Jul 24 17:20:03.078722 ip-10-0-141-115 systemd[1]: Starting Kubernetes Kubelet... Jul 24 17:20:03.476446 ip-10-0-141-115 kubenswrapper[2570]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 17:20:03.476446 ip-10-0-141-115 kubenswrapper[2570]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 24 17:20:03.476446 ip-10-0-141-115 kubenswrapper[2570]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 17:20:03.477131 ip-10-0-141-115 kubenswrapper[2570]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 24 17:20:03.477131 ip-10-0-141-115 kubenswrapper[2570]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 17:20:03.478244 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.478110 2570 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 24 17:20:03.484082 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484068 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 17:20:03.484120 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484083 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 17:20:03.484120 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484088 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 17:20:03.484120 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484091 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 17:20:03.484120 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484094 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 17:20:03.484120 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484097 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 17:20:03.484120 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484100 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 17:20:03.484120 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484109 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 17:20:03.484120 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484112 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 17:20:03.484120 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484114 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 17:20:03.484120 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484117 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 17:20:03.484120 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484119 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 17:20:03.484120 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484122 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 17:20:03.484120 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484125 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 17:20:03.484428 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484128 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 17:20:03.484428 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484131 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 17:20:03.484428 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484133 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 17:20:03.484428 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484137 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 17:20:03.484428 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484140 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 17:20:03.484428 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484142 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 17:20:03.484428 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484145 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 17:20:03.484428 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484148 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 17:20:03.484428 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484150 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 17:20:03.484428 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484153 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 17:20:03.484428 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484155 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 17:20:03.484428 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484158 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 17:20:03.484428 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484160 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 17:20:03.484428 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484163 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 17:20:03.484428 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484165 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 17:20:03.484428 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484168 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 17:20:03.484428 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484170 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 17:20:03.484428 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484174 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 17:20:03.484428 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484176 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 17:20:03.484891 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484179 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 17:20:03.484891 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484181 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 17:20:03.484891 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484184 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 17:20:03.484891 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484186 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 17:20:03.484891 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484189 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 17:20:03.484891 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484192 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 17:20:03.484891 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484195 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 17:20:03.484891 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484197 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 17:20:03.484891 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484200 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 17:20:03.484891 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484203 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 17:20:03.484891 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484205 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 17:20:03.484891 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484207 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 17:20:03.484891 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484210 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 17:20:03.484891 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484213 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 17:20:03.484891 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484216 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 17:20:03.484891 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484219 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 17:20:03.484891 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484221 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 17:20:03.484891 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484224 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 17:20:03.484891 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484226 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 17:20:03.484891 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484229 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 17:20:03.485377 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484231 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 17:20:03.485377 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484234 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 17:20:03.485377 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484237 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 17:20:03.485377 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484239 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 17:20:03.485377 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484242 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 17:20:03.485377 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484246 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 17:20:03.485377 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484250 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 17:20:03.485377 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484253 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 17:20:03.485377 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484256 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 17:20:03.485377 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484258 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 17:20:03.485377 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484261 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 17:20:03.485377 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484263 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 24 17:20:03.485377 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484266 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 17:20:03.485377 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484268 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 17:20:03.485377 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484271 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 17:20:03.485377 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484273 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 17:20:03.485377 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484276 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 17:20:03.485377 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484279 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 17:20:03.485377 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484282 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 17:20:03.485377 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484284 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 17:20:03.485959 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484287 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 17:20:03.485959 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484289 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 17:20:03.485959 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484292 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 17:20:03.485959 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484295 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 17:20:03.485959 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484297 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 17:20:03.485959 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484301 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 17:20:03.485959 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484304 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 17:20:03.485959 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484307 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 17:20:03.485959 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484309 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 17:20:03.485959 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484312 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 17:20:03.485959 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484314 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 17:20:03.485959 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484317 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 17:20:03.485959 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484319 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 17:20:03.485959 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484323 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 17:20:03.485959 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484325 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 17:20:03.485959 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484328 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 17:20:03.485959 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484330 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 17:20:03.485959 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484333 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 17:20:03.485959 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484335 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 17:20:03.485959 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484339 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 17:20:03.486473 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484342 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 17:20:03.486473 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484345 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 17:20:03.486473 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484348 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 17:20:03.486473 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484351 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 17:20:03.486473 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484355 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 17:20:03.486473 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.484358 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 17:20:03.486473 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485074 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 17:20:03.486473 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485081 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 17:20:03.486473 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485084 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 17:20:03.486473 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485087 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 17:20:03.486473 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485090 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 17:20:03.486473 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485100 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 17:20:03.486473 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485103 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 17:20:03.486473 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485106 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 17:20:03.486473 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485109 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 17:20:03.486473 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485111 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 17:20:03.486473 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485114 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 17:20:03.486473 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485117 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 17:20:03.486473 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485120 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 17:20:03.486473 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485123 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 17:20:03.486997 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485125 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 17:20:03.486997 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485128 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 17:20:03.486997 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485131 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 17:20:03.486997 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485134 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 17:20:03.486997 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485138 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 17:20:03.486997 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485142 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 17:20:03.486997 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485145 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 17:20:03.486997 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485147 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 17:20:03.486997 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485151 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 17:20:03.486997 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485153 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 17:20:03.486997 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485156 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 17:20:03.486997 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485158 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 17:20:03.486997 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485161 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 17:20:03.486997 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485163 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 17:20:03.486997 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485166 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 17:20:03.486997 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485168 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 17:20:03.486997 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485171 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 24 17:20:03.486997 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485173 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 17:20:03.486997 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485176 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 17:20:03.486997 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485178 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 17:20:03.487487 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485181 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 17:20:03.487487 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485183 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 17:20:03.487487 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485185 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 17:20:03.487487 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485188 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 17:20:03.487487 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485195 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 17:20:03.487487 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485198 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 17:20:03.487487 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485201 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 17:20:03.487487 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485203 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 17:20:03.487487 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485206 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 17:20:03.487487 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485209 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 17:20:03.487487 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485213 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 17:20:03.487487 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485216 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 17:20:03.487487 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485219 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 17:20:03.487487 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485221 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 17:20:03.487487 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485224 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 17:20:03.487487 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485227 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 17:20:03.487487 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485230 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 17:20:03.487487 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485233 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 17:20:03.487487 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485235 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 17:20:03.487957 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485238 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 17:20:03.487957 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485240 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 17:20:03.487957 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485243 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 17:20:03.487957 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485245 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 17:20:03.487957 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485248 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 17:20:03.487957 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485251 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 17:20:03.487957 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485253 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 17:20:03.487957 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485256 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 17:20:03.487957 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485258 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 17:20:03.487957 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485261 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 17:20:03.487957 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485263 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 17:20:03.487957 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485266 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 17:20:03.487957 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485268 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 17:20:03.487957 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485271 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 17:20:03.487957 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485273 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 17:20:03.487957 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485276 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 17:20:03.487957 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485278 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 17:20:03.487957 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485280 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 17:20:03.487957 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485284 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 17:20:03.487957 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485286 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 17:20:03.488437 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485289 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 17:20:03.488437 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485291 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 17:20:03.488437 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485294 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 17:20:03.488437 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485297 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 17:20:03.488437 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485300 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 17:20:03.488437 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485302 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 17:20:03.488437 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485307 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 17:20:03.488437 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485311 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 17:20:03.488437 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485314 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 17:20:03.488437 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485317 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 17:20:03.488437 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485320 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 17:20:03.488437 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485323 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 17:20:03.488437 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485325 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 17:20:03.488437 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485328 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 17:20:03.488437 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485330 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 17:20:03.488437 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485333 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 17:20:03.488437 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485335 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 17:20:03.488437 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485338 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 17:20:03.488437 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485340 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 17:20:03.488905 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485342 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 17:20:03.488905 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485345 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 17:20:03.488905 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485347 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 17:20:03.488905 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485350 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 17:20:03.488905 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485353 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 17:20:03.488905 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485355 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 17:20:03.488905 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485358 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 17:20:03.488905 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485767 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 17:20:03.488905 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485774 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 17:20:03.488905 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485778 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 17:20:03.488905 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485781 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 17:20:03.488905 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485785 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 17:20:03.488905 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485788 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 17:20:03.488905 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485791 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 17:20:03.488905 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485793 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 17:20:03.488905 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485796 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 17:20:03.488905 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485799 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 17:20:03.488905 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485802 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 17:20:03.488905 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485805 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 17:20:03.489362 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485807 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 17:20:03.489362 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485810 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 17:20:03.489362 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485813 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 17:20:03.489362 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485815 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 17:20:03.489362 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485818 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 17:20:03.489362 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485820 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 17:20:03.489362 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485823 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 17:20:03.489362 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485826 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 17:20:03.489362 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485828 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 17:20:03.489362 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485831 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 17:20:03.489362 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485833 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 17:20:03.489362 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485836 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 17:20:03.489362 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485838 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 17:20:03.489362 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485841 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 17:20:03.489362 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485843 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 17:20:03.489362 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485846 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 17:20:03.489362 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485848 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 17:20:03.489362 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485851 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 17:20:03.489362 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485853 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 17:20:03.489362 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485856 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 17:20:03.489861 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485858 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 17:20:03.489861 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485863 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 17:20:03.489861 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485866 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 17:20:03.489861 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485869 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 17:20:03.489861 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485873 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 17:20:03.489861 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485876 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 17:20:03.489861 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485880 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 17:20:03.489861 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485882 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 17:20:03.489861 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485885 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 17:20:03.489861 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485888 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 17:20:03.489861 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485891 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 17:20:03.489861 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485894 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 17:20:03.489861 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485896 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 17:20:03.489861 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485899 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 17:20:03.489861 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485901 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 17:20:03.489861 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485904 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 17:20:03.489861 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485906 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 17:20:03.489861 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485909 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 17:20:03.489861 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485912 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 17:20:03.490333 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485915 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 17:20:03.490333 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485918 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 17:20:03.490333 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485920 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 17:20:03.490333 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485923 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 17:20:03.490333 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485925 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 17:20:03.490333 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485928 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 17:20:03.490333 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485930 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 17:20:03.490333 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485933 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 17:20:03.490333 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485936 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 17:20:03.490333 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485938 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 17:20:03.490333 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485941 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 17:20:03.490333 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485943 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 17:20:03.490333 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485946 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 17:20:03.490333 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485948 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 17:20:03.490333 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485951 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 17:20:03.490333 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485954 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 17:20:03.490333 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485956 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 17:20:03.490333 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485959 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 17:20:03.490333 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485961 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 17:20:03.490333 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485964 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 17:20:03.490831 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485967 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 17:20:03.490831 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485970 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 17:20:03.490831 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485973 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 17:20:03.490831 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485976 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 17:20:03.490831 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485978 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 17:20:03.490831 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485981 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 17:20:03.490831 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485983 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 17:20:03.490831 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485986 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 17:20:03.490831 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485989 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 17:20:03.490831 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485991 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 17:20:03.490831 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485993 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 17:20:03.490831 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485996 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 17:20:03.490831 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.485998 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 17:20:03.490831 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486001 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 17:20:03.490831 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486003 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 17:20:03.490831 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486006 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 17:20:03.490831 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486008 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 17:20:03.490831 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486011 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 17:20:03.490831 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486014 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 17:20:03.490831 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486016 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 17:20:03.491307 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486018 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 17:20:03.491307 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486021 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 17:20:03.491307 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486037 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 17:20:03.491307 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486040 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 17:20:03.491307 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486043 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 24 17:20:03.491307 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486045 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 17:20:03.491307 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486050 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 17:20:03.491307 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486052 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 17:20:03.491307 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486117 2570 flags.go:64] FLAG: --address="0.0.0.0" Jul 24 17:20:03.491307 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486124 2570 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 24 17:20:03.491307 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486130 2570 flags.go:64] FLAG: --anonymous-auth="true" Jul 24 17:20:03.491307 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486134 2570 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 24 17:20:03.491307 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486139 2570 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 24 17:20:03.491307 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486142 2570 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 24 17:20:03.491307 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486147 2570 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 24 17:20:03.491307 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486151 2570 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 24 17:20:03.491307 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486155 2570 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 24 17:20:03.491307 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486158 2570 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 24 17:20:03.491307 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486161 2570 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 24 17:20:03.491307 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486164 2570 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 24 17:20:03.491307 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486167 2570 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 24 17:20:03.491307 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486170 2570 flags.go:64] FLAG: --cgroup-root="" Jul 24 17:20:03.491889 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486173 2570 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 24 17:20:03.491889 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486176 2570 flags.go:64] FLAG: --client-ca-file="" Jul 24 17:20:03.491889 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486179 2570 flags.go:64] FLAG: --cloud-provider="external" Jul 24 17:20:03.491889 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486181 2570 flags.go:64] FLAG: --cluster-dns="[]" Jul 24 17:20:03.491889 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486186 2570 flags.go:64] FLAG: --cluster-domain="" Jul 24 17:20:03.491889 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486189 2570 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 24 17:20:03.491889 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486192 2570 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 24 17:20:03.491889 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486194 2570 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 24 17:20:03.491889 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486198 2570 flags.go:64] FLAG: --container-log-max-files="5" Jul 24 17:20:03.491889 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486201 2570 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 24 17:20:03.491889 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486204 2570 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 24 17:20:03.491889 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486207 2570 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 24 17:20:03.491889 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486210 2570 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 24 17:20:03.491889 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486213 2570 flags.go:64] FLAG: --contention-profiling="false" Jul 24 17:20:03.491889 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486216 2570 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 24 17:20:03.491889 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486219 2570 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 24 17:20:03.491889 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486223 2570 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 24 17:20:03.491889 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486226 2570 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 24 17:20:03.491889 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486230 2570 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 24 17:20:03.491889 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486233 2570 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 24 17:20:03.491889 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486236 2570 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 24 17:20:03.491889 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486239 2570 flags.go:64] FLAG: --enable-load-reader="false" Jul 24 17:20:03.491889 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486242 2570 flags.go:64] FLAG: --enable-server="true" Jul 24 17:20:03.491889 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486245 2570 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 24 17:20:03.491889 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486251 2570 flags.go:64] FLAG: --event-burst="100" Jul 24 17:20:03.492492 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486255 2570 flags.go:64] FLAG: --event-qps="50" Jul 24 17:20:03.492492 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486257 2570 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 24 17:20:03.492492 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486260 2570 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 24 17:20:03.492492 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486263 2570 flags.go:64] FLAG: --eviction-hard="" Jul 24 17:20:03.492492 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486266 2570 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 24 17:20:03.492492 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486269 2570 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 24 17:20:03.492492 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486272 2570 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 24 17:20:03.492492 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486275 2570 flags.go:64] FLAG: --eviction-soft="" Jul 24 17:20:03.492492 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486278 2570 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 24 17:20:03.492492 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486280 2570 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 24 17:20:03.492492 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486283 2570 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 24 17:20:03.492492 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486286 2570 flags.go:64] FLAG: --experimental-mounter-path="" Jul 24 17:20:03.492492 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486289 2570 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 24 17:20:03.492492 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486292 2570 flags.go:64] FLAG: --fail-swap-on="true" Jul 24 17:20:03.492492 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486294 2570 flags.go:64] FLAG: --feature-gates="" Jul 24 17:20:03.492492 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486298 2570 flags.go:64] FLAG: --file-check-frequency="20s" Jul 24 17:20:03.492492 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486301 2570 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 24 17:20:03.492492 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486304 2570 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 24 17:20:03.492492 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486307 2570 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 24 17:20:03.492492 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486310 2570 flags.go:64] FLAG: --healthz-port="10248" Jul 24 17:20:03.492492 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486313 2570 flags.go:64] FLAG: --help="false" Jul 24 17:20:03.492492 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486317 2570 flags.go:64] FLAG: --hostname-override="ip-10-0-141-115.ec2.internal" Jul 24 17:20:03.492492 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486320 2570 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 24 17:20:03.492492 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486324 2570 flags.go:64] FLAG: --http-check-frequency="20s" Jul 24 17:20:03.493079 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486327 2570 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 24 17:20:03.493079 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486331 2570 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 24 17:20:03.493079 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486334 2570 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 24 17:20:03.493079 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486337 2570 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 24 17:20:03.493079 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486339 2570 flags.go:64] FLAG: --image-service-endpoint="" Jul 24 17:20:03.493079 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486342 2570 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 24 17:20:03.493079 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486345 2570 flags.go:64] FLAG: --kube-api-burst="100" Jul 24 17:20:03.493079 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486348 2570 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 24 17:20:03.493079 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486352 2570 flags.go:64] FLAG: --kube-api-qps="50" Jul 24 17:20:03.493079 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486354 2570 flags.go:64] FLAG: --kube-reserved="" Jul 24 17:20:03.493079 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486357 2570 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 24 17:20:03.493079 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486360 2570 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 24 17:20:03.493079 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486363 2570 flags.go:64] FLAG: --kubelet-cgroups="" Jul 24 17:20:03.493079 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486366 2570 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 24 17:20:03.493079 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486368 2570 flags.go:64] FLAG: --lock-file="" Jul 24 17:20:03.493079 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486371 2570 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 24 17:20:03.493079 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486374 2570 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 24 17:20:03.493079 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486377 2570 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 24 17:20:03.493079 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486382 2570 flags.go:64] FLAG: --log-json-split-stream="false" Jul 24 17:20:03.493079 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486384 2570 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 24 17:20:03.493079 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486387 2570 flags.go:64] FLAG: --log-text-split-stream="false" Jul 24 17:20:03.493079 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486390 2570 flags.go:64] FLAG: --logging-format="text" Jul 24 17:20:03.493079 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486393 2570 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 24 17:20:03.493658 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486396 2570 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 24 17:20:03.493658 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486398 2570 flags.go:64] FLAG: --manifest-url="" Jul 24 17:20:03.493658 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486401 2570 flags.go:64] FLAG: --manifest-url-header="" Jul 24 17:20:03.493658 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486405 2570 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 24 17:20:03.493658 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486408 2570 flags.go:64] FLAG: --max-open-files="1000000" Jul 24 17:20:03.493658 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486411 2570 flags.go:64] FLAG: --max-pods="110" Jul 24 17:20:03.493658 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486416 2570 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 24 17:20:03.493658 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486419 2570 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 24 17:20:03.493658 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486423 2570 flags.go:64] FLAG: --memory-manager-policy="None" Jul 24 17:20:03.493658 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486426 2570 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 24 17:20:03.493658 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486429 2570 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 24 17:20:03.493658 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486432 2570 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 24 17:20:03.493658 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486435 2570 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 24 17:20:03.493658 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486441 2570 flags.go:64] FLAG: --node-status-max-images="50" Jul 24 17:20:03.493658 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486444 2570 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 24 17:20:03.493658 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486463 2570 flags.go:64] FLAG: --oom-score-adj="-999" Jul 24 17:20:03.493658 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486466 2570 flags.go:64] FLAG: --pod-cidr="" Jul 24 17:20:03.493658 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486469 2570 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 24 17:20:03.493658 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486475 2570 flags.go:64] FLAG: --pod-manifest-path="" Jul 24 17:20:03.493658 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486478 2570 flags.go:64] FLAG: --pod-max-pids="-1" Jul 24 17:20:03.493658 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486481 2570 flags.go:64] FLAG: --pods-per-core="0" Jul 24 17:20:03.493658 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486484 2570 flags.go:64] FLAG: --port="10250" Jul 24 17:20:03.493658 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486487 2570 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 24 17:20:03.493658 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486490 2570 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-07b8f2bf5e1984700" Jul 24 17:20:03.494248 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486493 2570 flags.go:64] FLAG: --qos-reserved="" Jul 24 17:20:03.494248 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486496 2570 flags.go:64] FLAG: --read-only-port="10255" Jul 24 17:20:03.494248 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486499 2570 flags.go:64] FLAG: --register-node="true" Jul 24 17:20:03.494248 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486502 2570 flags.go:64] FLAG: --register-with-taints="" Jul 24 17:20:03.494248 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486505 2570 flags.go:64] FLAG: --registry-burst="10" Jul 24 17:20:03.494248 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486508 2570 flags.go:64] FLAG: --registry-qps="5" Jul 24 17:20:03.494248 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486510 2570 flags.go:64] FLAG: --reserved-cpus="" Jul 24 17:20:03.494248 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486513 2570 flags.go:64] FLAG: --reserved-memory="" Jul 24 17:20:03.494248 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486517 2570 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 24 17:20:03.494248 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486520 2570 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 24 17:20:03.494248 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486523 2570 flags.go:64] FLAG: --rotate-certificates="false" Jul 24 17:20:03.494248 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486525 2570 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 24 17:20:03.494248 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486528 2570 flags.go:64] FLAG: --runonce="false" Jul 24 17:20:03.494248 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486531 2570 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 24 17:20:03.494248 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486534 2570 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 24 17:20:03.494248 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486538 2570 flags.go:64] FLAG: --seccomp-default="false" Jul 24 17:20:03.494248 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486542 2570 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 24 17:20:03.494248 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486545 2570 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 24 17:20:03.494248 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486547 2570 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 24 17:20:03.494248 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486550 2570 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 24 17:20:03.494248 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486553 2570 flags.go:64] FLAG: --storage-driver-password="root" Jul 24 17:20:03.494248 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486556 2570 flags.go:64] FLAG: --storage-driver-secure="false" Jul 24 17:20:03.494248 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486559 2570 flags.go:64] FLAG: --storage-driver-table="stats" Jul 24 17:20:03.494248 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486562 2570 flags.go:64] FLAG: --storage-driver-user="root" Jul 24 17:20:03.494248 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486564 2570 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 24 17:20:03.494248 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486567 2570 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 24 17:20:03.494874 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486570 2570 flags.go:64] FLAG: --system-cgroups="" Jul 24 17:20:03.494874 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486573 2570 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 24 17:20:03.494874 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486578 2570 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 24 17:20:03.494874 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486581 2570 flags.go:64] FLAG: --tls-cert-file="" Jul 24 17:20:03.494874 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486584 2570 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 24 17:20:03.494874 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486587 2570 flags.go:64] FLAG: --tls-min-version="" Jul 24 17:20:03.494874 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486590 2570 flags.go:64] FLAG: --tls-private-key-file="" Jul 24 17:20:03.494874 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486593 2570 flags.go:64] FLAG: --topology-manager-policy="none" Jul 24 17:20:03.494874 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486595 2570 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 24 17:20:03.494874 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486598 2570 flags.go:64] FLAG: --topology-manager-scope="container" Jul 24 17:20:03.494874 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486601 2570 flags.go:64] FLAG: --v="2" Jul 24 17:20:03.494874 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486604 2570 flags.go:64] FLAG: --version="false" Jul 24 17:20:03.494874 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486608 2570 flags.go:64] FLAG: --vmodule="" Jul 24 17:20:03.494874 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486611 2570 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 24 17:20:03.494874 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.486614 2570 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 24 17:20:03.494874 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486729 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 17:20:03.494874 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486733 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 17:20:03.494874 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486736 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 17:20:03.494874 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486738 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 17:20:03.494874 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486741 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 17:20:03.494874 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486744 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 17:20:03.494874 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486748 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 17:20:03.494874 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486752 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 17:20:03.495460 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486754 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 17:20:03.495460 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486757 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 24 17:20:03.495460 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486759 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 17:20:03.495460 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486762 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 17:20:03.495460 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486764 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 17:20:03.495460 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486767 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 17:20:03.495460 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486770 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 17:20:03.495460 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486773 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 17:20:03.495460 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486775 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 17:20:03.495460 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486778 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 17:20:03.495460 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486781 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 17:20:03.495460 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486783 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 17:20:03.495460 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486787 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 17:20:03.495460 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486789 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 17:20:03.495460 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486792 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 17:20:03.495460 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486794 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 17:20:03.495460 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486798 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 17:20:03.495460 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486802 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 17:20:03.495460 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486806 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 17:20:03.495460 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486808 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 17:20:03.495953 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486811 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 17:20:03.495953 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486814 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 17:20:03.495953 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486816 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 17:20:03.495953 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486819 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 17:20:03.495953 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486821 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 17:20:03.495953 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486824 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 17:20:03.495953 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486826 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 17:20:03.495953 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486829 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 17:20:03.495953 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486831 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 17:20:03.495953 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486834 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 17:20:03.495953 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486837 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 17:20:03.495953 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486841 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 17:20:03.495953 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486843 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 17:20:03.495953 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486846 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 17:20:03.495953 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486849 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 17:20:03.495953 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486851 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 17:20:03.495953 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486854 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 17:20:03.495953 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486856 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 17:20:03.495953 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486858 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 17:20:03.495953 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486861 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 17:20:03.496468 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486864 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 17:20:03.496468 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486866 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 17:20:03.496468 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486869 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 17:20:03.496468 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486872 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 17:20:03.496468 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486874 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 17:20:03.496468 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486877 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 17:20:03.496468 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486879 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 17:20:03.496468 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486882 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 17:20:03.496468 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486884 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 17:20:03.496468 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486887 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 17:20:03.496468 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486890 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 17:20:03.496468 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486892 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 17:20:03.496468 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486895 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 17:20:03.496468 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486897 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 17:20:03.496468 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486900 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 17:20:03.496468 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486903 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 17:20:03.496468 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486905 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 17:20:03.496468 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486908 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 17:20:03.496468 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486910 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 17:20:03.496468 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486913 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 17:20:03.497000 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486915 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 17:20:03.497000 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486918 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 17:20:03.497000 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486924 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 17:20:03.497000 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486929 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 17:20:03.497000 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486931 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 17:20:03.497000 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486934 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 17:20:03.497000 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486937 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 17:20:03.497000 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486940 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 17:20:03.497000 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486942 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 17:20:03.497000 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486944 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 17:20:03.497000 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486947 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 17:20:03.497000 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486949 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 17:20:03.497000 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486952 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 17:20:03.497000 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486954 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 17:20:03.497000 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486958 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 17:20:03.497000 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486961 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 17:20:03.497000 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486965 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 17:20:03.497000 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486968 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 17:20:03.497000 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486971 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 17:20:03.497477 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486974 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 17:20:03.497477 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486977 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 17:20:03.497477 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486979 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 17:20:03.497477 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486983 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 17:20:03.497477 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486986 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 17:20:03.497477 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486988 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 17:20:03.497477 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486991 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 17:20:03.497477 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486993 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 17:20:03.497477 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486996 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 17:20:03.497477 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.486999 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 17:20:03.497477 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.487001 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 17:20:03.497477 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.487004 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 17:20:03.497477 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.488103 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 17:20:03.497477 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.495042 2570 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 24 17:20:03.497477 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.495056 2570 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 24 17:20:03.497852 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.495809 2570 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 24 17:20:03.497852 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.495817 2570 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 24 17:20:03.497852 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.495882 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 17:20:03.497852 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.495887 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 17:20:03.497852 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.495891 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 17:20:03.497852 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.495894 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 17:20:03.497852 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.495897 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 17:20:03.497852 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.495900 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 17:20:03.497852 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.495904 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 17:20:03.497852 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.495907 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 17:20:03.497852 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.495909 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 17:20:03.497852 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.495912 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 17:20:03.497852 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.495915 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 17:20:03.497852 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.495918 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 17:20:03.497852 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.495928 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 17:20:03.497852 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.495932 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 17:20:03.497852 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.495935 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 17:20:03.497852 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.495938 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 17:20:03.497852 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.495941 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 17:20:03.498305 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.495943 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 17:20:03.498305 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.495946 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 24 17:20:03.498305 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.495949 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 17:20:03.498305 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.495951 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 17:20:03.498305 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.495954 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 17:20:03.498305 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.495957 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 17:20:03.498305 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.495959 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 17:20:03.498305 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.495962 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 17:20:03.498305 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.495965 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 17:20:03.498305 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.495967 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 17:20:03.498305 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.495970 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 17:20:03.498305 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.495972 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 17:20:03.498305 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.495976 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 17:20:03.498305 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.495979 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 17:20:03.498305 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.495981 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 17:20:03.498305 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.495983 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 17:20:03.498305 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.495986 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 17:20:03.498305 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.495988 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 17:20:03.498305 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.495991 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 17:20:03.498305 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.495993 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 17:20:03.498863 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.495996 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 17:20:03.498863 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496000 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 17:20:03.498863 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496003 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 17:20:03.498863 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496006 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 17:20:03.498863 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496008 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 17:20:03.498863 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496011 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 17:20:03.498863 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496013 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 17:20:03.498863 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496016 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 17:20:03.498863 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496023 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 17:20:03.498863 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496026 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 17:20:03.498863 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496028 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 17:20:03.498863 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496031 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 17:20:03.498863 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496034 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 17:20:03.498863 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496036 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 17:20:03.498863 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496039 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 17:20:03.498863 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496041 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 17:20:03.498863 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496045 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 17:20:03.498863 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496047 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 17:20:03.498863 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496050 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 17:20:03.498863 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496052 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 17:20:03.499344 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496055 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 17:20:03.499344 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496057 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 17:20:03.499344 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496060 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 17:20:03.499344 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496062 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 17:20:03.499344 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496065 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 17:20:03.499344 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496068 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 17:20:03.499344 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496071 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 17:20:03.499344 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496073 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 17:20:03.499344 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496076 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 17:20:03.499344 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496078 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 17:20:03.499344 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496081 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 17:20:03.499344 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496083 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 17:20:03.499344 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496086 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 17:20:03.499344 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496088 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 17:20:03.499344 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496091 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 17:20:03.499344 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496093 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 17:20:03.499344 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496097 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 17:20:03.499344 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496100 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 17:20:03.499344 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496103 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 17:20:03.500016 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496106 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 17:20:03.500016 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496109 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 17:20:03.500016 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496117 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 17:20:03.500016 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496119 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 17:20:03.500016 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496122 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 17:20:03.500016 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496124 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 17:20:03.500016 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496127 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 17:20:03.500016 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496129 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 17:20:03.500016 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496132 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 17:20:03.500016 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496135 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 17:20:03.500016 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496137 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 17:20:03.500016 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496140 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 17:20:03.500016 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496142 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 17:20:03.500016 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496145 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 17:20:03.500016 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496147 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 17:20:03.500016 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496150 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 17:20:03.500016 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496152 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 17:20:03.500016 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496155 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 17:20:03.500016 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496157 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 17:20:03.500541 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496160 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 17:20:03.500541 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496162 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 17:20:03.500541 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496165 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 17:20:03.500541 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496167 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 17:20:03.500541 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.496172 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 17:20:03.500541 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496347 2570 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 17:20:03.500541 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496352 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 17:20:03.500541 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496355 2570 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 17:20:03.500541 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496358 2570 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 17:20:03.500541 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496361 2570 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 17:20:03.500541 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496363 2570 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 17:20:03.500541 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496366 2570 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 17:20:03.500541 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496369 2570 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 17:20:03.500541 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496371 2570 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 17:20:03.500541 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496374 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 17:20:03.500906 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496377 2570 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 17:20:03.500906 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496386 2570 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 17:20:03.500906 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496388 2570 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 17:20:03.500906 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496391 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 17:20:03.500906 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496393 2570 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 17:20:03.500906 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496396 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 17:20:03.500906 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496399 2570 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 17:20:03.500906 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496401 2570 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 17:20:03.500906 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496404 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 17:20:03.500906 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496406 2570 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 17:20:03.500906 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496409 2570 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 17:20:03.500906 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496411 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 17:20:03.500906 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496414 2570 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 17:20:03.500906 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496416 2570 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 17:20:03.500906 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496418 2570 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 17:20:03.500906 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496421 2570 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 17:20:03.500906 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496423 2570 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 17:20:03.500906 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496426 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 17:20:03.500906 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496428 2570 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 17:20:03.500906 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496431 2570 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 17:20:03.501403 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496433 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 17:20:03.501403 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496436 2570 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 17:20:03.501403 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496438 2570 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 17:20:03.501403 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496441 2570 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 17:20:03.501403 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496443 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 17:20:03.501403 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496446 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 17:20:03.501403 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496464 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 17:20:03.501403 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496468 2570 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 17:20:03.501403 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496472 2570 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 17:20:03.501403 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496477 2570 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 17:20:03.501403 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496481 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 17:20:03.501403 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496484 2570 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 17:20:03.501403 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496487 2570 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 17:20:03.501403 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496489 2570 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 17:20:03.501403 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496498 2570 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 17:20:03.501403 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496501 2570 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 17:20:03.501403 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496504 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 17:20:03.501403 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496507 2570 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 17:20:03.501403 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496509 2570 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 17:20:03.502019 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496512 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 17:20:03.502019 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496515 2570 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 17:20:03.502019 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496519 2570 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 17:20:03.502019 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496522 2570 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 17:20:03.502019 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496525 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 17:20:03.502019 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496528 2570 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 17:20:03.502019 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496530 2570 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 17:20:03.502019 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496533 2570 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 17:20:03.502019 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496535 2570 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 17:20:03.502019 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496538 2570 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 17:20:03.502019 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496540 2570 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 17:20:03.502019 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496543 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 17:20:03.502019 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496545 2570 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 17:20:03.502019 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496548 2570 feature_gate.go:328] unrecognized feature gate: Example Jul 24 17:20:03.502019 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496550 2570 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 17:20:03.502019 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496553 2570 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 17:20:03.502019 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496555 2570 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 17:20:03.502019 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496558 2570 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 17:20:03.502019 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496560 2570 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 17:20:03.502019 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496562 2570 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 17:20:03.502576 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496565 2570 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 17:20:03.502576 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496567 2570 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 17:20:03.502576 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496570 2570 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 17:20:03.502576 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496572 2570 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 17:20:03.502576 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496575 2570 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 17:20:03.502576 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496577 2570 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 17:20:03.502576 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496580 2570 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 17:20:03.502576 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496583 2570 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 17:20:03.502576 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496590 2570 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 17:20:03.502576 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496593 2570 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 17:20:03.502576 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496595 2570 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 17:20:03.502576 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496597 2570 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 17:20:03.502576 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496600 2570 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 17:20:03.502576 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496603 2570 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 17:20:03.502576 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496605 2570 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 17:20:03.502576 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496613 2570 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 17:20:03.502576 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496616 2570 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 17:20:03.502576 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496618 2570 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 17:20:03.502576 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496621 2570 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 17:20:03.502576 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496623 2570 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 17:20:03.503293 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496626 2570 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 17:20:03.503293 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496628 2570 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 17:20:03.503293 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496631 2570 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 17:20:03.503293 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496633 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 17:20:03.503293 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496636 2570 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 17:20:03.503293 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496638 2570 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 17:20:03.503293 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496641 2570 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 17:20:03.503293 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496643 2570 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 17:20:03.503293 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496646 2570 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 17:20:03.503293 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:03.496648 2570 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 17:20:03.503293 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.496653 2570 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 17:20:03.503293 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.496752 2570 server.go:962] "Client rotation is on, will bootstrap in background" Jul 24 17:20:03.503293 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.498733 2570 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 24 17:20:03.503293 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.501626 2570 server.go:1019] "Starting client certificate rotation" Jul 24 17:20:03.503739 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.501738 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 17:20:03.503739 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.501791 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 17:20:03.505052 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.505038 2570 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 17:20:03.506204 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.506183 2570 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 17:20:03.518987 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.518968 2570 log.go:25] "Validated CRI v1 runtime API" Jul 24 17:20:03.521030 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.521015 2570 log.go:25] "Validated CRI v1 image API" Jul 24 17:20:03.521838 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.521827 2570 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 24 17:20:03.524286 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.524267 2570 fs.go:135] Filesystem UUIDs: map[3fa292bd-13d4-4179-a92d-8803ba7e5267:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 9bd4ad11-c4ac-44ef-a642-a21bdb84c6a0:/dev/nvme0n1p3] Jul 24 17:20:03.524343 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.524286 2570 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 24 17:20:03.529989 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.529872 2570 manager.go:216] Machine: {Timestamp:2026-07-24 17:20:03.528532987 +0000 UTC m=+0.333824953 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101545 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2f2a60bc0a1ea4de90d2bc0b5561c5 SystemUUID:ec2f2a60-bc0a-1ea4-de90-d2bc0b5561c5 BootID:96d41772-e4ec-413a-b51b-b4b155f8cc6e Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:83:ad:65:c0:e7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:83:ad:65:c0:e7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:e6:5a:5b:44:1f:8d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 24 17:20:03.529989 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.529982 2570 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 24 17:20:03.530097 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.530062 2570 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 24 17:20:03.531469 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.531432 2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 17:20:03.533178 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.533150 2570 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 24 17:20:03.533328 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.533180 2570 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-115.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 24 17:20:03.533851 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.533839 2570 topology_manager.go:138] "Creating topology manager with none policy" Jul 24 17:20:03.533891 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.533853 2570 container_manager_linux.go:309] "Creating device plugin manager" Jul 24 17:20:03.533891 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.533860 2570 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 17:20:03.534475 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.534466 2570 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 17:20:03.535534 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.535516 2570 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 24 17:20:03.539196 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.539185 2570 state_mem.go:36] "Initialized new in-memory state store" Jul 24 17:20:03.539355 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.539344 2570 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 24 17:20:03.539394 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.539374 2570 kubelet.go:486] "Attempting to sync node with API server" Jul 24 17:20:03.539394 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.539388 2570 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 24 17:20:03.539506 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.539404 2570 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 24 17:20:03.539506 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.539439 2570 kubelet.go:398] "Adding apiserver pod source" Jul 24 17:20:03.539506 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.539466 2570 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 24 17:20:03.539976 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.539963 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 17:20:03.540025 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.539985 2570 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 17:20:03.544115 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.544090 2570 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 24 17:20:03.545815 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.545798 2570 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 24 17:20:03.545891 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.545830 2570 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 24 17:20:03.546595 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.546581 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 24 17:20:03.546640 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.546602 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 24 17:20:03.546640 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.546608 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 24 17:20:03.546640 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.546614 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 24 17:20:03.546640 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.546622 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 24 17:20:03.546640 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.546627 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 24 17:20:03.546782 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.546680 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 24 17:20:03.546782 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.546687 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 24 17:20:03.546782 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.546697 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 24 17:20:03.546782 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.546704 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 24 17:20:03.546782 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.546717 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 24 17:20:03.546782 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.546727 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 24 17:20:03.547943 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.547929 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 24 17:20:03.547943 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.547942 2570 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 24 17:20:03.549027 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:03.549008 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-115.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 24 17:20:03.549088 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:03.549007 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 24 17:20:03.551103 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.551091 2570 server.go:1268] "Started kubelet" Jul 24 17:20:03.551209 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.551180 2570 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 24 17:20:03.551209 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.551163 2570 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 24 17:20:03.551366 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.551233 2570 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 24 17:20:03.551983 ip-10-0-141-115 systemd[1]: Started Kubernetes Kubelet. Jul 24 17:20:03.552345 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.552327 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5vrww" Jul 24 17:20:03.552550 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.552489 2570 server.go:310] "Adding debug handlers to kubelet server" Jul 24 17:20:03.552937 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.552924 2570 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 24 17:20:03.556289 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:03.556270 2570 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 24 17:20:03.558621 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.558604 2570 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 24 17:20:03.558621 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.558616 2570 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 24 17:20:03.558826 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:03.558807 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-115.ec2.internal\" not found" Jul 24 17:20:03.559148 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.559118 2570 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 24 17:20:03.559227 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.559151 2570 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 24 17:20:03.559318 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.559305 2570 reconstruct.go:97] "Volume reconstruction finished" Jul 24 17:20:03.559318 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.559317 2570 reconciler.go:29] "Reconciler: start to sync state" Jul 24 17:20:03.559432 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.559404 2570 factory.go:55] Registering systemd factory Jul 24 17:20:03.559432 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.559424 2570 factory.go:223] Registration of the systemd container factory successfully Jul 24 17:20:03.559539 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.559505 2570 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 24 17:20:03.559539 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.559496 2570 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-115.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 24 17:20:03.559678 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.559652 2570 factory.go:153] Registering CRI-O factory Jul 24 17:20:03.559678 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.559670 2570 factory.go:223] Registration of the crio container factory successfully Jul 24 17:20:03.559813 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.559720 2570 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 24 17:20:03.559813 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.559749 2570 factory.go:103] Registering Raw factory Jul 24 17:20:03.559813 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.559769 2570 manager.go:1196] Started watching for new ooms in manager Jul 24 17:20:03.560238 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.560222 2570 manager.go:349] Starting recovery of all containers Jul 24 17:20:03.560322 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:03.559281 2570 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-115.ec2.internal.18c549772e6c6cc3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-115.ec2.internal,UID:ip-10-0-141-115.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-115.ec2.internal,},FirstTimestamp:2026-07-24 17:20:03.551063235 +0000 UTC m=+0.356355200,LastTimestamp:2026-07-24 17:20:03.551063235 +0000 UTC m=+0.356355200,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-115.ec2.internal,}" Jul 24 17:20:03.560901 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.560825 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-5vrww" Jul 24 17:20:03.563443 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:03.563418 2570 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 24 17:20:03.563561 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:03.563542 2570 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-141-115.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 24 17:20:03.570657 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.570630 2570 manager.go:354] Recovery completed Jul 24 17:20:03.573176 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:03.573154 2570 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 24 17:20:03.576157 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.576145 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 17:20:03.578461 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.578430 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-115.ec2.internal" event="NodeHasSufficientMemory" Jul 24 17:20:03.578554 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.578476 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-115.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 17:20:03.578554 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.578487 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-115.ec2.internal" event="NodeHasSufficientPID" Jul 24 17:20:03.578973 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.578957 2570 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 24 17:20:03.578973 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.578972 2570 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 24 17:20:03.579057 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.578971 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 17:20:03.579057 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.578987 2570 state_mem.go:36] "Initialized new in-memory state store" Jul 24 17:20:03.580340 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.580329 2570 policy_none.go:49] "None policy: Start" Jul 24 17:20:03.580411 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.580344 2570 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 24 17:20:03.580411 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.580354 2570 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 24 17:20:03.581434 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.581425 2570 policy_none.go:47] "Start" Jul 24 17:20:03.582541 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.582408 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-115.ec2.internal" event="NodeHasSufficientMemory" Jul 24 17:20:03.582628 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.582549 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-115.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 17:20:03.582628 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.582559 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-115.ec2.internal" event="NodeHasSufficientPID" Jul 24 17:20:03.616686 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.616675 2570 manager.go:337] "Starting Device Plugin manager" Jul 24 17:20:03.616738 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:03.616726 2570 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 24 17:20:03.616738 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.616737 2570 server.go:87] "Starting device plugin registration server" Jul 24 17:20:03.616964 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.616952 2570 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 24 17:20:03.617001 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.616967 2570 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 24 17:20:03.617143 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.617127 2570 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 24 17:20:03.617235 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.617203 2570 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 24 17:20:03.617235 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.617211 2570 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 24 17:20:03.617558 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:03.617540 2570 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 24 17:20:03.617632 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:03.617589 2570 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-115.ec2.internal\" not found" Jul 24 17:20:03.717691 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.717670 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 17:20:03.718597 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.718472 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-115.ec2.internal" event="NodeHasSufficientMemory" Jul 24 17:20:03.718597 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.718499 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-115.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 17:20:03.718597 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.718508 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-115.ec2.internal" event="NodeHasSufficientPID" Jul 24 17:20:03.718597 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.718539 2570 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-115.ec2.internal" Jul 24 17:20:03.726813 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.726769 2570 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-115.ec2.internal" Jul 24 17:20:03.726813 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:03.726788 2570 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-115.ec2.internal\": node \"ip-10-0-141-115.ec2.internal\" not found" Jul 24 17:20:03.750749 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:03.750730 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-115.ec2.internal\" not found" Jul 24 17:20:03.768762 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.768739 2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 24 17:20:03.770063 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.770049 2570 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 24 17:20:03.770144 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.770091 2570 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 24 17:20:03.770144 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.770114 2570 kubelet.go:2448] "Starting kubelet main sync loop" Jul 24 17:20:03.770232 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:03.770154 2570 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 24 17:20:03.772604 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.772586 2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 17:20:03.851153 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:03.851132 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-115.ec2.internal\" not found" Jul 24 17:20:03.870523 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.870494 2570 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-115.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-115.ec2.internal"] Jul 24 17:20:03.870600 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.870561 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 17:20:03.871438 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.871424 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-115.ec2.internal" event="NodeHasSufficientMemory" Jul 24 17:20:03.871530 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.871464 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-115.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 17:20:03.871530 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.871475 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-115.ec2.internal" event="NodeHasSufficientPID" Jul 24 17:20:03.872896 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.872884 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 17:20:03.873029 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.873014 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-115.ec2.internal" Jul 24 17:20:03.873077 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.873050 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 17:20:03.873592 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.873576 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-115.ec2.internal" event="NodeHasSufficientMemory" Jul 24 17:20:03.873671 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.873607 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-115.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 17:20:03.873671 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.873580 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-115.ec2.internal" event="NodeHasSufficientMemory" Jul 24 17:20:03.873671 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.873617 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-115.ec2.internal" event="NodeHasSufficientPID" Jul 24 17:20:03.873671 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.873633 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-115.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 17:20:03.873671 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.873644 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-115.ec2.internal" event="NodeHasSufficientPID" Jul 24 17:20:03.874594 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.874581 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-115.ec2.internal" Jul 24 17:20:03.874643 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.874604 2570 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 17:20:03.875208 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.875195 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-115.ec2.internal" event="NodeHasSufficientMemory" Jul 24 17:20:03.875286 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.875214 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-115.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 17:20:03.875286 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.875223 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-115.ec2.internal" event="NodeHasSufficientPID" Jul 24 17:20:03.908055 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:03.908039 2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-115.ec2.internal\" not found" node="ip-10-0-141-115.ec2.internal" Jul 24 17:20:03.912377 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:03.912362 2570 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-115.ec2.internal\" not found" node="ip-10-0-141-115.ec2.internal" Jul 24 17:20:03.951821 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:03.951802 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-115.ec2.internal\" not found" Jul 24 17:20:03.961095 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.961075 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/18378e7a938206fd65fc7da834e2352c-config\") pod \"kube-apiserver-proxy-ip-10-0-141-115.ec2.internal\" (UID: \"18378e7a938206fd65fc7da834e2352c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-115.ec2.internal" Jul 24 17:20:03.961156 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.961098 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/23d0e823dbe407b05e0ec0e36a2e5f00-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-115.ec2.internal\" (UID: \"23d0e823dbe407b05e0ec0e36a2e5f00\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-115.ec2.internal" Jul 24 17:20:03.961156 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:03.961115 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23d0e823dbe407b05e0ec0e36a2e5f00-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-115.ec2.internal\" (UID: \"23d0e823dbe407b05e0ec0e36a2e5f00\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-115.ec2.internal" Jul 24 17:20:04.052669 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:04.052622 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-115.ec2.internal\" not found" Jul 24 17:20:04.061980 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:04.061961 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/23d0e823dbe407b05e0ec0e36a2e5f00-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-115.ec2.internal\" (UID: \"23d0e823dbe407b05e0ec0e36a2e5f00\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-115.ec2.internal" Jul 24 17:20:04.062045 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:04.061984 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23d0e823dbe407b05e0ec0e36a2e5f00-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-115.ec2.internal\" (UID: \"23d0e823dbe407b05e0ec0e36a2e5f00\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-115.ec2.internal" Jul 24 17:20:04.062045 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:04.062001 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/18378e7a938206fd65fc7da834e2352c-config\") pod \"kube-apiserver-proxy-ip-10-0-141-115.ec2.internal\" (UID: \"18378e7a938206fd65fc7da834e2352c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-115.ec2.internal" Jul 24 17:20:04.062045 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:04.062039 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/18378e7a938206fd65fc7da834e2352c-config\") pod \"kube-apiserver-proxy-ip-10-0-141-115.ec2.internal\" (UID: \"18378e7a938206fd65fc7da834e2352c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-115.ec2.internal" Jul 24 17:20:04.062158 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:04.062062 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/23d0e823dbe407b05e0ec0e36a2e5f00-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-115.ec2.internal\" (UID: \"23d0e823dbe407b05e0ec0e36a2e5f00\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-115.ec2.internal" Jul 24 17:20:04.062158 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:04.062060 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/23d0e823dbe407b05e0ec0e36a2e5f00-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-115.ec2.internal\" (UID: \"23d0e823dbe407b05e0ec0e36a2e5f00\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-115.ec2.internal" Jul 24 17:20:04.153161 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:04.153133 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-115.ec2.internal\" not found" Jul 24 17:20:04.210681 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:04.210653 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-115.ec2.internal" Jul 24 17:20:04.215643 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:04.215628 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-115.ec2.internal" Jul 24 17:20:04.253427 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:04.253405 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-115.ec2.internal\" not found" Jul 24 17:20:04.353963 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:04.353912 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-115.ec2.internal\" not found" Jul 24 17:20:05.591343 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:05.591315 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-115.ec2.internal\" not found" Jul 24 17:20:05.637754 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:05.637730 2570 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 24 17:20:05.638108 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:05.637866 2570 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 17:20:05.692263 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:05.692237 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-115.ec2.internal\" not found" Jul 24 17:20:05.702209 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:05.702180 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 17:15:04 +0000 UTC" deadline="2028-03-31 05:39:16.550048482 +0000 UTC" Jul 24 17:20:05.702209 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:05.702205 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14772h19m10.847845831s" Jul 24 17:20:05.792883 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:05.792841 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-115.ec2.internal\" not found" Jul 24 17:20:05.872608 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:05.872575 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18378e7a938206fd65fc7da834e2352c.slice/crio-1d6a1a1c63b08e1189d0b7051d662af742170c116cedb9724df4c51adc8d17e9 WatchSource:0}: Error finding container 1d6a1a1c63b08e1189d0b7051d662af742170c116cedb9724df4c51adc8d17e9: Status 404 returned error can't find the container with id 1d6a1a1c63b08e1189d0b7051d662af742170c116cedb9724df4c51adc8d17e9 Jul 24 17:20:05.875301 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:05.875288 2570 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 17:20:05.878826 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:05.878814 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 17:20:05.892925 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:05.892900 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-115.ec2.internal\" not found" Jul 24 17:20:05.910417 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:05.910375 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-115.ec2.internal" event={"ID":"18378e7a938206fd65fc7da834e2352c","Type":"ContainerStarted","Data":"1d6a1a1c63b08e1189d0b7051d662af742170c116cedb9724df4c51adc8d17e9"} Jul 24 17:20:05.993577 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:05.993554 2570 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-115.ec2.internal\" not found" Jul 24 17:20:06.034931 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:06.034911 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23d0e823dbe407b05e0ec0e36a2e5f00.slice/crio-57194f9368fa2caa262094e44874fabb1575d80d32ed77c2088b1d214f7b3aa4 WatchSource:0}: Error finding container 57194f9368fa2caa262094e44874fabb1575d80d32ed77c2088b1d214f7b3aa4: Status 404 returned error can't find the container with id 57194f9368fa2caa262094e44874fabb1575d80d32ed77c2088b1d214f7b3aa4 Jul 24 17:20:06.035552 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.035538 2570 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 17:20:06.057751 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.057709 2570 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 17:20:06.096757 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.096736 2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-115.ec2.internal" Jul 24 17:20:06.108349 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.108312 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 17:20:06.109384 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.109369 2570 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-115.ec2.internal" Jul 24 17:20:06.119816 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.119798 2570 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 17:20:06.668745 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.667479 2570 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 17:20:06.677765 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.677741 2570 apiserver.go:52] "Watching apiserver" Jul 24 17:20:06.689818 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.689527 2570 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 24 17:20:06.691105 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.690727 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-7z5ql","openshift-multus/multus-zfr4g","openshift-multus/network-metrics-daemon-njwgg","kube-system/global-pull-secret-syncer-7smjt","kube-system/kube-apiserver-proxy-ip-10-0-141-115.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56hfg","openshift-network-diagnostics/network-check-target-nsllf","openshift-network-operator/iptables-alerter-xb7qm","openshift-ovn-kubernetes/ovnkube-node-v6pz6","kube-system/konnectivity-agent-fqhxk","openshift-cluster-node-tuning-operator/tuned-sc2sx","openshift-dns/node-resolver-jj8qn","openshift-image-registry/node-ca-qc64j","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-115.ec2.internal"] Jul 24 17:20:06.692142 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.692116 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fqhxk" Jul 24 17:20:06.693343 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.693306 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.694841 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.694650 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njwgg" Jul 24 17:20:06.694841 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.694681 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 24 17:20:06.694841 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:06.694723 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njwgg" podUID="c9c7af4e-bb66-40e8-936c-d9d62240e05f" Jul 24 17:20:06.695035 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.694945 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-gq2xk\"" Jul 24 17:20:06.695035 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.694980 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 24 17:20:06.695679 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.695658 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 24 17:20:06.695778 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.695686 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-dm8xd\"" Jul 24 17:20:06.695778 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.695685 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 24 17:20:06.695904 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.695817 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xb7qm" Jul 24 17:20:06.697034 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.696512 2570 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 24 17:20:06.697301 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.697282 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsllf" Jul 24 17:20:06.697420 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:06.697373 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nsllf" podUID="b51ad1bf-cbce-4045-aee9-4997201a35cd" Jul 24 17:20:06.698171 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.698140 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 24 17:20:06.698171 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.698165 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xjbm4\"" Jul 24 17:20:06.698504 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.698482 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56hfg" Jul 24 17:20:06.699739 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.699216 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 24 17:20:06.699739 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.699440 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 24 17:20:06.701011 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.700514 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 24 17:20:06.701011 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.700780 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.701993 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.701925 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-l5bmf\"" Jul 24 17:20:06.702127 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.702111 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 24 17:20:06.703780 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.702377 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 24 17:20:06.703780 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.702895 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qc64j" Jul 24 17:20:06.703780 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.703499 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 24 17:20:06.703780 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.703585 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 24 17:20:06.703780 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.703654 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.703780 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.703761 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-t5mc4\"" Jul 24 17:20:06.704096 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.703783 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 24 17:20:06.704096 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.703793 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 24 17:20:06.704894 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.704694 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 24 17:20:06.704894 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.704752 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 24 17:20:06.705175 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.705155 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 24 17:20:06.705275 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.705258 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-p4qkw\"" Jul 24 17:20:06.705275 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.705257 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 24 17:20:06.705396 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.705167 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7z5ql" Jul 24 17:20:06.705544 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.705492 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 24 17:20:06.707418 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.707385 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-sys\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.707514 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.707424 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-var-lib-kubelet\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.707514 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.707456 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-etc-tuned\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.707514 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.707486 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/723e5a70-b2cb-4a82-95d8-85be102d18ce-host-slash\") pod \"iptables-alerter-xb7qm\" (UID: \"723e5a70-b2cb-4a82-95d8-85be102d18ce\") " pod="openshift-network-operator/iptables-alerter-xb7qm" Jul 24 17:20:06.707686 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.707669 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-etc-modprobe-d\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.707744 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.707703 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-etc-sysconfig\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.707744 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.707718 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 24 17:20:06.707744 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.707726 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-etc-sysctl-conf\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.707835 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.707756 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/723e5a70-b2cb-4a82-95d8-85be102d18ce-iptables-alerter-script\") pod \"iptables-alerter-xb7qm\" (UID: \"723e5a70-b2cb-4a82-95d8-85be102d18ce\") " pod="openshift-network-operator/iptables-alerter-xb7qm" Jul 24 17:20:06.707835 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.707790 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7v5d\" (UniqueName: \"kubernetes.io/projected/723e5a70-b2cb-4a82-95d8-85be102d18ce-kube-api-access-c7v5d\") pod \"iptables-alerter-xb7qm\" (UID: \"723e5a70-b2cb-4a82-95d8-85be102d18ce\") " pod="openshift-network-operator/iptables-alerter-xb7qm" Jul 24 17:20:06.707835 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.707821 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-etc-kubernetes\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.707931 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.707848 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-etc-systemd\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.707931 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.707869 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-run\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.707931 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.707876 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 24 17:20:06.707931 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.707895 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-lib-modules\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.707931 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.707923 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-host\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.708110 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.707949 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-tmp\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.708110 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.707975 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bcf29f60-9cc0-40b2-906e-774225ebf9ad-agent-certs\") pod \"konnectivity-agent-fqhxk\" (UID: \"bcf29f60-9cc0-40b2-906e-774225ebf9ad\") " pod="kube-system/konnectivity-agent-fqhxk" Jul 24 17:20:06.708110 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.708000 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bcf29f60-9cc0-40b2-906e-774225ebf9ad-konnectivity-ca\") pod \"konnectivity-agent-fqhxk\" (UID: \"bcf29f60-9cc0-40b2-906e-774225ebf9ad\") " pod="kube-system/konnectivity-agent-fqhxk" Jul 24 17:20:06.708110 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.708030 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 24 17:20:06.708110 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.708033 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-etc-sysctl-d\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.708110 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.708061 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkp4z\" (UniqueName: \"kubernetes.io/projected/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-kube-api-access-kkp4z\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.708283 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.708115 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9c7af4e-bb66-40e8-936c-d9d62240e05f-metrics-certs\") pod \"network-metrics-daemon-njwgg\" (UID: \"c9c7af4e-bb66-40e8-936c-d9d62240e05f\") " pod="openshift-multus/network-metrics-daemon-njwgg" Jul 24 17:20:06.708283 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.708144 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hclw6\" (UniqueName: \"kubernetes.io/projected/c9c7af4e-bb66-40e8-936c-d9d62240e05f-kube-api-access-hclw6\") pod \"network-metrics-daemon-njwgg\" (UID: \"c9c7af4e-bb66-40e8-936c-d9d62240e05f\") " pod="openshift-multus/network-metrics-daemon-njwgg" Jul 24 17:20:06.708283 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.708169 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l6tmb\" (UniqueName: \"kubernetes.io/projected/b51ad1bf-cbce-4045-aee9-4997201a35cd-kube-api-access-l6tmb\") pod \"network-check-target-nsllf\" (UID: \"b51ad1bf-cbce-4045-aee9-4997201a35cd\") " pod="openshift-network-diagnostics/network-check-target-nsllf" Jul 24 17:20:06.708438 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.708425 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-j4lf8\"" Jul 24 17:20:06.709288 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.708555 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7smjt" Jul 24 17:20:06.709288 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:06.708618 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7smjt" podUID="8dd24b3b-de29-4d73-9b9a-519287ab38c0" Jul 24 17:20:06.709288 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.708682 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jj8qn" Jul 24 17:20:06.709288 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.708697 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 24 17:20:06.709288 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.708759 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-sw4nv\"" Jul 24 17:20:06.709288 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.709031 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 24 17:20:06.709288 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.708701 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 24 17:20:06.709288 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.709032 2570 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 17:20:06.711408 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.711226 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 24 17:20:06.711781 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.711606 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-d8hhn\"" Jul 24 17:20:06.711781 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.711629 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 24 17:20:06.731619 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.731599 2570 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mg6cl" Jul 24 17:20:06.740876 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.740856 2570 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mg6cl" Jul 24 17:20:06.797576 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.797552 2570 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 24 17:20:06.809385 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.809361 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-etc-modprobe-d\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.809485 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.809393 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/723e5a70-b2cb-4a82-95d8-85be102d18ce-iptables-alerter-script\") pod \"iptables-alerter-xb7qm\" (UID: \"723e5a70-b2cb-4a82-95d8-85be102d18ce\") " pod="openshift-network-operator/iptables-alerter-xb7qm" Jul 24 17:20:06.809485 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.809413 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-run-openvswitch\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.809485 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.809428 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-host\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.809485 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.809443 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5zx2\" (UniqueName: \"kubernetes.io/projected/5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e-kube-api-access-m5zx2\") pod \"aws-ebs-csi-driver-node-56hfg\" (UID: \"5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56hfg" Jul 24 17:20:06.809485 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.809459 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/57db7dd7-3eed-4936-818f-0fcf8d031c0f-host\") pod \"node-ca-qc64j\" (UID: \"57db7dd7-3eed-4936-818f-0fcf8d031c0f\") " pod="openshift-image-registry/node-ca-qc64j" Jul 24 17:20:06.809485 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.809473 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-host-var-lib-cni-multus\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.809485 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.809488 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-var-lib-openvswitch\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.809701 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.809503 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bcf29f60-9cc0-40b2-906e-774225ebf9ad-agent-certs\") pod \"konnectivity-agent-fqhxk\" (UID: \"bcf29f60-9cc0-40b2-906e-774225ebf9ad\") " pod="kube-system/konnectivity-agent-fqhxk" Jul 24 17:20:06.809701 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.809519 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-56hfg\" (UID: \"5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56hfg" Jul 24 17:20:06.809701 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.809539 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-etc-openvswitch\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.809701 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.809553 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/76b2d34e-61a3-45fb-8652-66d51f0289d6-ovn-node-metrics-cert\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.809701 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.809567 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8dd24b3b-de29-4d73-9b9a-519287ab38c0-original-pull-secret\") pod \"global-pull-secret-syncer-7smjt\" (UID: \"8dd24b3b-de29-4d73-9b9a-519287ab38c0\") " pod="kube-system/global-pull-secret-syncer-7smjt" Jul 24 17:20:06.809701 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.809592 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-sys\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.809701 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.809612 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e-socket-dir\") pod \"aws-ebs-csi-driver-node-56hfg\" (UID: \"5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56hfg" Jul 24 17:20:06.809701 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.809626 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/57db7dd7-3eed-4936-818f-0fcf8d031c0f-serviceca\") pod \"node-ca-qc64j\" (UID: \"57db7dd7-3eed-4936-818f-0fcf8d031c0f\") " pod="openshift-image-registry/node-ca-qc64j" Jul 24 17:20:06.809701 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.809640 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-multus-daemon-config\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.809701 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.809660 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-host-run-netns\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.809701 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.809675 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-run-systemd\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.809701 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.809688 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-host-cni-bin\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.810021 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.809702 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/76b2d34e-61a3-45fb-8652-66d51f0289d6-ovnkube-config\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.810021 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.809725 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7v5d\" (UniqueName: \"kubernetes.io/projected/723e5a70-b2cb-4a82-95d8-85be102d18ce-kube-api-access-c7v5d\") pod \"iptables-alerter-xb7qm\" (UID: \"723e5a70-b2cb-4a82-95d8-85be102d18ce\") " pod="openshift-network-operator/iptables-alerter-xb7qm" Jul 24 17:20:06.810021 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.809746 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-multus-cni-dir\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.810021 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.809760 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-os-release\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.810021 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.809776 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-host-run-k8s-cni-cncf-io\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.810021 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.809799 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-host-slash\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.810021 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.809815 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-host-cni-netd\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.810021 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.809829 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0d218512-e801-4d6e-8f09-bd0ee5a815d9-hosts-file\") pod \"node-resolver-jj8qn\" (UID: \"0d218512-e801-4d6e-8f09-bd0ee5a815d9\") " pod="openshift-dns/node-resolver-jj8qn" Jul 24 17:20:06.810021 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.809845 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-etc-kubernetes\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.810021 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.809861 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-run\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.810021 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.809875 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-tmp\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.810021 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.809889 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkp4z\" (UniqueName: \"kubernetes.io/projected/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-kube-api-access-kkp4z\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.810021 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.809904 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-node-log\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.810021 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.809920 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlhfj\" (UniqueName: \"kubernetes.io/projected/76b2d34e-61a3-45fb-8652-66d51f0289d6-kube-api-access-vlhfj\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.810021 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.809937 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d218512-e801-4d6e-8f09-bd0ee5a815d9-tmp-dir\") pod \"node-resolver-jj8qn\" (UID: \"0d218512-e801-4d6e-8f09-bd0ee5a815d9\") " pod="openshift-dns/node-resolver-jj8qn" Jul 24 17:20:06.810021 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.809954 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bcf29f60-9cc0-40b2-906e-774225ebf9ad-konnectivity-ca\") pod \"konnectivity-agent-fqhxk\" (UID: \"bcf29f60-9cc0-40b2-906e-774225ebf9ad\") " pod="kube-system/konnectivity-agent-fqhxk" Jul 24 17:20:06.810021 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.809973 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9c7af4e-bb66-40e8-936c-d9d62240e05f-metrics-certs\") pod \"network-metrics-daemon-njwgg\" (UID: \"c9c7af4e-bb66-40e8-936c-d9d62240e05f\") " pod="openshift-multus/network-metrics-daemon-njwgg" Jul 24 17:20:06.810637 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.809991 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-host-var-lib-kubelet\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.810637 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810012 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-etc-kubernetes\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.810637 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810028 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2335c195-a768-4809-a99c-621276a6fd6b-cni-binary-copy\") pod \"multus-additional-cni-plugins-7z5ql\" (UID: \"2335c195-a768-4809-a99c-621276a6fd6b\") " pod="openshift-multus/multus-additional-cni-plugins-7z5ql" Jul 24 17:20:06.810637 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810042 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-systemd-units\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.810637 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810057 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8dd24b3b-de29-4d73-9b9a-519287ab38c0-kubelet-config\") pod \"global-pull-secret-syncer-7smjt\" (UID: \"8dd24b3b-de29-4d73-9b9a-519287ab38c0\") " pod="kube-system/global-pull-secret-syncer-7smjt" Jul 24 17:20:06.810637 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810072 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8dd24b3b-de29-4d73-9b9a-519287ab38c0-dbus\") pod \"global-pull-secret-syncer-7smjt\" (UID: \"8dd24b3b-de29-4d73-9b9a-519287ab38c0\") " pod="kube-system/global-pull-secret-syncer-7smjt" Jul 24 17:20:06.810637 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810087 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-etc-tuned\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.810637 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810113 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e-device-dir\") pod \"aws-ebs-csi-driver-node-56hfg\" (UID: \"5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56hfg" Jul 24 17:20:06.810637 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810128 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e-sys-fs\") pod \"aws-ebs-csi-driver-node-56hfg\" (UID: \"5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56hfg" Jul 24 17:20:06.810637 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810142 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-system-cni-dir\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.810637 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810156 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-host-run-netns\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.810637 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810180 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-hostroot\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.810637 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810200 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-host-run-multus-certs\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.810637 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810216 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2335c195-a768-4809-a99c-621276a6fd6b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7z5ql\" (UID: \"2335c195-a768-4809-a99c-621276a6fd6b\") " pod="openshift-multus/multus-additional-cni-plugins-7z5ql" Jul 24 17:20:06.810637 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810253 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-etc-sysctl-conf\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.810637 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810278 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pvfsh\" (UniqueName: \"kubernetes.io/projected/57db7dd7-3eed-4936-818f-0fcf8d031c0f-kube-api-access-pvfsh\") pod \"node-ca-qc64j\" (UID: \"57db7dd7-3eed-4936-818f-0fcf8d031c0f\") " pod="openshift-image-registry/node-ca-qc64j" Jul 24 17:20:06.811150 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810303 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2335c195-a768-4809-a99c-621276a6fd6b-system-cni-dir\") pod \"multus-additional-cni-plugins-7z5ql\" (UID: \"2335c195-a768-4809-a99c-621276a6fd6b\") " pod="openshift-multus/multus-additional-cni-plugins-7z5ql" Jul 24 17:20:06.811150 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810328 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-host-run-ovn-kubernetes\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.811150 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810377 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.811150 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810402 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bwckz\" (UniqueName: \"kubernetes.io/projected/0d218512-e801-4d6e-8f09-bd0ee5a815d9-kube-api-access-bwckz\") pod \"node-resolver-jj8qn\" (UID: \"0d218512-e801-4d6e-8f09-bd0ee5a815d9\") " pod="openshift-dns/node-resolver-jj8qn" Jul 24 17:20:06.811150 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810427 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-lib-modules\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.811150 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810475 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-host-var-lib-cni-bin\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.811150 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810492 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx9hd\" (UniqueName: \"kubernetes.io/projected/2335c195-a768-4809-a99c-621276a6fd6b-kube-api-access-fx9hd\") pod \"multus-additional-cni-plugins-7z5ql\" (UID: \"2335c195-a768-4809-a99c-621276a6fd6b\") " pod="openshift-multus/multus-additional-cni-plugins-7z5ql" Jul 24 17:20:06.811150 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810516 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hclw6\" (UniqueName: \"kubernetes.io/projected/c9c7af4e-bb66-40e8-936c-d9d62240e05f-kube-api-access-hclw6\") pod \"network-metrics-daemon-njwgg\" (UID: \"c9c7af4e-bb66-40e8-936c-d9d62240e05f\") " pod="openshift-multus/network-metrics-daemon-njwgg" Jul 24 17:20:06.811150 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810538 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-cnibin\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.811150 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810555 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-multus-socket-dir-parent\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.811150 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810571 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2335c195-a768-4809-a99c-621276a6fd6b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7z5ql\" (UID: \"2335c195-a768-4809-a99c-621276a6fd6b\") " pod="openshift-multus/multus-additional-cni-plugins-7z5ql" Jul 24 17:20:06.811150 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810617 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/723e5a70-b2cb-4a82-95d8-85be102d18ce-host-slash\") pod \"iptables-alerter-xb7qm\" (UID: \"723e5a70-b2cb-4a82-95d8-85be102d18ce\") " pod="openshift-network-operator/iptables-alerter-xb7qm" Jul 24 17:20:06.811150 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810635 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-cni-binary-copy\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.811150 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810657 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2335c195-a768-4809-a99c-621276a6fd6b-os-release\") pod \"multus-additional-cni-plugins-7z5ql\" (UID: \"2335c195-a768-4809-a99c-621276a6fd6b\") " pod="openshift-multus/multus-additional-cni-plugins-7z5ql" Jul 24 17:20:06.811150 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810672 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-run-ovn\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.811150 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810691 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/76b2d34e-61a3-45fb-8652-66d51f0289d6-env-overrides\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.811728 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810708 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-etc-sysconfig\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.811728 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810722 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hbgw\" (UniqueName: \"kubernetes.io/projected/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-kube-api-access-2hbgw\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.811728 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810737 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-host-kubelet\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.811728 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810751 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-log-socket\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.811728 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810767 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-etc-systemd\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.811728 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810783 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6tmb\" (UniqueName: \"kubernetes.io/projected/b51ad1bf-cbce-4045-aee9-4997201a35cd-kube-api-access-l6tmb\") pod \"network-check-target-nsllf\" (UID: \"b51ad1bf-cbce-4045-aee9-4997201a35cd\") " pod="openshift-network-diagnostics/network-check-target-nsllf" Jul 24 17:20:06.811728 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810807 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e-registration-dir\") pod \"aws-ebs-csi-driver-node-56hfg\" (UID: \"5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56hfg" Jul 24 17:20:06.811728 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810824 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2335c195-a768-4809-a99c-621276a6fd6b-cnibin\") pod \"multus-additional-cni-plugins-7z5ql\" (UID: \"2335c195-a768-4809-a99c-621276a6fd6b\") " pod="openshift-multus/multus-additional-cni-plugins-7z5ql" Jul 24 17:20:06.811728 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810840 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2335c195-a768-4809-a99c-621276a6fd6b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7z5ql\" (UID: \"2335c195-a768-4809-a99c-621276a6fd6b\") " pod="openshift-multus/multus-additional-cni-plugins-7z5ql" Jul 24 17:20:06.811728 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810855 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-etc-sysctl-d\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.811728 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810870 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-multus-conf-dir\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.811728 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810886 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/76b2d34e-61a3-45fb-8652-66d51f0289d6-ovnkube-script-lib\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.811728 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810903 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-var-lib-kubelet\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.811728 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.810919 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e-etc-selinux\") pod \"aws-ebs-csi-driver-node-56hfg\" (UID: \"5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56hfg" Jul 24 17:20:06.811728 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.811084 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-etc-modprobe-d\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.811728 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.811618 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/723e5a70-b2cb-4a82-95d8-85be102d18ce-iptables-alerter-script\") pod \"iptables-alerter-xb7qm\" (UID: \"723e5a70-b2cb-4a82-95d8-85be102d18ce\") " pod="openshift-network-operator/iptables-alerter-xb7qm" Jul 24 17:20:06.811728 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.811722 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-host\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.812490 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.812153 2570 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 24 17:20:06.812490 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.812464 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-sys\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.812874 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.812855 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-etc-kubernetes\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.812928 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.812915 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-run\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.813401 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:06.813382 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 17:20:06.813478 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:06.813471 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9c7af4e-bb66-40e8-936c-d9d62240e05f-metrics-certs podName:c9c7af4e-bb66-40e8-936c-d9d62240e05f nodeName:}" failed. No retries permitted until 2026-07-24 17:20:07.313435985 +0000 UTC m=+2.981846991 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9c7af4e-bb66-40e8-936c-d9d62240e05f-metrics-certs") pod "network-metrics-daemon-njwgg" (UID: "c9c7af4e-bb66-40e8-936c-d9d62240e05f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 17:20:06.813636 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.813621 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/bcf29f60-9cc0-40b2-906e-774225ebf9ad-konnectivity-ca\") pod \"konnectivity-agent-fqhxk\" (UID: \"bcf29f60-9cc0-40b2-906e-774225ebf9ad\") " pod="kube-system/konnectivity-agent-fqhxk" Jul 24 17:20:06.813703 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.813686 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-etc-sysctl-conf\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.813738 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.813719 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-lib-modules\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.813822 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.813811 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/723e5a70-b2cb-4a82-95d8-85be102d18ce-host-slash\") pod \"iptables-alerter-xb7qm\" (UID: \"723e5a70-b2cb-4a82-95d8-85be102d18ce\") " pod="openshift-network-operator/iptables-alerter-xb7qm" Jul 24 17:20:06.813879 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.813866 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-etc-sysconfig\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.813953 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.813935 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-etc-systemd\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.814047 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.814029 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-var-lib-kubelet\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.814047 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.814030 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-etc-sysctl-d\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.816755 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.816431 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-tmp\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.816755 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.816687 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/bcf29f60-9cc0-40b2-906e-774225ebf9ad-agent-certs\") pod \"konnectivity-agent-fqhxk\" (UID: \"bcf29f60-9cc0-40b2-906e-774225ebf9ad\") " pod="kube-system/konnectivity-agent-fqhxk" Jul 24 17:20:06.816755 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.816724 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-etc-tuned\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.822621 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:06.822603 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 17:20:06.822716 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:06.822629 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 17:20:06.822716 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:06.822643 2570 projected.go:196] Error preparing data for projected volume kube-api-access-l6tmb for pod openshift-network-diagnostics/network-check-target-nsllf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 17:20:06.822716 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:06.822711 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b51ad1bf-cbce-4045-aee9-4997201a35cd-kube-api-access-l6tmb podName:b51ad1bf-cbce-4045-aee9-4997201a35cd nodeName:}" failed. No retries permitted until 2026-07-24 17:20:07.322694592 +0000 UTC m=+2.991105612 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-l6tmb" (UniqueName: "kubernetes.io/projected/b51ad1bf-cbce-4045-aee9-4997201a35cd-kube-api-access-l6tmb") pod "network-check-target-nsllf" (UID: "b51ad1bf-cbce-4045-aee9-4997201a35cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 17:20:06.823537 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.823518 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkp4z\" (UniqueName: \"kubernetes.io/projected/0b8671b0-9bd5-4f1f-adc9-83403b143b8a-kube-api-access-kkp4z\") pod \"tuned-sc2sx\" (UID: \"0b8671b0-9bd5-4f1f-adc9-83403b143b8a\") " pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:06.824086 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.824069 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7v5d\" (UniqueName: \"kubernetes.io/projected/723e5a70-b2cb-4a82-95d8-85be102d18ce-kube-api-access-c7v5d\") pod \"iptables-alerter-xb7qm\" (UID: \"723e5a70-b2cb-4a82-95d8-85be102d18ce\") " pod="openshift-network-operator/iptables-alerter-xb7qm" Jul 24 17:20:06.824749 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.824731 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hclw6\" (UniqueName: \"kubernetes.io/projected/c9c7af4e-bb66-40e8-936c-d9d62240e05f-kube-api-access-hclw6\") pod \"network-metrics-daemon-njwgg\" (UID: \"c9c7af4e-bb66-40e8-936c-d9d62240e05f\") " pod="openshift-multus/network-metrics-daemon-njwgg" Jul 24 17:20:06.911426 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.911394 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-cni-binary-copy\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.911592 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.911436 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2335c195-a768-4809-a99c-621276a6fd6b-os-release\") pod \"multus-additional-cni-plugins-7z5ql\" (UID: \"2335c195-a768-4809-a99c-621276a6fd6b\") " pod="openshift-multus/multus-additional-cni-plugins-7z5ql" Jul 24 17:20:06.911592 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.911463 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-run-ovn\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.911592 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.911488 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/76b2d34e-61a3-45fb-8652-66d51f0289d6-env-overrides\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.911592 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.911512 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hbgw\" (UniqueName: \"kubernetes.io/projected/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-kube-api-access-2hbgw\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.911592 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.911535 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-host-kubelet\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.911592 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.911558 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-log-socket\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.911592 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.911561 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-run-ovn\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.911592 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.911593 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e-registration-dir\") pod \"aws-ebs-csi-driver-node-56hfg\" (UID: \"5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56hfg" Jul 24 17:20:06.911986 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.911616 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2335c195-a768-4809-a99c-621276a6fd6b-cnibin\") pod \"multus-additional-cni-plugins-7z5ql\" (UID: \"2335c195-a768-4809-a99c-621276a6fd6b\") " pod="openshift-multus/multus-additional-cni-plugins-7z5ql" Jul 24 17:20:06.911986 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.911641 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2335c195-a768-4809-a99c-621276a6fd6b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7z5ql\" (UID: \"2335c195-a768-4809-a99c-621276a6fd6b\") " pod="openshift-multus/multus-additional-cni-plugins-7z5ql" Jul 24 17:20:06.911986 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.911646 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2335c195-a768-4809-a99c-621276a6fd6b-os-release\") pod \"multus-additional-cni-plugins-7z5ql\" (UID: \"2335c195-a768-4809-a99c-621276a6fd6b\") " pod="openshift-multus/multus-additional-cni-plugins-7z5ql" Jul 24 17:20:06.911986 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.911672 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-multus-conf-dir\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.911986 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.911698 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/76b2d34e-61a3-45fb-8652-66d51f0289d6-ovnkube-script-lib\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.911986 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.911716 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e-etc-selinux\") pod \"aws-ebs-csi-driver-node-56hfg\" (UID: \"5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56hfg" Jul 24 17:20:06.911986 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.911740 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e-registration-dir\") pod \"aws-ebs-csi-driver-node-56hfg\" (UID: \"5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56hfg" Jul 24 17:20:06.911986 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.911743 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-run-openvswitch\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.911986 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.911770 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-run-openvswitch\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.911986 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.911791 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5zx2\" (UniqueName: \"kubernetes.io/projected/5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e-kube-api-access-m5zx2\") pod \"aws-ebs-csi-driver-node-56hfg\" (UID: \"5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56hfg" Jul 24 17:20:06.911986 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.911812 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2335c195-a768-4809-a99c-621276a6fd6b-cnibin\") pod \"multus-additional-cni-plugins-7z5ql\" (UID: \"2335c195-a768-4809-a99c-621276a6fd6b\") " pod="openshift-multus/multus-additional-cni-plugins-7z5ql" Jul 24 17:20:06.911986 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.911817 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/57db7dd7-3eed-4936-818f-0fcf8d031c0f-host\") pod \"node-ca-qc64j\" (UID: \"57db7dd7-3eed-4936-818f-0fcf8d031c0f\") " pod="openshift-image-registry/node-ca-qc64j" Jul 24 17:20:06.911986 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.911839 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-host-var-lib-cni-multus\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.911986 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.911895 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-var-lib-openvswitch\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.911986 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.911915 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2335c195-a768-4809-a99c-621276a6fd6b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7z5ql\" (UID: \"2335c195-a768-4809-a99c-621276a6fd6b\") " pod="openshift-multus/multus-additional-cni-plugins-7z5ql" Jul 24 17:20:06.911986 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.911927 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-56hfg\" (UID: \"5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56hfg" Jul 24 17:20:06.911986 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.911940 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-multus-conf-dir\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.912820 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.911948 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-etc-openvswitch\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.912820 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.911984 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/76b2d34e-61a3-45fb-8652-66d51f0289d6-ovn-node-metrics-cert\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.912820 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912009 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8dd24b3b-de29-4d73-9b9a-519287ab38c0-original-pull-secret\") pod \"global-pull-secret-syncer-7smjt\" (UID: \"8dd24b3b-de29-4d73-9b9a-519287ab38c0\") " pod="kube-system/global-pull-secret-syncer-7smjt" Jul 24 17:20:06.912820 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912034 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e-socket-dir\") pod \"aws-ebs-csi-driver-node-56hfg\" (UID: \"5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56hfg" Jul 24 17:20:06.912820 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912060 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-var-lib-openvswitch\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.912820 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912058 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/57db7dd7-3eed-4936-818f-0fcf8d031c0f-serviceca\") pod \"node-ca-qc64j\" (UID: \"57db7dd7-3eed-4936-818f-0fcf8d031c0f\") " pod="openshift-image-registry/node-ca-qc64j" Jul 24 17:20:06.912820 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912073 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-cni-binary-copy\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.912820 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912084 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-multus-daemon-config\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.912820 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912122 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-host-run-netns\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.912820 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912129 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-56hfg\" (UID: \"5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56hfg" Jul 24 17:20:06.912820 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912138 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-run-systemd\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.912820 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912170 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-host-cni-bin\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.912820 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912177 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-etc-openvswitch\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.912820 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912202 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-host-kubelet\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.912820 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912235 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-host-run-netns\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.912820 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912236 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-host-var-lib-cni-multus\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.912820 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:06.912267 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 17:20:06.912820 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912038 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e-etc-selinux\") pod \"aws-ebs-csi-driver-node-56hfg\" (UID: \"5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56hfg" Jul 24 17:20:06.913657 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912284 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/76b2d34e-61a3-45fb-8652-66d51f0289d6-ovnkube-config\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.913657 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912267 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e-socket-dir\") pod \"aws-ebs-csi-driver-node-56hfg\" (UID: \"5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56hfg" Jul 24 17:20:06.913657 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912291 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/57db7dd7-3eed-4936-818f-0fcf8d031c0f-host\") pod \"node-ca-qc64j\" (UID: \"57db7dd7-3eed-4936-818f-0fcf8d031c0f\") " pod="openshift-image-registry/node-ca-qc64j" Jul 24 17:20:06.913657 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912315 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-log-socket\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.913657 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912323 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-host-cni-bin\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.913657 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:06.912364 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dd24b3b-de29-4d73-9b9a-519287ab38c0-original-pull-secret podName:8dd24b3b-de29-4d73-9b9a-519287ab38c0 nodeName:}" failed. No retries permitted until 2026-07-24 17:20:07.412304579 +0000 UTC m=+3.080715594 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8dd24b3b-de29-4d73-9b9a-519287ab38c0-original-pull-secret") pod "global-pull-secret-syncer-7smjt" (UID: "8dd24b3b-de29-4d73-9b9a-519287ab38c0") : object "kube-system"/"original-pull-secret" not registered Jul 24 17:20:06.913657 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912387 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-multus-cni-dir\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.913657 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912413 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-os-release\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.913657 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912440 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-host-run-k8s-cni-cncf-io\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.913657 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912269 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-run-systemd\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.913657 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912463 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-host-slash\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.913657 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912472 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/57db7dd7-3eed-4936-818f-0fcf8d031c0f-serviceca\") pod \"node-ca-qc64j\" (UID: \"57db7dd7-3eed-4936-818f-0fcf8d031c0f\") " pod="openshift-image-registry/node-ca-qc64j" Jul 24 17:20:06.913657 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912532 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-host-slash\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.913657 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912565 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-host-cni-netd\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.913657 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912591 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-os-release\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.913657 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912594 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0d218512-e801-4d6e-8f09-bd0ee5a815d9-hosts-file\") pod \"node-resolver-jj8qn\" (UID: \"0d218512-e801-4d6e-8f09-bd0ee5a815d9\") " pod="openshift-dns/node-resolver-jj8qn" Jul 24 17:20:06.913657 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912620 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-multus-cni-dir\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.914272 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912633 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-node-log\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.914272 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912637 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-host-cni-netd\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.914272 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912659 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-host-run-k8s-cni-cncf-io\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.914272 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912675 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlhfj\" (UniqueName: \"kubernetes.io/projected/76b2d34e-61a3-45fb-8652-66d51f0289d6-kube-api-access-vlhfj\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.914272 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912684 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/0d218512-e801-4d6e-8f09-bd0ee5a815d9-hosts-file\") pod \"node-resolver-jj8qn\" (UID: \"0d218512-e801-4d6e-8f09-bd0ee5a815d9\") " pod="openshift-dns/node-resolver-jj8qn" Jul 24 17:20:06.914272 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912692 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d218512-e801-4d6e-8f09-bd0ee5a815d9-tmp-dir\") pod \"node-resolver-jj8qn\" (UID: \"0d218512-e801-4d6e-8f09-bd0ee5a815d9\") " pod="openshift-dns/node-resolver-jj8qn" Jul 24 17:20:06.914272 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912752 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-node-log\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.914272 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912782 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-host-var-lib-kubelet\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.914272 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912807 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-multus-daemon-config\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.914272 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912824 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-etc-kubernetes\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.914272 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912853 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-host-var-lib-kubelet\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.914272 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912875 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0d218512-e801-4d6e-8f09-bd0ee5a815d9-tmp-dir\") pod \"node-resolver-jj8qn\" (UID: \"0d218512-e801-4d6e-8f09-bd0ee5a815d9\") " pod="openshift-dns/node-resolver-jj8qn" Jul 24 17:20:06.914272 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912899 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2335c195-a768-4809-a99c-621276a6fd6b-cni-binary-copy\") pod \"multus-additional-cni-plugins-7z5ql\" (UID: \"2335c195-a768-4809-a99c-621276a6fd6b\") " pod="openshift-multus/multus-additional-cni-plugins-7z5ql" Jul 24 17:20:06.914272 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912909 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-etc-kubernetes\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.914272 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.912941 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-systemd-units\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.914272 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.913032 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8dd24b3b-de29-4d73-9b9a-519287ab38c0-kubelet-config\") pod \"global-pull-secret-syncer-7smjt\" (UID: \"8dd24b3b-de29-4d73-9b9a-519287ab38c0\") " pod="kube-system/global-pull-secret-syncer-7smjt" Jul 24 17:20:06.914272 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.913062 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8dd24b3b-de29-4d73-9b9a-519287ab38c0-dbus\") pod \"global-pull-secret-syncer-7smjt\" (UID: \"8dd24b3b-de29-4d73-9b9a-519287ab38c0\") " pod="kube-system/global-pull-secret-syncer-7smjt" Jul 24 17:20:06.914272 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.913103 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e-device-dir\") pod \"aws-ebs-csi-driver-node-56hfg\" (UID: \"5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56hfg" Jul 24 17:20:06.915019 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.913129 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e-sys-fs\") pod \"aws-ebs-csi-driver-node-56hfg\" (UID: \"5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56hfg" Jul 24 17:20:06.915019 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.913152 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-system-cni-dir\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.915019 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.913190 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-host-run-netns\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.915019 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.913230 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-hostroot\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.915019 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.913198 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/76b2d34e-61a3-45fb-8652-66d51f0289d6-env-overrides\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.915019 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.913254 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-host-run-multus-certs\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.915019 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.913298 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-host-run-multus-certs\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.915019 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.913297 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/8dd24b3b-de29-4d73-9b9a-519287ab38c0-kubelet-config\") pod \"global-pull-secret-syncer-7smjt\" (UID: \"8dd24b3b-de29-4d73-9b9a-519287ab38c0\") " pod="kube-system/global-pull-secret-syncer-7smjt" Jul 24 17:20:06.915019 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.913351 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/76b2d34e-61a3-45fb-8652-66d51f0289d6-ovnkube-script-lib\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.915019 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.913368 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/8dd24b3b-de29-4d73-9b9a-519287ab38c0-dbus\") pod \"global-pull-secret-syncer-7smjt\" (UID: \"8dd24b3b-de29-4d73-9b9a-519287ab38c0\") " pod="kube-system/global-pull-secret-syncer-7smjt" Jul 24 17:20:06.915019 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.913377 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2335c195-a768-4809-a99c-621276a6fd6b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7z5ql\" (UID: \"2335c195-a768-4809-a99c-621276a6fd6b\") " pod="openshift-multus/multus-additional-cni-plugins-7z5ql" Jul 24 17:20:06.915019 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.913395 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e-device-dir\") pod \"aws-ebs-csi-driver-node-56hfg\" (UID: \"5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56hfg" Jul 24 17:20:06.915019 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.913409 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pvfsh\" (UniqueName: \"kubernetes.io/projected/57db7dd7-3eed-4936-818f-0fcf8d031c0f-kube-api-access-pvfsh\") pod \"node-ca-qc64j\" (UID: \"57db7dd7-3eed-4936-818f-0fcf8d031c0f\") " pod="openshift-image-registry/node-ca-qc64j" Jul 24 17:20:06.915019 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.913409 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/76b2d34e-61a3-45fb-8652-66d51f0289d6-ovnkube-config\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.915019 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.913415 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-hostroot\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.915019 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.913415 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-systemd-units\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.915019 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.913437 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-system-cni-dir\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.915019 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.913478 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-host-run-netns\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.915681 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.913485 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2335c195-a768-4809-a99c-621276a6fd6b-system-cni-dir\") pod \"multus-additional-cni-plugins-7z5ql\" (UID: \"2335c195-a768-4809-a99c-621276a6fd6b\") " pod="openshift-multus/multus-additional-cni-plugins-7z5ql" Jul 24 17:20:06.915681 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.913511 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-host-run-ovn-kubernetes\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.915681 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.913513 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2335c195-a768-4809-a99c-621276a6fd6b-cni-binary-copy\") pod \"multus-additional-cni-plugins-7z5ql\" (UID: \"2335c195-a768-4809-a99c-621276a6fd6b\") " pod="openshift-multus/multus-additional-cni-plugins-7z5ql" Jul 24 17:20:06.915681 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.913520 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e-sys-fs\") pod \"aws-ebs-csi-driver-node-56hfg\" (UID: \"5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56hfg" Jul 24 17:20:06.915681 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.913599 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2335c195-a768-4809-a99c-621276a6fd6b-system-cni-dir\") pod \"multus-additional-cni-plugins-7z5ql\" (UID: \"2335c195-a768-4809-a99c-621276a6fd6b\") " pod="openshift-multus/multus-additional-cni-plugins-7z5ql" Jul 24 17:20:06.915681 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.913612 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.915681 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.913619 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-host-run-ovn-kubernetes\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.915681 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.913721 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bwckz\" (UniqueName: \"kubernetes.io/projected/0d218512-e801-4d6e-8f09-bd0ee5a815d9-kube-api-access-bwckz\") pod \"node-resolver-jj8qn\" (UID: \"0d218512-e801-4d6e-8f09-bd0ee5a815d9\") " pod="openshift-dns/node-resolver-jj8qn" Jul 24 17:20:06.915681 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.913768 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/76b2d34e-61a3-45fb-8652-66d51f0289d6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.915681 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.913877 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-host-var-lib-cni-bin\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.915681 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.913893 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/2335c195-a768-4809-a99c-621276a6fd6b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7z5ql\" (UID: \"2335c195-a768-4809-a99c-621276a6fd6b\") " pod="openshift-multus/multus-additional-cni-plugins-7z5ql" Jul 24 17:20:06.915681 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.913920 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx9hd\" (UniqueName: \"kubernetes.io/projected/2335c195-a768-4809-a99c-621276a6fd6b-kube-api-access-fx9hd\") pod \"multus-additional-cni-plugins-7z5ql\" (UID: \"2335c195-a768-4809-a99c-621276a6fd6b\") " pod="openshift-multus/multus-additional-cni-plugins-7z5ql" Jul 24 17:20:06.915681 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.913952 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-host-var-lib-cni-bin\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.915681 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.913993 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-cnibin\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.915681 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.914039 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-multus-socket-dir-parent\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.915681 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.914052 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-cnibin\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.915681 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.914088 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2335c195-a768-4809-a99c-621276a6fd6b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7z5ql\" (UID: \"2335c195-a768-4809-a99c-621276a6fd6b\") " pod="openshift-multus/multus-additional-cni-plugins-7z5ql" Jul 24 17:20:06.916386 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.914176 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-multus-socket-dir-parent\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.916386 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.914644 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/2335c195-a768-4809-a99c-621276a6fd6b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7z5ql\" (UID: \"2335c195-a768-4809-a99c-621276a6fd6b\") " pod="openshift-multus/multus-additional-cni-plugins-7z5ql" Jul 24 17:20:06.916386 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.915950 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-115.ec2.internal" event={"ID":"23d0e823dbe407b05e0ec0e36a2e5f00","Type":"ContainerStarted","Data":"57194f9368fa2caa262094e44874fabb1575d80d32ed77c2088b1d214f7b3aa4"} Jul 24 17:20:06.917061 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.917019 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/76b2d34e-61a3-45fb-8652-66d51f0289d6-ovn-node-metrics-cert\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.923197 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.923136 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hbgw\" (UniqueName: \"kubernetes.io/projected/c10bccc0-4f25-4a6c-9d75-999d4a20f6c7-kube-api-access-2hbgw\") pod \"multus-zfr4g\" (UID: \"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7\") " pod="openshift-multus/multus-zfr4g" Jul 24 17:20:06.928158 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.927758 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pvfsh\" (UniqueName: \"kubernetes.io/projected/57db7dd7-3eed-4936-818f-0fcf8d031c0f-kube-api-access-pvfsh\") pod \"node-ca-qc64j\" (UID: \"57db7dd7-3eed-4936-818f-0fcf8d031c0f\") " pod="openshift-image-registry/node-ca-qc64j" Jul 24 17:20:06.928158 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.928117 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5zx2\" (UniqueName: \"kubernetes.io/projected/5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e-kube-api-access-m5zx2\") pod \"aws-ebs-csi-driver-node-56hfg\" (UID: \"5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56hfg" Jul 24 17:20:06.928304 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.928197 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx9hd\" (UniqueName: \"kubernetes.io/projected/2335c195-a768-4809-a99c-621276a6fd6b-kube-api-access-fx9hd\") pod \"multus-additional-cni-plugins-7z5ql\" (UID: \"2335c195-a768-4809-a99c-621276a6fd6b\") " pod="openshift-multus/multus-additional-cni-plugins-7z5ql" Jul 24 17:20:06.928304 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.928206 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlhfj\" (UniqueName: \"kubernetes.io/projected/76b2d34e-61a3-45fb-8652-66d51f0289d6-kube-api-access-vlhfj\") pod \"ovnkube-node-v6pz6\" (UID: \"76b2d34e-61a3-45fb-8652-66d51f0289d6\") " pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:06.929204 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:06.929165 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bwckz\" (UniqueName: \"kubernetes.io/projected/0d218512-e801-4d6e-8f09-bd0ee5a815d9-kube-api-access-bwckz\") pod \"node-resolver-jj8qn\" (UID: \"0d218512-e801-4d6e-8f09-bd0ee5a815d9\") " pod="openshift-dns/node-resolver-jj8qn" Jul 24 17:20:07.004415 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:07.004384 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-fqhxk" Jul 24 17:20:07.016185 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:07.016163 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" Jul 24 17:20:07.026035 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:07.026012 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xb7qm" Jul 24 17:20:07.032540 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:07.032521 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56hfg" Jul 24 17:20:07.040101 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:07.040082 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:07.047568 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:07.047549 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-qc64j" Jul 24 17:20:07.055160 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:07.055143 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-zfr4g" Jul 24 17:20:07.063848 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:07.063830 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7z5ql" Jul 24 17:20:07.069579 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:07.069561 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jj8qn" Jul 24 17:20:07.317396 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:07.317300 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9c7af4e-bb66-40e8-936c-d9d62240e05f-metrics-certs\") pod \"network-metrics-daemon-njwgg\" (UID: \"c9c7af4e-bb66-40e8-936c-d9d62240e05f\") " pod="openshift-multus/network-metrics-daemon-njwgg" Jul 24 17:20:07.317550 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:07.317437 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 17:20:07.317550 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:07.317514 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9c7af4e-bb66-40e8-936c-d9d62240e05f-metrics-certs podName:c9c7af4e-bb66-40e8-936c-d9d62240e05f nodeName:}" failed. No retries permitted until 2026-07-24 17:20:08.317496164 +0000 UTC m=+3.985907187 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9c7af4e-bb66-40e8-936c-d9d62240e05f-metrics-certs") pod "network-metrics-daemon-njwgg" (UID: "c9c7af4e-bb66-40e8-936c-d9d62240e05f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 17:20:07.418144 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:07.418107 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6tmb\" (UniqueName: \"kubernetes.io/projected/b51ad1bf-cbce-4045-aee9-4997201a35cd-kube-api-access-l6tmb\") pod \"network-check-target-nsllf\" (UID: \"b51ad1bf-cbce-4045-aee9-4997201a35cd\") " pod="openshift-network-diagnostics/network-check-target-nsllf" Jul 24 17:20:07.418320 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:07.418156 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8dd24b3b-de29-4d73-9b9a-519287ab38c0-original-pull-secret\") pod \"global-pull-secret-syncer-7smjt\" (UID: \"8dd24b3b-de29-4d73-9b9a-519287ab38c0\") " pod="kube-system/global-pull-secret-syncer-7smjt" Jul 24 17:20:07.418320 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:07.418276 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 17:20:07.418320 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:07.418285 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 17:20:07.418320 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:07.418311 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 17:20:07.418530 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:07.418360 2570 projected.go:196] Error preparing data for projected volume kube-api-access-l6tmb for pod openshift-network-diagnostics/network-check-target-nsllf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 17:20:07.418530 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:07.418368 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dd24b3b-de29-4d73-9b9a-519287ab38c0-original-pull-secret podName:8dd24b3b-de29-4d73-9b9a-519287ab38c0 nodeName:}" failed. No retries permitted until 2026-07-24 17:20:08.418317189 +0000 UTC m=+4.086728196 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8dd24b3b-de29-4d73-9b9a-519287ab38c0-original-pull-secret") pod "global-pull-secret-syncer-7smjt" (UID: "8dd24b3b-de29-4d73-9b9a-519287ab38c0") : object "kube-system"/"original-pull-secret" not registered Jul 24 17:20:07.418530 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:07.418413 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b51ad1bf-cbce-4045-aee9-4997201a35cd-kube-api-access-l6tmb podName:b51ad1bf-cbce-4045-aee9-4997201a35cd nodeName:}" failed. No retries permitted until 2026-07-24 17:20:08.418396188 +0000 UTC m=+4.086807196 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-l6tmb" (UniqueName: "kubernetes.io/projected/b51ad1bf-cbce-4045-aee9-4997201a35cd-kube-api-access-l6tmb") pod "network-check-target-nsllf" (UID: "b51ad1bf-cbce-4045-aee9-4997201a35cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 17:20:07.743379 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:07.743322 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 17:15:06 +0000 UTC" deadline="2027-12-30 15:25:21.528368197 +0000 UTC" Jul 24 17:20:07.743379 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:07.743375 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12574h5m13.784999476s" Jul 24 17:20:07.824847 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:07.824803 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod723e5a70_b2cb_4a82_95d8_85be102d18ce.slice/crio-70fc6ebc3970d01470cdab90ff8e9e75d77bb5644ab2cdfe0deed6a6e344af8d WatchSource:0}: Error finding container 70fc6ebc3970d01470cdab90ff8e9e75d77bb5644ab2cdfe0deed6a6e344af8d: Status 404 returned error can't find the container with id 70fc6ebc3970d01470cdab90ff8e9e75d77bb5644ab2cdfe0deed6a6e344af8d Jul 24 17:20:07.831462 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:07.831441 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2335c195_a768_4809_a99c_621276a6fd6b.slice/crio-c8feb6947a5ee9a3b51076d8c27e515b757b424c16fe20c4a73bad4630cff5d1 WatchSource:0}: Error finding container c8feb6947a5ee9a3b51076d8c27e515b757b424c16fe20c4a73bad4630cff5d1: Status 404 returned error can't find the container with id c8feb6947a5ee9a3b51076d8c27e515b757b424c16fe20c4a73bad4630cff5d1 Jul 24 17:20:07.832171 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:07.832151 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76b2d34e_61a3_45fb_8652_66d51f0289d6.slice/crio-1535d0e72a0bffd466e57e8b5dfe624547568472e3ba948c3e66b25f8b5f81f7 WatchSource:0}: Error finding container 1535d0e72a0bffd466e57e8b5dfe624547568472e3ba948c3e66b25f8b5f81f7: Status 404 returned error can't find the container with id 1535d0e72a0bffd466e57e8b5dfe624547568472e3ba948c3e66b25f8b5f81f7 Jul 24 17:20:07.833687 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:07.833652 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc10bccc0_4f25_4a6c_9d75_999d4a20f6c7.slice/crio-d7111523f420a00ed0414de225e26621649a495928d4634e257236d2c1e1e2a8 WatchSource:0}: Error finding container d7111523f420a00ed0414de225e26621649a495928d4634e257236d2c1e1e2a8: Status 404 returned error can't find the container with id d7111523f420a00ed0414de225e26621649a495928d4634e257236d2c1e1e2a8 Jul 24 17:20:07.907874 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:07.907710 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njwgg" Jul 24 17:20:07.907984 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:07.907725 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7smjt" Jul 24 17:20:07.908036 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:07.907981 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njwgg" podUID="c9c7af4e-bb66-40e8-936c-d9d62240e05f" Jul 24 17:20:07.908073 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:07.907737 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsllf" Jul 24 17:20:07.908073 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:07.908046 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7smjt" podUID="8dd24b3b-de29-4d73-9b9a-519287ab38c0" Jul 24 17:20:07.908141 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:07.908101 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nsllf" podUID="b51ad1bf-cbce-4045-aee9-4997201a35cd" Jul 24 17:20:07.919131 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:07.919029 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-115.ec2.internal" event={"ID":"18378e7a938206fd65fc7da834e2352c","Type":"ContainerStarted","Data":"9f821a3ae0295cf6be104cf8cbcab1a066bb01dada212cb61d728882e82bc036"} Jul 24 17:20:07.920223 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:07.920200 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" event={"ID":"0b8671b0-9bd5-4f1f-adc9-83403b143b8a","Type":"ContainerStarted","Data":"785e6a47e109ddee4459cc66d64a9758143cd2c412594f5ad26913346acc03f5"} Jul 24 17:20:07.921301 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:07.921271 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56hfg" event={"ID":"5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e","Type":"ContainerStarted","Data":"cfac753cfb467e0bb3a8521b595d143784468e7f38008ff08a6b807e8e97c750"} Jul 24 17:20:07.922610 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:07.922589 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zfr4g" event={"ID":"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7","Type":"ContainerStarted","Data":"d7111523f420a00ed0414de225e26621649a495928d4634e257236d2c1e1e2a8"} Jul 24 17:20:07.923666 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:07.923644 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jj8qn" event={"ID":"0d218512-e801-4d6e-8f09-bd0ee5a815d9","Type":"ContainerStarted","Data":"db75c3218db85544a450372befe3b234bbb798c6632433d308ec2b9a3301ce08"} Jul 24 17:20:07.924739 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:07.924715 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qc64j" event={"ID":"57db7dd7-3eed-4936-818f-0fcf8d031c0f","Type":"ContainerStarted","Data":"e84446755f27a0e9690c2376cd2df25b573fc1d0fe3c8a6d0b7f34431a8b5764"} Jul 24 17:20:07.925846 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:07.925821 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" event={"ID":"76b2d34e-61a3-45fb-8652-66d51f0289d6","Type":"ContainerStarted","Data":"1535d0e72a0bffd466e57e8b5dfe624547568472e3ba948c3e66b25f8b5f81f7"} Jul 24 17:20:07.927053 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:07.927031 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7z5ql" event={"ID":"2335c195-a768-4809-a99c-621276a6fd6b","Type":"ContainerStarted","Data":"c8feb6947a5ee9a3b51076d8c27e515b757b424c16fe20c4a73bad4630cff5d1"} Jul 24 17:20:07.928010 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:07.927984 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fqhxk" event={"ID":"bcf29f60-9cc0-40b2-906e-774225ebf9ad","Type":"ContainerStarted","Data":"27f041e7d5ef861f6f195911c11503a3a80319ea3097fb07ab354f7d9460b420"} Jul 24 17:20:07.929082 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:07.929058 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xb7qm" event={"ID":"723e5a70-b2cb-4a82-95d8-85be102d18ce","Type":"ContainerStarted","Data":"70fc6ebc3970d01470cdab90ff8e9e75d77bb5644ab2cdfe0deed6a6e344af8d"} Jul 24 17:20:07.933055 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:07.933019 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-115.ec2.internal" podStartSLOduration=1.933008182 podStartE2EDuration="1.933008182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:20:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:20:07.93275452 +0000 UTC m=+3.601165547" watchObservedRunningTime="2026-07-24 17:20:07.933008182 +0000 UTC m=+3.601419206" Jul 24 17:20:08.322938 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:08.322854 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9c7af4e-bb66-40e8-936c-d9d62240e05f-metrics-certs\") pod \"network-metrics-daemon-njwgg\" (UID: \"c9c7af4e-bb66-40e8-936c-d9d62240e05f\") " pod="openshift-multus/network-metrics-daemon-njwgg" Jul 24 17:20:08.323086 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:08.323005 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 17:20:08.323086 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:08.323072 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9c7af4e-bb66-40e8-936c-d9d62240e05f-metrics-certs podName:c9c7af4e-bb66-40e8-936c-d9d62240e05f nodeName:}" failed. No retries permitted until 2026-07-24 17:20:10.323056395 +0000 UTC m=+5.991467396 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9c7af4e-bb66-40e8-936c-d9d62240e05f-metrics-certs") pod "network-metrics-daemon-njwgg" (UID: "c9c7af4e-bb66-40e8-936c-d9d62240e05f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 17:20:08.424524 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:08.423691 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6tmb\" (UniqueName: \"kubernetes.io/projected/b51ad1bf-cbce-4045-aee9-4997201a35cd-kube-api-access-l6tmb\") pod \"network-check-target-nsllf\" (UID: \"b51ad1bf-cbce-4045-aee9-4997201a35cd\") " pod="openshift-network-diagnostics/network-check-target-nsllf" Jul 24 17:20:08.424524 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:08.423752 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8dd24b3b-de29-4d73-9b9a-519287ab38c0-original-pull-secret\") pod \"global-pull-secret-syncer-7smjt\" (UID: \"8dd24b3b-de29-4d73-9b9a-519287ab38c0\") " pod="kube-system/global-pull-secret-syncer-7smjt" Jul 24 17:20:08.424524 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:08.423895 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 17:20:08.424524 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:08.423958 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dd24b3b-de29-4d73-9b9a-519287ab38c0-original-pull-secret podName:8dd24b3b-de29-4d73-9b9a-519287ab38c0 nodeName:}" failed. No retries permitted until 2026-07-24 17:20:10.423939649 +0000 UTC m=+6.092350671 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8dd24b3b-de29-4d73-9b9a-519287ab38c0-original-pull-secret") pod "global-pull-secret-syncer-7smjt" (UID: "8dd24b3b-de29-4d73-9b9a-519287ab38c0") : object "kube-system"/"original-pull-secret" not registered Jul 24 17:20:08.424524 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:08.424384 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 17:20:08.424524 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:08.424404 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 17:20:08.424524 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:08.424416 2570 projected.go:196] Error preparing data for projected volume kube-api-access-l6tmb for pod openshift-network-diagnostics/network-check-target-nsllf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 17:20:08.424524 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:08.424463 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b51ad1bf-cbce-4045-aee9-4997201a35cd-kube-api-access-l6tmb podName:b51ad1bf-cbce-4045-aee9-4997201a35cd nodeName:}" failed. No retries permitted until 2026-07-24 17:20:10.424448413 +0000 UTC m=+6.092859434 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-l6tmb" (UniqueName: "kubernetes.io/projected/b51ad1bf-cbce-4045-aee9-4997201a35cd-kube-api-access-l6tmb") pod "network-check-target-nsllf" (UID: "b51ad1bf-cbce-4045-aee9-4997201a35cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 17:20:08.744434 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:08.744358 2570 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 17:15:06 +0000 UTC" deadline="2028-01-10 14:41:04.041423656 +0000 UTC" Jul 24 17:20:08.744434 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:08.744414 2570 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12837h20m55.297013174s" Jul 24 17:20:08.955508 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:08.955470 2570 generic.go:356] "Generic (PLEG): container finished" podID="23d0e823dbe407b05e0ec0e36a2e5f00" containerID="8110bb5058de451d27fa8777409ab40f1a56e8abea33856f5262a704e9162c19" exitCode=0 Jul 24 17:20:08.956043 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:08.956017 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-115.ec2.internal" event={"ID":"23d0e823dbe407b05e0ec0e36a2e5f00","Type":"ContainerDied","Data":"8110bb5058de451d27fa8777409ab40f1a56e8abea33856f5262a704e9162c19"} Jul 24 17:20:09.907789 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:09.907744 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsllf" Jul 24 17:20:09.908283 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:09.907869 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nsllf" podUID="b51ad1bf-cbce-4045-aee9-4997201a35cd" Jul 24 17:20:09.908283 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:09.908243 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njwgg" Jul 24 17:20:09.908484 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:09.908375 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njwgg" podUID="c9c7af4e-bb66-40e8-936c-d9d62240e05f" Jul 24 17:20:09.908484 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:09.908432 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7smjt" Jul 24 17:20:09.908600 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:09.908504 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7smjt" podUID="8dd24b3b-de29-4d73-9b9a-519287ab38c0" Jul 24 17:20:09.977481 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:09.977430 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-115.ec2.internal" event={"ID":"23d0e823dbe407b05e0ec0e36a2e5f00","Type":"ContainerStarted","Data":"eb2638e4966f4661bb7ab4236d1e85313998153afef0861f02e0923f21e90143"} Jul 24 17:20:10.342514 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:10.342426 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9c7af4e-bb66-40e8-936c-d9d62240e05f-metrics-certs\") pod \"network-metrics-daemon-njwgg\" (UID: \"c9c7af4e-bb66-40e8-936c-d9d62240e05f\") " pod="openshift-multus/network-metrics-daemon-njwgg" Jul 24 17:20:10.342686 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:10.342593 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 17:20:10.342686 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:10.342654 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9c7af4e-bb66-40e8-936c-d9d62240e05f-metrics-certs podName:c9c7af4e-bb66-40e8-936c-d9d62240e05f nodeName:}" failed. No retries permitted until 2026-07-24 17:20:14.342636529 +0000 UTC m=+10.011047536 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9c7af4e-bb66-40e8-936c-d9d62240e05f-metrics-certs") pod "network-metrics-daemon-njwgg" (UID: "c9c7af4e-bb66-40e8-936c-d9d62240e05f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 17:20:10.443026 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:10.442973 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6tmb\" (UniqueName: \"kubernetes.io/projected/b51ad1bf-cbce-4045-aee9-4997201a35cd-kube-api-access-l6tmb\") pod \"network-check-target-nsllf\" (UID: \"b51ad1bf-cbce-4045-aee9-4997201a35cd\") " pod="openshift-network-diagnostics/network-check-target-nsllf" Jul 24 17:20:10.443026 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:10.443032 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8dd24b3b-de29-4d73-9b9a-519287ab38c0-original-pull-secret\") pod \"global-pull-secret-syncer-7smjt\" (UID: \"8dd24b3b-de29-4d73-9b9a-519287ab38c0\") " pod="kube-system/global-pull-secret-syncer-7smjt" Jul 24 17:20:10.443241 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:10.443191 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 17:20:10.443288 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:10.443249 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dd24b3b-de29-4d73-9b9a-519287ab38c0-original-pull-secret podName:8dd24b3b-de29-4d73-9b9a-519287ab38c0 nodeName:}" failed. No retries permitted until 2026-07-24 17:20:14.443232059 +0000 UTC m=+10.111643066 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8dd24b3b-de29-4d73-9b9a-519287ab38c0-original-pull-secret") pod "global-pull-secret-syncer-7smjt" (UID: "8dd24b3b-de29-4d73-9b9a-519287ab38c0") : object "kube-system"/"original-pull-secret" not registered Jul 24 17:20:10.443696 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:10.443675 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 17:20:10.443804 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:10.443704 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 17:20:10.443804 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:10.443716 2570 projected.go:196] Error preparing data for projected volume kube-api-access-l6tmb for pod openshift-network-diagnostics/network-check-target-nsllf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 17:20:10.443804 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:10.443762 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b51ad1bf-cbce-4045-aee9-4997201a35cd-kube-api-access-l6tmb podName:b51ad1bf-cbce-4045-aee9-4997201a35cd nodeName:}" failed. No retries permitted until 2026-07-24 17:20:14.443746608 +0000 UTC m=+10.112157613 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-l6tmb" (UniqueName: "kubernetes.io/projected/b51ad1bf-cbce-4045-aee9-4997201a35cd-kube-api-access-l6tmb") pod "network-check-target-nsllf" (UID: "b51ad1bf-cbce-4045-aee9-4997201a35cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 17:20:11.908234 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:11.908196 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsllf" Jul 24 17:20:11.908726 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:11.908245 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7smjt" Jul 24 17:20:11.908726 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:11.908211 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njwgg" Jul 24 17:20:11.908726 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:11.908326 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nsllf" podUID="b51ad1bf-cbce-4045-aee9-4997201a35cd" Jul 24 17:20:11.908726 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:11.908476 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njwgg" podUID="c9c7af4e-bb66-40e8-936c-d9d62240e05f" Jul 24 17:20:11.908726 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:11.908579 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7smjt" podUID="8dd24b3b-de29-4d73-9b9a-519287ab38c0" Jul 24 17:20:13.908137 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:13.908106 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njwgg" Jul 24 17:20:13.908743 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:13.908245 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njwgg" podUID="c9c7af4e-bb66-40e8-936c-d9d62240e05f" Jul 24 17:20:13.908743 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:13.908433 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsllf" Jul 24 17:20:13.908743 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:13.908455 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7smjt" Jul 24 17:20:13.908743 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:13.908541 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nsllf" podUID="b51ad1bf-cbce-4045-aee9-4997201a35cd" Jul 24 17:20:13.908743 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:13.908646 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7smjt" podUID="8dd24b3b-de29-4d73-9b9a-519287ab38c0" Jul 24 17:20:14.374956 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:14.374892 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9c7af4e-bb66-40e8-936c-d9d62240e05f-metrics-certs\") pod \"network-metrics-daemon-njwgg\" (UID: \"c9c7af4e-bb66-40e8-936c-d9d62240e05f\") " pod="openshift-multus/network-metrics-daemon-njwgg" Jul 24 17:20:14.375136 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:14.375007 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 17:20:14.375136 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:14.375081 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9c7af4e-bb66-40e8-936c-d9d62240e05f-metrics-certs podName:c9c7af4e-bb66-40e8-936c-d9d62240e05f nodeName:}" failed. No retries permitted until 2026-07-24 17:20:22.375060662 +0000 UTC m=+18.043471676 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9c7af4e-bb66-40e8-936c-d9d62240e05f-metrics-certs") pod "network-metrics-daemon-njwgg" (UID: "c9c7af4e-bb66-40e8-936c-d9d62240e05f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 17:20:14.475550 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:14.475514 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6tmb\" (UniqueName: \"kubernetes.io/projected/b51ad1bf-cbce-4045-aee9-4997201a35cd-kube-api-access-l6tmb\") pod \"network-check-target-nsllf\" (UID: \"b51ad1bf-cbce-4045-aee9-4997201a35cd\") " pod="openshift-network-diagnostics/network-check-target-nsllf" Jul 24 17:20:14.475725 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:14.475576 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8dd24b3b-de29-4d73-9b9a-519287ab38c0-original-pull-secret\") pod \"global-pull-secret-syncer-7smjt\" (UID: \"8dd24b3b-de29-4d73-9b9a-519287ab38c0\") " pod="kube-system/global-pull-secret-syncer-7smjt" Jul 24 17:20:14.475725 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:14.475698 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 17:20:14.475852 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:14.475756 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dd24b3b-de29-4d73-9b9a-519287ab38c0-original-pull-secret podName:8dd24b3b-de29-4d73-9b9a-519287ab38c0 nodeName:}" failed. No retries permitted until 2026-07-24 17:20:22.475737802 +0000 UTC m=+18.144148811 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8dd24b3b-de29-4d73-9b9a-519287ab38c0-original-pull-secret") pod "global-pull-secret-syncer-7smjt" (UID: "8dd24b3b-de29-4d73-9b9a-519287ab38c0") : object "kube-system"/"original-pull-secret" not registered Jul 24 17:20:14.476159 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:14.476141 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 17:20:14.476243 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:14.476169 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 17:20:14.476243 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:14.476182 2570 projected.go:196] Error preparing data for projected volume kube-api-access-l6tmb for pod openshift-network-diagnostics/network-check-target-nsllf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 17:20:14.476243 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:14.476227 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b51ad1bf-cbce-4045-aee9-4997201a35cd-kube-api-access-l6tmb podName:b51ad1bf-cbce-4045-aee9-4997201a35cd nodeName:}" failed. No retries permitted until 2026-07-24 17:20:22.476212407 +0000 UTC m=+18.144623414 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-l6tmb" (UniqueName: "kubernetes.io/projected/b51ad1bf-cbce-4045-aee9-4997201a35cd-kube-api-access-l6tmb") pod "network-check-target-nsllf" (UID: "b51ad1bf-cbce-4045-aee9-4997201a35cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 17:20:15.907245 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:15.907217 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsllf" Jul 24 17:20:15.907728 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:15.907326 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nsllf" podUID="b51ad1bf-cbce-4045-aee9-4997201a35cd" Jul 24 17:20:15.907728 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:15.907396 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njwgg" Jul 24 17:20:15.907728 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:15.907494 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njwgg" podUID="c9c7af4e-bb66-40e8-936c-d9d62240e05f" Jul 24 17:20:15.907728 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:15.907542 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7smjt" Jul 24 17:20:15.907728 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:15.907604 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7smjt" podUID="8dd24b3b-de29-4d73-9b9a-519287ab38c0" Jul 24 17:20:17.907580 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:17.907548 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsllf" Jul 24 17:20:17.908058 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:17.907665 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7smjt" Jul 24 17:20:17.908058 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:17.907672 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nsllf" podUID="b51ad1bf-cbce-4045-aee9-4997201a35cd" Jul 24 17:20:17.908058 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:17.907698 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njwgg" Jul 24 17:20:17.908058 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:17.907797 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7smjt" podUID="8dd24b3b-de29-4d73-9b9a-519287ab38c0" Jul 24 17:20:17.908058 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:17.907872 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njwgg" podUID="c9c7af4e-bb66-40e8-936c-d9d62240e05f" Jul 24 17:20:19.908239 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:19.908202 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njwgg" Jul 24 17:20:19.908717 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:19.908214 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7smjt" Jul 24 17:20:19.908717 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:19.908320 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njwgg" podUID="c9c7af4e-bb66-40e8-936c-d9d62240e05f" Jul 24 17:20:19.908717 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:19.908356 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsllf" Jul 24 17:20:19.908717 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:19.908434 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7smjt" podUID="8dd24b3b-de29-4d73-9b9a-519287ab38c0" Jul 24 17:20:19.908717 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:19.908540 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nsllf" podUID="b51ad1bf-cbce-4045-aee9-4997201a35cd" Jul 24 17:20:21.907969 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:21.907933 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njwgg" Jul 24 17:20:21.907969 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:21.907956 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7smjt" Jul 24 17:20:21.908539 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:21.908064 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njwgg" podUID="c9c7af4e-bb66-40e8-936c-d9d62240e05f" Jul 24 17:20:21.908539 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:21.908139 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsllf" Jul 24 17:20:21.908539 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:21.908262 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nsllf" podUID="b51ad1bf-cbce-4045-aee9-4997201a35cd" Jul 24 17:20:21.908539 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:21.908370 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7smjt" podUID="8dd24b3b-de29-4d73-9b9a-519287ab38c0" Jul 24 17:20:22.439056 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:22.439029 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9c7af4e-bb66-40e8-936c-d9d62240e05f-metrics-certs\") pod \"network-metrics-daemon-njwgg\" (UID: \"c9c7af4e-bb66-40e8-936c-d9d62240e05f\") " pod="openshift-multus/network-metrics-daemon-njwgg" Jul 24 17:20:22.439261 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:22.439146 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 17:20:22.439261 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:22.439200 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9c7af4e-bb66-40e8-936c-d9d62240e05f-metrics-certs podName:c9c7af4e-bb66-40e8-936c-d9d62240e05f nodeName:}" failed. No retries permitted until 2026-07-24 17:20:38.439186741 +0000 UTC m=+34.107597742 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9c7af4e-bb66-40e8-936c-d9d62240e05f-metrics-certs") pod "network-metrics-daemon-njwgg" (UID: "c9c7af4e-bb66-40e8-936c-d9d62240e05f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 17:20:22.539852 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:22.539822 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6tmb\" (UniqueName: \"kubernetes.io/projected/b51ad1bf-cbce-4045-aee9-4997201a35cd-kube-api-access-l6tmb\") pod \"network-check-target-nsllf\" (UID: \"b51ad1bf-cbce-4045-aee9-4997201a35cd\") " pod="openshift-network-diagnostics/network-check-target-nsllf" Jul 24 17:20:22.539979 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:22.539862 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8dd24b3b-de29-4d73-9b9a-519287ab38c0-original-pull-secret\") pod \"global-pull-secret-syncer-7smjt\" (UID: \"8dd24b3b-de29-4d73-9b9a-519287ab38c0\") " pod="kube-system/global-pull-secret-syncer-7smjt" Jul 24 17:20:22.539979 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:22.539951 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 17:20:22.539979 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:22.539967 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 17:20:22.540077 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:22.539987 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 17:20:22.540077 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:22.539996 2570 projected.go:196] Error preparing data for projected volume kube-api-access-l6tmb for pod openshift-network-diagnostics/network-check-target-nsllf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 17:20:22.540077 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:22.540001 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dd24b3b-de29-4d73-9b9a-519287ab38c0-original-pull-secret podName:8dd24b3b-de29-4d73-9b9a-519287ab38c0 nodeName:}" failed. No retries permitted until 2026-07-24 17:20:38.539985952 +0000 UTC m=+34.208396956 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8dd24b3b-de29-4d73-9b9a-519287ab38c0-original-pull-secret") pod "global-pull-secret-syncer-7smjt" (UID: "8dd24b3b-de29-4d73-9b9a-519287ab38c0") : object "kube-system"/"original-pull-secret" not registered Jul 24 17:20:22.540077 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:22.540032 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b51ad1bf-cbce-4045-aee9-4997201a35cd-kube-api-access-l6tmb podName:b51ad1bf-cbce-4045-aee9-4997201a35cd nodeName:}" failed. No retries permitted until 2026-07-24 17:20:38.540021301 +0000 UTC m=+34.208432308 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-l6tmb" (UniqueName: "kubernetes.io/projected/b51ad1bf-cbce-4045-aee9-4997201a35cd-kube-api-access-l6tmb") pod "network-check-target-nsllf" (UID: "b51ad1bf-cbce-4045-aee9-4997201a35cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 17:20:23.908018 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:23.907981 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7smjt" Jul 24 17:20:23.908553 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:23.908109 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7smjt" podUID="8dd24b3b-de29-4d73-9b9a-519287ab38c0" Jul 24 17:20:23.908553 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:23.908492 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsllf" Jul 24 17:20:23.908672 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:23.908563 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nsllf" podUID="b51ad1bf-cbce-4045-aee9-4997201a35cd" Jul 24 17:20:23.908672 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:23.908611 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njwgg" Jul 24 17:20:23.908765 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:23.908701 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njwgg" podUID="c9c7af4e-bb66-40e8-936c-d9d62240e05f" Jul 24 17:20:25.907593 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:25.907557 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njwgg" Jul 24 17:20:25.908063 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:25.907555 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7smjt" Jul 24 17:20:25.908063 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:25.907700 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njwgg" podUID="c9c7af4e-bb66-40e8-936c-d9d62240e05f" Jul 24 17:20:25.908063 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:25.907777 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7smjt" podUID="8dd24b3b-de29-4d73-9b9a-519287ab38c0" Jul 24 17:20:25.908063 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:25.907555 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsllf" Jul 24 17:20:25.908063 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:25.907854 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nsllf" podUID="b51ad1bf-cbce-4045-aee9-4997201a35cd" Jul 24 17:20:27.020277 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:27.019940 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jj8qn" event={"ID":"0d218512-e801-4d6e-8f09-bd0ee5a815d9","Type":"ContainerStarted","Data":"dd9dbd702059beed7dcec72ed67e765697ab882e81c57503b51e84aa4938b835"} Jul 24 17:20:27.021676 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:27.021646 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-qc64j" event={"ID":"57db7dd7-3eed-4936-818f-0fcf8d031c0f","Type":"ContainerStarted","Data":"b11624cdd069f005ead9503a4d96024cd652e5394dfbfc1966a5b3580317fa38"} Jul 24 17:20:27.023738 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:27.023719 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" event={"ID":"76b2d34e-61a3-45fb-8652-66d51f0289d6","Type":"ContainerStarted","Data":"de199ccd0e43dc5e78d59fb2c97eb076ad5df83ad539085d52924f75594fbb09"} Jul 24 17:20:27.023838 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:27.023796 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" event={"ID":"76b2d34e-61a3-45fb-8652-66d51f0289d6","Type":"ContainerStarted","Data":"775299a2b0cede74e5b66b1008251bca22c411c75158d9efa1bc01be532b3a22"} Jul 24 17:20:27.023895 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:27.023851 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" event={"ID":"76b2d34e-61a3-45fb-8652-66d51f0289d6","Type":"ContainerStarted","Data":"7e2180f073330bf80bd1be43913c0e7f387b12d0740c9b2dc6077c2de3131d02"} Jul 24 17:20:27.025254 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:27.025234 2570 generic.go:356] "Generic (PLEG): container finished" podID="2335c195-a768-4809-a99c-621276a6fd6b" containerID="d77c6e942aa764858344e0806c3e601664ef8b04d410048e16c9d360cb097da3" exitCode=0 Jul 24 17:20:27.025378 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:27.025277 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7z5ql" event={"ID":"2335c195-a768-4809-a99c-621276a6fd6b","Type":"ContainerDied","Data":"d77c6e942aa764858344e0806c3e601664ef8b04d410048e16c9d360cb097da3"} Jul 24 17:20:27.026920 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:27.026901 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-fqhxk" event={"ID":"bcf29f60-9cc0-40b2-906e-774225ebf9ad","Type":"ContainerStarted","Data":"b6c3bf0760162adcf262c4a91dea9d16c47623394084d9384f78658f57eb5d89"} Jul 24 17:20:27.028268 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:27.028252 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" event={"ID":"0b8671b0-9bd5-4f1f-adc9-83403b143b8a","Type":"ContainerStarted","Data":"d9cad52eb8751de56e3cc5a085dbc72985c49627fbc4d241052e62d6e8577eca"} Jul 24 17:20:27.029610 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:27.029592 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56hfg" event={"ID":"5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e","Type":"ContainerStarted","Data":"26ea6ff4b76988e5e9c998398689c0095cf40e42c0e730dd7b53f7ea3e78d4ae"} Jul 24 17:20:27.030761 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:27.030744 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-zfr4g" event={"ID":"c10bccc0-4f25-4a6c-9d75-999d4a20f6c7","Type":"ContainerStarted","Data":"5fbdd08f326bf379f4a2ec2fd9b83133f88ca099434786a72ea36f89386aba70"} Jul 24 17:20:27.035082 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:27.035049 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jj8qn" podStartSLOduration=3.333863312 podStartE2EDuration="22.035038157s" totalImagesPullingTime="18.701174845s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:20:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:20:27.0349427 +0000 UTC m=+22.703353723" watchObservedRunningTime="2026-07-24 17:20:27.035038157 +0000 UTC m=+22.703449181" Jul 24 17:20:27.035169 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:27.035136 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-115.ec2.internal" podStartSLOduration=21.035132438 podStartE2EDuration="21.035132438s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:20:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:20:09.998523767 +0000 UTC m=+5.666934793" watchObservedRunningTime="2026-07-24 17:20:27.035132438 +0000 UTC m=+22.703543461" Jul 24 17:20:27.054311 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:27.054280 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sc2sx" podStartSLOduration=4.346715661 podStartE2EDuration="23.05426785s" totalImagesPullingTime="18.707552189s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:20:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:20:27.054172749 +0000 UTC m=+22.722583778" watchObservedRunningTime="2026-07-24 17:20:27.05426785 +0000 UTC m=+22.722678874" Jul 24 17:20:27.068244 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:27.068205 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-qc64j" podStartSLOduration=4.36544249 podStartE2EDuration="23.068190133s" totalImagesPullingTime="18.702747643s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:20:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:20:27.06798318 +0000 UTC m=+22.736394203" watchObservedRunningTime="2026-07-24 17:20:27.068190133 +0000 UTC m=+22.736601189" Jul 24 17:20:27.085152 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:27.085119 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-zfr4g" podStartSLOduration=4.327085876 podStartE2EDuration="23.085102571s" totalImagesPullingTime="18.758016695s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:20:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:20:27.084586474 +0000 UTC m=+22.752997498" watchObservedRunningTime="2026-07-24 17:20:27.085102571 +0000 UTC m=+22.753513595" Jul 24 17:20:27.908038 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:27.908001 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7smjt" Jul 24 17:20:27.908284 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:27.908125 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njwgg" Jul 24 17:20:27.908284 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:27.908127 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7smjt" podUID="8dd24b3b-de29-4d73-9b9a-519287ab38c0" Jul 24 17:20:27.908284 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:27.908129 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsllf" Jul 24 17:20:27.908284 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:27.908240 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njwgg" podUID="c9c7af4e-bb66-40e8-936c-d9d62240e05f" Jul 24 17:20:27.908536 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:27.908304 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nsllf" podUID="b51ad1bf-cbce-4045-aee9-4997201a35cd" Jul 24 17:20:28.036722 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:28.036683 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" event={"ID":"76b2d34e-61a3-45fb-8652-66d51f0289d6","Type":"ContainerStarted","Data":"0d3d07443084d6bbaf1f5e3c95461a15cf32380f6e166ec4f70f1fb4e9149e2f"} Jul 24 17:20:28.037205 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:28.036781 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" event={"ID":"76b2d34e-61a3-45fb-8652-66d51f0289d6","Type":"ContainerStarted","Data":"29b4259b43ed77adb9818e48870afb417497601c2602071db0fbc52f7bed66c0"} Jul 24 17:20:28.037205 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:28.036835 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" event={"ID":"76b2d34e-61a3-45fb-8652-66d51f0289d6","Type":"ContainerStarted","Data":"f1d8d58a504fd233f62bf97aff8a12a6fdb1f0b8a1fe7acfddaf8ab5c59c757a"} Jul 24 17:20:28.038652 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:28.038206 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xb7qm" event={"ID":"723e5a70-b2cb-4a82-95d8-85be102d18ce","Type":"ContainerStarted","Data":"f591e0980d80e6f3be9976b784c5e66e633afb80f9838308f4c8d5c98aaf8e8f"} Jul 24 17:20:28.055274 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:28.055235 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-fqhxk" podStartSLOduration=13.245448197 podStartE2EDuration="24.055221485s" totalImagesPullingTime="10.809773288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:20:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:20:27.124753618 +0000 UTC m=+22.793164641" watchObservedRunningTime="2026-07-24 17:20:28.055221485 +0000 UTC m=+23.723632508" Jul 24 17:20:28.055898 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:28.055862 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xb7qm" podStartSLOduration=5.342816349 podStartE2EDuration="24.055852863s" totalImagesPullingTime="18.713036514s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:20:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:20:28.055367174 +0000 UTC m=+23.723778199" watchObservedRunningTime="2026-07-24 17:20:28.055852863 +0000 UTC m=+23.724263886" Jul 24 17:20:28.081527 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:28.081505 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-fqhxk" Jul 24 17:20:28.082303 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:28.082288 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-fqhxk" Jul 24 17:20:28.250118 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:28.250091 2570 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 24 17:20:28.768828 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:28.768711 2570 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T17:20:28.250114078Z","UUID":"aa614377-881c-498a-b77d-a29fdbb21e77","Handler":null,"Name":"","Endpoint":""} Jul 24 17:20:28.770289 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:28.770267 2570 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 24 17:20:28.770436 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:28.770303 2570 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 24 17:20:29.042418 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:29.042320 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56hfg" event={"ID":"5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e","Type":"ContainerStarted","Data":"457d7c83262bdae00935eeea7eb6a375a8475e6e053d1d77cd98b0a4f69285fc"} Jul 24 17:20:29.643077 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:29.643049 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-fqhxk" Jul 24 17:20:29.643816 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:29.643796 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-fqhxk" Jul 24 17:20:29.907289 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:29.907223 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7smjt" Jul 24 17:20:29.907289 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:29.907259 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsllf" Jul 24 17:20:29.907603 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:29.907350 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njwgg" Jul 24 17:20:29.907603 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:29.907381 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7smjt" podUID="8dd24b3b-de29-4d73-9b9a-519287ab38c0" Jul 24 17:20:29.907603 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:29.907537 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njwgg" podUID="c9c7af4e-bb66-40e8-936c-d9d62240e05f" Jul 24 17:20:29.907737 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:29.907627 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nsllf" podUID="b51ad1bf-cbce-4045-aee9-4997201a35cd" Jul 24 17:20:30.038637 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:30.038609 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jj8qn_0d218512-e801-4d6e-8f09-bd0ee5a815d9/dns-node-resolver/0.log" Jul 24 17:20:30.047930 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:30.047890 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" event={"ID":"76b2d34e-61a3-45fb-8652-66d51f0289d6","Type":"ContainerStarted","Data":"7fb16fb3ea1e7e8f3dfc4554b3655ba0c8d817a3b9af7a8b588e66ad94f86dca"} Jul 24 17:20:30.807618 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:30.807591 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qc64j_57db7dd7-3eed-4936-818f-0fcf8d031c0f/node-ca/0.log" Jul 24 17:20:31.908383 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:31.908195 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7smjt" Jul 24 17:20:31.908971 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:31.908220 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njwgg" Jul 24 17:20:31.908971 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:31.908465 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7smjt" podUID="8dd24b3b-de29-4d73-9b9a-519287ab38c0" Jul 24 17:20:31.908971 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:31.908249 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsllf" Jul 24 17:20:31.908971 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:31.908547 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njwgg" podUID="c9c7af4e-bb66-40e8-936c-d9d62240e05f" Jul 24 17:20:31.908971 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:31.908633 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nsllf" podUID="b51ad1bf-cbce-4045-aee9-4997201a35cd" Jul 24 17:20:32.056243 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:32.056209 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" event={"ID":"76b2d34e-61a3-45fb-8652-66d51f0289d6","Type":"ContainerStarted","Data":"e9ced8f35776d330eb32a99fe0c5fa35f032b0a6913a2e01ab65b058196bc97a"} Jul 24 17:20:32.056530 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:32.056505 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:32.056634 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:32.056567 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:32.056634 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:32.056625 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:32.058818 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:32.058790 2570 generic.go:356] "Generic (PLEG): container finished" podID="2335c195-a768-4809-a99c-621276a6fd6b" containerID="3f9a3f5deff19761a73ccace940e324551fe8561f1a7b280575f81d1c4cd03d0" exitCode=0 Jul 24 17:20:32.059086 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:32.058873 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7z5ql" event={"ID":"2335c195-a768-4809-a99c-621276a6fd6b","Type":"ContainerDied","Data":"3f9a3f5deff19761a73ccace940e324551fe8561f1a7b280575f81d1c4cd03d0"} Jul 24 17:20:32.061409 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:32.061354 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56hfg" event={"ID":"5b3a8cdd-42cb-4ba7-a33b-400bbe5e154e","Type":"ContainerStarted","Data":"6e9bfb4c7716d062824de782b158ae2f33c3101f7251aab97952d7fcadd0da93"} Jul 24 17:20:32.072964 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:32.072949 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:32.073080 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:32.073034 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:20:32.088761 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:32.088726 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" podStartSLOduration=9.305603505 podStartE2EDuration="28.088714604s" totalImagesPullingTime="18.783111099s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:20:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:20:32.088377785 +0000 UTC m=+27.756788822" watchObservedRunningTime="2026-07-24 17:20:32.088714604 +0000 UTC m=+27.757125643" Jul 24 17:20:32.158748 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:32.158674 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-56hfg" podStartSLOduration=5.099090028 podStartE2EDuration="28.158662076s" totalImagesPullingTime="23.059572048s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:20:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:20:32.158318184 +0000 UTC m=+27.826729209" watchObservedRunningTime="2026-07-24 17:20:32.158662076 +0000 UTC m=+27.827073099" Jul 24 17:20:33.537791 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:33.537552 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7smjt"] Jul 24 17:20:33.538273 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:33.537820 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7smjt" Jul 24 17:20:33.538273 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:33.537931 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7smjt" podUID="8dd24b3b-de29-4d73-9b9a-519287ab38c0" Jul 24 17:20:33.542123 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:33.542097 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nsllf"] Jul 24 17:20:33.542230 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:33.542201 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsllf" Jul 24 17:20:33.542296 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:33.542273 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nsllf" podUID="b51ad1bf-cbce-4045-aee9-4997201a35cd" Jul 24 17:20:33.542706 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:33.542689 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-njwgg"] Jul 24 17:20:33.542792 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:33.542781 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njwgg" Jul 24 17:20:33.542882 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:33.542866 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njwgg" podUID="c9c7af4e-bb66-40e8-936c-d9d62240e05f" Jul 24 17:20:34.067048 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:34.067014 2570 generic.go:356] "Generic (PLEG): container finished" podID="2335c195-a768-4809-a99c-621276a6fd6b" containerID="f72f85579e20b0f496f8c3fbe62a3c1fa542ec46142faedf2759259a387ed8e9" exitCode=0 Jul 24 17:20:34.067198 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:34.067091 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7z5ql" event={"ID":"2335c195-a768-4809-a99c-621276a6fd6b","Type":"ContainerDied","Data":"f72f85579e20b0f496f8c3fbe62a3c1fa542ec46142faedf2759259a387ed8e9"} Jul 24 17:20:34.908695 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:34.908658 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njwgg" Jul 24 17:20:34.909126 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:34.908778 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njwgg" podUID="c9c7af4e-bb66-40e8-936c-d9d62240e05f" Jul 24 17:20:34.909126 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:34.908872 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7smjt" Jul 24 17:20:34.909126 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:34.908988 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7smjt" podUID="8dd24b3b-de29-4d73-9b9a-519287ab38c0" Jul 24 17:20:35.908299 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:35.908135 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsllf" Jul 24 17:20:35.908482 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:35.908403 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nsllf" podUID="b51ad1bf-cbce-4045-aee9-4997201a35cd" Jul 24 17:20:36.074630 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:36.074598 2570 generic.go:356] "Generic (PLEG): container finished" podID="2335c195-a768-4809-a99c-621276a6fd6b" containerID="f7caf76dc595cf767695f170059367b57f62b5ab45228e97f1baad522e650c57" exitCode=0 Jul 24 17:20:36.075090 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:36.074652 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7z5ql" event={"ID":"2335c195-a768-4809-a99c-621276a6fd6b","Type":"ContainerDied","Data":"f7caf76dc595cf767695f170059367b57f62b5ab45228e97f1baad522e650c57"} Jul 24 17:20:36.908187 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:36.908157 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7smjt" Jul 24 17:20:36.908407 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:36.908264 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7smjt" podUID="8dd24b3b-de29-4d73-9b9a-519287ab38c0" Jul 24 17:20:36.908407 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:36.908296 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njwgg" Jul 24 17:20:36.908525 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:36.908406 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njwgg" podUID="c9c7af4e-bb66-40e8-936c-d9d62240e05f" Jul 24 17:20:37.908222 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:37.908113 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsllf" Jul 24 17:20:37.908753 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:37.908328 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-nsllf" podUID="b51ad1bf-cbce-4045-aee9-4997201a35cd" Jul 24 17:20:38.462215 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:38.462181 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9c7af4e-bb66-40e8-936c-d9d62240e05f-metrics-certs\") pod \"network-metrics-daemon-njwgg\" (UID: \"c9c7af4e-bb66-40e8-936c-d9d62240e05f\") " pod="openshift-multus/network-metrics-daemon-njwgg" Jul 24 17:20:38.462426 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:38.462291 2570 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 17:20:38.462426 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:38.462364 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c9c7af4e-bb66-40e8-936c-d9d62240e05f-metrics-certs podName:c9c7af4e-bb66-40e8-936c-d9d62240e05f nodeName:}" failed. No retries permitted until 2026-07-24 17:21:10.462347194 +0000 UTC m=+66.130758196 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c9c7af4e-bb66-40e8-936c-d9d62240e05f-metrics-certs") pod "network-metrics-daemon-njwgg" (UID: "c9c7af4e-bb66-40e8-936c-d9d62240e05f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 17:20:38.563516 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:38.563485 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6tmb\" (UniqueName: \"kubernetes.io/projected/b51ad1bf-cbce-4045-aee9-4997201a35cd-kube-api-access-l6tmb\") pod \"network-check-target-nsllf\" (UID: \"b51ad1bf-cbce-4045-aee9-4997201a35cd\") " pod="openshift-network-diagnostics/network-check-target-nsllf" Jul 24 17:20:38.563689 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:38.563529 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8dd24b3b-de29-4d73-9b9a-519287ab38c0-original-pull-secret\") pod \"global-pull-secret-syncer-7smjt\" (UID: \"8dd24b3b-de29-4d73-9b9a-519287ab38c0\") " pod="kube-system/global-pull-secret-syncer-7smjt" Jul 24 17:20:38.563689 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:38.563646 2570 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 17:20:38.563689 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:38.563662 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 17:20:38.563689 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:38.563678 2570 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 17:20:38.563689 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:38.563689 2570 projected.go:196] Error preparing data for projected volume kube-api-access-l6tmb for pod openshift-network-diagnostics/network-check-target-nsllf: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 17:20:38.563947 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:38.563711 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8dd24b3b-de29-4d73-9b9a-519287ab38c0-original-pull-secret podName:8dd24b3b-de29-4d73-9b9a-519287ab38c0 nodeName:}" failed. No retries permitted until 2026-07-24 17:21:10.563691763 +0000 UTC m=+66.232102769 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/8dd24b3b-de29-4d73-9b9a-519287ab38c0-original-pull-secret") pod "global-pull-secret-syncer-7smjt" (UID: "8dd24b3b-de29-4d73-9b9a-519287ab38c0") : object "kube-system"/"original-pull-secret" not registered Jul 24 17:20:38.563947 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:38.563728 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b51ad1bf-cbce-4045-aee9-4997201a35cd-kube-api-access-l6tmb podName:b51ad1bf-cbce-4045-aee9-4997201a35cd nodeName:}" failed. No retries permitted until 2026-07-24 17:21:10.563718303 +0000 UTC m=+66.232129321 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-l6tmb" (UniqueName: "kubernetes.io/projected/b51ad1bf-cbce-4045-aee9-4997201a35cd-kube-api-access-l6tmb") pod "network-check-target-nsllf" (UID: "b51ad1bf-cbce-4045-aee9-4997201a35cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 17:20:38.907563 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:38.907529 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njwgg" Jul 24 17:20:38.907563 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:38.907558 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7smjt" Jul 24 17:20:38.907772 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:38.907656 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7smjt" podUID="8dd24b3b-de29-4d73-9b9a-519287ab38c0" Jul 24 17:20:38.907820 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:38.907795 2570 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-njwgg" podUID="c9c7af4e-bb66-40e8-936c-d9d62240e05f" Jul 24 17:20:39.143204 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.143178 2570 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-115.ec2.internal" event="NodeReady" Jul 24 17:20:39.143619 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.143313 2570 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 24 17:20:39.199402 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.199316 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qsn2t"] Jul 24 17:20:39.202523 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.202501 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qsn2t" Jul 24 17:20:39.206108 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.206083 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 24 17:20:39.206211 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.206111 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jtfqv\"" Jul 24 17:20:39.206546 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.206524 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 24 17:20:39.207539 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.207518 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-qjpvd"] Jul 24 17:20:39.210173 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.210156 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qjpvd" Jul 24 17:20:39.212691 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.212672 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-pkrw7\"" Jul 24 17:20:39.212793 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.212723 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 24 17:20:39.213037 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.213020 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 24 17:20:39.213161 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.213144 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 24 17:20:39.218656 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.218636 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qsn2t"] Jul 24 17:20:39.225215 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.225196 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qjpvd"] Jul 24 17:20:39.240230 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.240212 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nbhc9"] Jul 24 17:20:39.242476 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.242456 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nbhc9" Jul 24 17:20:39.245017 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.244999 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 24 17:20:39.245119 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.244999 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 24 17:20:39.245401 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.245370 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 24 17:20:39.245508 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.245480 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-ts8s2\"" Jul 24 17:20:39.245758 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.245738 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 24 17:20:39.256714 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.256698 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nbhc9"] Jul 24 17:20:39.371257 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.371224 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ee78578-9e17-4d87-99bc-9eb4c154fcc7-data-volume\") pod \"insights-runtime-extractor-nbhc9\" (UID: \"2ee78578-9e17-4d87-99bc-9eb4c154fcc7\") " pod="openshift-insights/insights-runtime-extractor-nbhc9" Jul 24 17:20:39.371257 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.371260 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2z8h2\" (UniqueName: \"kubernetes.io/projected/2ee78578-9e17-4d87-99bc-9eb4c154fcc7-kube-api-access-2z8h2\") pod \"insights-runtime-extractor-nbhc9\" (UID: \"2ee78578-9e17-4d87-99bc-9eb4c154fcc7\") " pod="openshift-insights/insights-runtime-extractor-nbhc9" Jul 24 17:20:39.371491 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.371288 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-shkjv\" (UniqueName: \"kubernetes.io/projected/1b2b7518-d0bb-4993-abb8-ac53aaba9825-kube-api-access-shkjv\") pod \"ingress-canary-qjpvd\" (UID: \"1b2b7518-d0bb-4993-abb8-ac53aaba9825\") " pod="openshift-ingress-canary/ingress-canary-qjpvd" Jul 24 17:20:39.371491 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.371318 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b2b7518-d0bb-4993-abb8-ac53aaba9825-cert\") pod \"ingress-canary-qjpvd\" (UID: \"1b2b7518-d0bb-4993-abb8-ac53aaba9825\") " pod="openshift-ingress-canary/ingress-canary-qjpvd" Jul 24 17:20:39.371491 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.371376 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/009f5e78-050b-4c16-8cb3-14dea0ea93ef-config-volume\") pod \"dns-default-qsn2t\" (UID: \"009f5e78-050b-4c16-8cb3-14dea0ea93ef\") " pod="openshift-dns/dns-default-qsn2t" Jul 24 17:20:39.371491 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.371419 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2ee78578-9e17-4d87-99bc-9eb4c154fcc7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nbhc9\" (UID: \"2ee78578-9e17-4d87-99bc-9eb4c154fcc7\") " pod="openshift-insights/insights-runtime-extractor-nbhc9" Jul 24 17:20:39.371491 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.371436 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2ee78578-9e17-4d87-99bc-9eb4c154fcc7-crio-socket\") pod \"insights-runtime-extractor-nbhc9\" (UID: \"2ee78578-9e17-4d87-99bc-9eb4c154fcc7\") " pod="openshift-insights/insights-runtime-extractor-nbhc9" Jul 24 17:20:39.371491 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.371454 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2ee78578-9e17-4d87-99bc-9eb4c154fcc7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nbhc9\" (UID: \"2ee78578-9e17-4d87-99bc-9eb4c154fcc7\") " pod="openshift-insights/insights-runtime-extractor-nbhc9" Jul 24 17:20:39.371727 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.371521 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/009f5e78-050b-4c16-8cb3-14dea0ea93ef-metrics-tls\") pod \"dns-default-qsn2t\" (UID: \"009f5e78-050b-4c16-8cb3-14dea0ea93ef\") " pod="openshift-dns/dns-default-qsn2t" Jul 24 17:20:39.371727 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.371551 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/009f5e78-050b-4c16-8cb3-14dea0ea93ef-tmp-dir\") pod \"dns-default-qsn2t\" (UID: \"009f5e78-050b-4c16-8cb3-14dea0ea93ef\") " pod="openshift-dns/dns-default-qsn2t" Jul 24 17:20:39.371727 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.371585 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5tkf\" (UniqueName: \"kubernetes.io/projected/009f5e78-050b-4c16-8cb3-14dea0ea93ef-kube-api-access-f5tkf\") pod \"dns-default-qsn2t\" (UID: \"009f5e78-050b-4c16-8cb3-14dea0ea93ef\") " pod="openshift-dns/dns-default-qsn2t" Jul 24 17:20:39.472989 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.472914 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/009f5e78-050b-4c16-8cb3-14dea0ea93ef-config-volume\") pod \"dns-default-qsn2t\" (UID: \"009f5e78-050b-4c16-8cb3-14dea0ea93ef\") " pod="openshift-dns/dns-default-qsn2t" Jul 24 17:20:39.472989 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.472968 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2ee78578-9e17-4d87-99bc-9eb4c154fcc7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nbhc9\" (UID: \"2ee78578-9e17-4d87-99bc-9eb4c154fcc7\") " pod="openshift-insights/insights-runtime-extractor-nbhc9" Jul 24 17:20:39.473192 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.472994 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2ee78578-9e17-4d87-99bc-9eb4c154fcc7-crio-socket\") pod \"insights-runtime-extractor-nbhc9\" (UID: \"2ee78578-9e17-4d87-99bc-9eb4c154fcc7\") " pod="openshift-insights/insights-runtime-extractor-nbhc9" Jul 24 17:20:39.473192 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.473018 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2ee78578-9e17-4d87-99bc-9eb4c154fcc7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nbhc9\" (UID: \"2ee78578-9e17-4d87-99bc-9eb4c154fcc7\") " pod="openshift-insights/insights-runtime-extractor-nbhc9" Jul 24 17:20:39.473192 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:39.473133 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 17:20:39.473192 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.473142 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/009f5e78-050b-4c16-8cb3-14dea0ea93ef-metrics-tls\") pod \"dns-default-qsn2t\" (UID: \"009f5e78-050b-4c16-8cb3-14dea0ea93ef\") " pod="openshift-dns/dns-default-qsn2t" Jul 24 17:20:39.473475 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:39.473196 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ee78578-9e17-4d87-99bc-9eb4c154fcc7-insights-runtime-extractor-tls podName:2ee78578-9e17-4d87-99bc-9eb4c154fcc7 nodeName:}" failed. No retries permitted until 2026-07-24 17:20:39.973177006 +0000 UTC m=+35.641588021 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2ee78578-9e17-4d87-99bc-9eb4c154fcc7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nbhc9" (UID: "2ee78578-9e17-4d87-99bc-9eb4c154fcc7") : secret "insights-runtime-extractor-tls" not found Jul 24 17:20:39.473475 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.473200 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/2ee78578-9e17-4d87-99bc-9eb4c154fcc7-crio-socket\") pod \"insights-runtime-extractor-nbhc9\" (UID: \"2ee78578-9e17-4d87-99bc-9eb4c154fcc7\") " pod="openshift-insights/insights-runtime-extractor-nbhc9" Jul 24 17:20:39.473475 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.473214 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/009f5e78-050b-4c16-8cb3-14dea0ea93ef-tmp-dir\") pod \"dns-default-qsn2t\" (UID: \"009f5e78-050b-4c16-8cb3-14dea0ea93ef\") " pod="openshift-dns/dns-default-qsn2t" Jul 24 17:20:39.473475 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:39.473254 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 17:20:39.473475 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:39.473303 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/009f5e78-050b-4c16-8cb3-14dea0ea93ef-metrics-tls podName:009f5e78-050b-4c16-8cb3-14dea0ea93ef nodeName:}" failed. No retries permitted until 2026-07-24 17:20:39.973288239 +0000 UTC m=+35.641699241 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/009f5e78-050b-4c16-8cb3-14dea0ea93ef-metrics-tls") pod "dns-default-qsn2t" (UID: "009f5e78-050b-4c16-8cb3-14dea0ea93ef") : secret "dns-default-metrics-tls" not found Jul 24 17:20:39.473475 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.473254 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5tkf\" (UniqueName: \"kubernetes.io/projected/009f5e78-050b-4c16-8cb3-14dea0ea93ef-kube-api-access-f5tkf\") pod \"dns-default-qsn2t\" (UID: \"009f5e78-050b-4c16-8cb3-14dea0ea93ef\") " pod="openshift-dns/dns-default-qsn2t" Jul 24 17:20:39.473475 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.473386 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ee78578-9e17-4d87-99bc-9eb4c154fcc7-data-volume\") pod \"insights-runtime-extractor-nbhc9\" (UID: \"2ee78578-9e17-4d87-99bc-9eb4c154fcc7\") " pod="openshift-insights/insights-runtime-extractor-nbhc9" Jul 24 17:20:39.473475 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.473405 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2z8h2\" (UniqueName: \"kubernetes.io/projected/2ee78578-9e17-4d87-99bc-9eb4c154fcc7-kube-api-access-2z8h2\") pod \"insights-runtime-extractor-nbhc9\" (UID: \"2ee78578-9e17-4d87-99bc-9eb4c154fcc7\") " pod="openshift-insights/insights-runtime-extractor-nbhc9" Jul 24 17:20:39.473475 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.473425 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-shkjv\" (UniqueName: \"kubernetes.io/projected/1b2b7518-d0bb-4993-abb8-ac53aaba9825-kube-api-access-shkjv\") pod \"ingress-canary-qjpvd\" (UID: \"1b2b7518-d0bb-4993-abb8-ac53aaba9825\") " pod="openshift-ingress-canary/ingress-canary-qjpvd" Jul 24 17:20:39.473475 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.473443 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b2b7518-d0bb-4993-abb8-ac53aaba9825-cert\") pod \"ingress-canary-qjpvd\" (UID: \"1b2b7518-d0bb-4993-abb8-ac53aaba9825\") " pod="openshift-ingress-canary/ingress-canary-qjpvd" Jul 24 17:20:39.473871 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.473492 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/009f5e78-050b-4c16-8cb3-14dea0ea93ef-tmp-dir\") pod \"dns-default-qsn2t\" (UID: \"009f5e78-050b-4c16-8cb3-14dea0ea93ef\") " pod="openshift-dns/dns-default-qsn2t" Jul 24 17:20:39.473871 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.473587 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/009f5e78-050b-4c16-8cb3-14dea0ea93ef-config-volume\") pod \"dns-default-qsn2t\" (UID: \"009f5e78-050b-4c16-8cb3-14dea0ea93ef\") " pod="openshift-dns/dns-default-qsn2t" Jul 24 17:20:39.473871 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.473620 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/2ee78578-9e17-4d87-99bc-9eb4c154fcc7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nbhc9\" (UID: \"2ee78578-9e17-4d87-99bc-9eb4c154fcc7\") " pod="openshift-insights/insights-runtime-extractor-nbhc9" Jul 24 17:20:39.473871 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.473653 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/2ee78578-9e17-4d87-99bc-9eb4c154fcc7-data-volume\") pod \"insights-runtime-extractor-nbhc9\" (UID: \"2ee78578-9e17-4d87-99bc-9eb4c154fcc7\") " pod="openshift-insights/insights-runtime-extractor-nbhc9" Jul 24 17:20:39.478258 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.478237 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1b2b7518-d0bb-4993-abb8-ac53aaba9825-cert\") pod \"ingress-canary-qjpvd\" (UID: \"1b2b7518-d0bb-4993-abb8-ac53aaba9825\") " pod="openshift-ingress-canary/ingress-canary-qjpvd" Jul 24 17:20:39.484763 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.484737 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-shkjv\" (UniqueName: \"kubernetes.io/projected/1b2b7518-d0bb-4993-abb8-ac53aaba9825-kube-api-access-shkjv\") pod \"ingress-canary-qjpvd\" (UID: \"1b2b7518-d0bb-4993-abb8-ac53aaba9825\") " pod="openshift-ingress-canary/ingress-canary-qjpvd" Jul 24 17:20:39.485118 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.485092 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2z8h2\" (UniqueName: \"kubernetes.io/projected/2ee78578-9e17-4d87-99bc-9eb4c154fcc7-kube-api-access-2z8h2\") pod \"insights-runtime-extractor-nbhc9\" (UID: \"2ee78578-9e17-4d87-99bc-9eb4c154fcc7\") " pod="openshift-insights/insights-runtime-extractor-nbhc9" Jul 24 17:20:39.485509 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.485490 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5tkf\" (UniqueName: \"kubernetes.io/projected/009f5e78-050b-4c16-8cb3-14dea0ea93ef-kube-api-access-f5tkf\") pod \"dns-default-qsn2t\" (UID: \"009f5e78-050b-4c16-8cb3-14dea0ea93ef\") " pod="openshift-dns/dns-default-qsn2t" Jul 24 17:20:39.521624 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.521600 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-qjpvd" Jul 24 17:20:39.907394 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.907364 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsllf" Jul 24 17:20:39.910622 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.910597 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 24 17:20:39.911573 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.911551 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 24 17:20:39.911573 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.911566 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8rjf6\"" Jul 24 17:20:39.978309 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.978282 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/009f5e78-050b-4c16-8cb3-14dea0ea93ef-metrics-tls\") pod \"dns-default-qsn2t\" (UID: \"009f5e78-050b-4c16-8cb3-14dea0ea93ef\") " pod="openshift-dns/dns-default-qsn2t" Jul 24 17:20:39.978453 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:39.978393 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2ee78578-9e17-4d87-99bc-9eb4c154fcc7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nbhc9\" (UID: \"2ee78578-9e17-4d87-99bc-9eb4c154fcc7\") " pod="openshift-insights/insights-runtime-extractor-nbhc9" Jul 24 17:20:39.978530 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:39.978461 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 17:20:39.978530 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:39.978498 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 17:20:39.978530 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:39.978530 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/009f5e78-050b-4c16-8cb3-14dea0ea93ef-metrics-tls podName:009f5e78-050b-4c16-8cb3-14dea0ea93ef nodeName:}" failed. No retries permitted until 2026-07-24 17:20:40.978510876 +0000 UTC m=+36.646921879 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/009f5e78-050b-4c16-8cb3-14dea0ea93ef-metrics-tls") pod "dns-default-qsn2t" (UID: "009f5e78-050b-4c16-8cb3-14dea0ea93ef") : secret "dns-default-metrics-tls" not found Jul 24 17:20:39.978692 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:39.978563 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ee78578-9e17-4d87-99bc-9eb4c154fcc7-insights-runtime-extractor-tls podName:2ee78578-9e17-4d87-99bc-9eb4c154fcc7 nodeName:}" failed. No retries permitted until 2026-07-24 17:20:40.97854683 +0000 UTC m=+36.646957841 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2ee78578-9e17-4d87-99bc-9eb4c154fcc7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nbhc9" (UID: "2ee78578-9e17-4d87-99bc-9eb4c154fcc7") : secret "insights-runtime-extractor-tls" not found Jul 24 17:20:40.131780 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:40.131634 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-qjpvd"] Jul 24 17:20:40.135178 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:40.135151 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b2b7518_d0bb_4993_abb8_ac53aaba9825.slice/crio-d5f80f4d7d6a67c41daf3fdea049004f5640d149a8f9703e2cf96a28d63843a7 WatchSource:0}: Error finding container d5f80f4d7d6a67c41daf3fdea049004f5640d149a8f9703e2cf96a28d63843a7: Status 404 returned error can't find the container with id d5f80f4d7d6a67c41daf3fdea049004f5640d149a8f9703e2cf96a28d63843a7 Jul 24 17:20:40.907718 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:40.907685 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7smjt" Jul 24 17:20:40.908322 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:40.907899 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njwgg" Jul 24 17:20:40.910689 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:40.910660 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jwvtx\"" Jul 24 17:20:40.910818 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:40.910660 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 17:20:40.910818 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:40.910670 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 17:20:40.986997 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:40.986972 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2ee78578-9e17-4d87-99bc-9eb4c154fcc7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nbhc9\" (UID: \"2ee78578-9e17-4d87-99bc-9eb4c154fcc7\") " pod="openshift-insights/insights-runtime-extractor-nbhc9" Jul 24 17:20:40.987115 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:40.987014 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/009f5e78-050b-4c16-8cb3-14dea0ea93ef-metrics-tls\") pod \"dns-default-qsn2t\" (UID: \"009f5e78-050b-4c16-8cb3-14dea0ea93ef\") " pod="openshift-dns/dns-default-qsn2t" Jul 24 17:20:40.987159 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:40.987119 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 17:20:40.987159 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:40.987129 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 17:20:40.987251 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:40.987179 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/009f5e78-050b-4c16-8cb3-14dea0ea93ef-metrics-tls podName:009f5e78-050b-4c16-8cb3-14dea0ea93ef nodeName:}" failed. No retries permitted until 2026-07-24 17:20:42.987162585 +0000 UTC m=+38.655573590 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/009f5e78-050b-4c16-8cb3-14dea0ea93ef-metrics-tls") pod "dns-default-qsn2t" (UID: "009f5e78-050b-4c16-8cb3-14dea0ea93ef") : secret "dns-default-metrics-tls" not found Jul 24 17:20:40.987251 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:40.987197 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ee78578-9e17-4d87-99bc-9eb4c154fcc7-insights-runtime-extractor-tls podName:2ee78578-9e17-4d87-99bc-9eb4c154fcc7 nodeName:}" failed. No retries permitted until 2026-07-24 17:20:42.98718784 +0000 UTC m=+38.655598847 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2ee78578-9e17-4d87-99bc-9eb4c154fcc7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nbhc9" (UID: "2ee78578-9e17-4d87-99bc-9eb4c154fcc7") : secret "insights-runtime-extractor-tls" not found Jul 24 17:20:41.091665 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:41.091634 2570 generic.go:356] "Generic (PLEG): container finished" podID="2335c195-a768-4809-a99c-621276a6fd6b" containerID="57e1e4b6411a9255ebdd25d2019ef316ca667450ce8df7a4b3b6cbbc0f598ef8" exitCode=0 Jul 24 17:20:41.091821 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:41.091726 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7z5ql" event={"ID":"2335c195-a768-4809-a99c-621276a6fd6b","Type":"ContainerDied","Data":"57e1e4b6411a9255ebdd25d2019ef316ca667450ce8df7a4b3b6cbbc0f598ef8"} Jul 24 17:20:41.093967 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:41.093942 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qjpvd" event={"ID":"1b2b7518-d0bb-4993-abb8-ac53aaba9825","Type":"ContainerStarted","Data":"d5f80f4d7d6a67c41daf3fdea049004f5640d149a8f9703e2cf96a28d63843a7"} Jul 24 17:20:41.754282 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:41.754251 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-xtlwj"] Jul 24 17:20:41.756665 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:41.756645 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-xtlwj" Jul 24 17:20:41.759869 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:41.759845 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 24 17:20:41.761091 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:41.761048 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 24 17:20:41.761178 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:41.761048 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-84qqt\"" Jul 24 17:20:41.767002 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:41.766982 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-xtlwj"] Jul 24 17:20:41.895271 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:41.895234 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx7bf\" (UniqueName: \"kubernetes.io/projected/71b354f3-6c11-4552-908a-29dee8a42c94-kube-api-access-xx7bf\") pod \"migrator-6865c9967-xtlwj\" (UID: \"71b354f3-6c11-4552-908a-29dee8a42c94\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-xtlwj" Jul 24 17:20:41.996621 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:41.996587 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx7bf\" (UniqueName: \"kubernetes.io/projected/71b354f3-6c11-4552-908a-29dee8a42c94-kube-api-access-xx7bf\") pod \"migrator-6865c9967-xtlwj\" (UID: \"71b354f3-6c11-4552-908a-29dee8a42c94\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-xtlwj" Jul 24 17:20:42.006557 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:42.006484 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx7bf\" (UniqueName: \"kubernetes.io/projected/71b354f3-6c11-4552-908a-29dee8a42c94-kube-api-access-xx7bf\") pod \"migrator-6865c9967-xtlwj\" (UID: \"71b354f3-6c11-4552-908a-29dee8a42c94\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-xtlwj" Jul 24 17:20:42.067141 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:42.067113 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-xtlwj" Jul 24 17:20:42.100084 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:42.100054 2570 generic.go:356] "Generic (PLEG): container finished" podID="2335c195-a768-4809-a99c-621276a6fd6b" containerID="f0970be9d69aa6d532eeff27f3b48e1e4d6c7789700d27eebb45bd030ffcaa6a" exitCode=0 Jul 24 17:20:42.100229 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:42.100120 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7z5ql" event={"ID":"2335c195-a768-4809-a99c-621276a6fd6b","Type":"ContainerDied","Data":"f0970be9d69aa6d532eeff27f3b48e1e4d6c7789700d27eebb45bd030ffcaa6a"} Jul 24 17:20:42.556582 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:42.556412 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-xtlwj"] Jul 24 17:20:42.563997 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:42.563975 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71b354f3_6c11_4552_908a_29dee8a42c94.slice/crio-07b58f11c3fdd83fb10ebca47d4f96b836c8af1d9dedd1e4b3537bd11a4b6551 WatchSource:0}: Error finding container 07b58f11c3fdd83fb10ebca47d4f96b836c8af1d9dedd1e4b3537bd11a4b6551: Status 404 returned error can't find the container with id 07b58f11c3fdd83fb10ebca47d4f96b836c8af1d9dedd1e4b3537bd11a4b6551 Jul 24 17:20:43.003904 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:43.003873 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2ee78578-9e17-4d87-99bc-9eb4c154fcc7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nbhc9\" (UID: \"2ee78578-9e17-4d87-99bc-9eb4c154fcc7\") " pod="openshift-insights/insights-runtime-extractor-nbhc9" Jul 24 17:20:43.004454 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:43.003914 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/009f5e78-050b-4c16-8cb3-14dea0ea93ef-metrics-tls\") pod \"dns-default-qsn2t\" (UID: \"009f5e78-050b-4c16-8cb3-14dea0ea93ef\") " pod="openshift-dns/dns-default-qsn2t" Jul 24 17:20:43.004454 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:43.004003 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 17:20:43.004454 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:43.004014 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 17:20:43.004454 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:43.004051 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/009f5e78-050b-4c16-8cb3-14dea0ea93ef-metrics-tls podName:009f5e78-050b-4c16-8cb3-14dea0ea93ef nodeName:}" failed. No retries permitted until 2026-07-24 17:20:47.004038291 +0000 UTC m=+42.672449294 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/009f5e78-050b-4c16-8cb3-14dea0ea93ef-metrics-tls") pod "dns-default-qsn2t" (UID: "009f5e78-050b-4c16-8cb3-14dea0ea93ef") : secret "dns-default-metrics-tls" not found Jul 24 17:20:43.004454 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:43.004070 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ee78578-9e17-4d87-99bc-9eb4c154fcc7-insights-runtime-extractor-tls podName:2ee78578-9e17-4d87-99bc-9eb4c154fcc7 nodeName:}" failed. No retries permitted until 2026-07-24 17:20:47.004057953 +0000 UTC m=+42.672468955 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2ee78578-9e17-4d87-99bc-9eb4c154fcc7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nbhc9" (UID: "2ee78578-9e17-4d87-99bc-9eb4c154fcc7") : secret "insights-runtime-extractor-tls" not found Jul 24 17:20:43.105513 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:43.105482 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7z5ql" event={"ID":"2335c195-a768-4809-a99c-621276a6fd6b","Type":"ContainerStarted","Data":"6812d288e3d6a10722beb57301e77acaa8f42f0b4c866c4a85baa3d57cd87847"} Jul 24 17:20:43.106902 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:43.106884 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-qjpvd" event={"ID":"1b2b7518-d0bb-4993-abb8-ac53aaba9825","Type":"ContainerStarted","Data":"0d7a8c520a1932bfbc080f3d9c0ed055d16bb892e5654a7ceb357800a9ccc0cb"} Jul 24 17:20:43.107934 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:43.107914 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-xtlwj" event={"ID":"71b354f3-6c11-4552-908a-29dee8a42c94","Type":"ContainerStarted","Data":"07b58f11c3fdd83fb10ebca47d4f96b836c8af1d9dedd1e4b3537bd11a4b6551"} Jul 24 17:20:43.131968 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:43.131918 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7z5ql" podStartSLOduration=9.78408529 podStartE2EDuration="39.131905547s" totalImagesPullingTime="29.347820257s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:20:04 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:20:43.130272631 +0000 UTC m=+38.798683665" watchObservedRunningTime="2026-07-24 17:20:43.131905547 +0000 UTC m=+38.800316571" Jul 24 17:20:43.151069 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:43.151036 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-qjpvd" podStartSLOduration=1.7117074140000001 podStartE2EDuration="4.151029548s" totalImagesPullingTime="2.439322134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:20:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:20:43.150201198 +0000 UTC m=+38.818612221" watchObservedRunningTime="2026-07-24 17:20:43.151029548 +0000 UTC m=+38.819440573" Jul 24 17:20:45.114777 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:45.114741 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-xtlwj" event={"ID":"71b354f3-6c11-4552-908a-29dee8a42c94","Type":"ContainerStarted","Data":"cdcb447f74302530a7568d35d445ef3d3f95987f383226dc6e30c2bd3fe1a51d"} Jul 24 17:20:45.115176 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:45.114791 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-xtlwj" event={"ID":"71b354f3-6c11-4552-908a-29dee8a42c94","Type":"ContainerStarted","Data":"a43b7a4885fed4ef19b5e464aa1277097b6b996a63b59031fc7b7e7260f1fbf6"} Jul 24 17:20:45.129939 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:45.129892 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-xtlwj" podStartSLOduration=2.170020317 podStartE2EDuration="4.129880401s" totalImagesPullingTime="1.959860084s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:20:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:20:45.129553951 +0000 UTC m=+40.797964974" watchObservedRunningTime="2026-07-24 17:20:45.129880401 +0000 UTC m=+40.798291403" Jul 24 17:20:47.026939 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:47.026911 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/009f5e78-050b-4c16-8cb3-14dea0ea93ef-metrics-tls\") pod \"dns-default-qsn2t\" (UID: \"009f5e78-050b-4c16-8cb3-14dea0ea93ef\") " pod="openshift-dns/dns-default-qsn2t" Jul 24 17:20:47.027308 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:47.026988 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2ee78578-9e17-4d87-99bc-9eb4c154fcc7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nbhc9\" (UID: \"2ee78578-9e17-4d87-99bc-9eb4c154fcc7\") " pod="openshift-insights/insights-runtime-extractor-nbhc9" Jul 24 17:20:47.027308 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:47.027046 2570 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 24 17:20:47.027308 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:47.027070 2570 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 24 17:20:47.027308 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:47.027103 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/009f5e78-050b-4c16-8cb3-14dea0ea93ef-metrics-tls podName:009f5e78-050b-4c16-8cb3-14dea0ea93ef nodeName:}" failed. No retries permitted until 2026-07-24 17:20:55.027087494 +0000 UTC m=+50.695498496 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/009f5e78-050b-4c16-8cb3-14dea0ea93ef-metrics-tls") pod "dns-default-qsn2t" (UID: "009f5e78-050b-4c16-8cb3-14dea0ea93ef") : secret "dns-default-metrics-tls" not found Jul 24 17:20:47.027308 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:20:47.027117 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2ee78578-9e17-4d87-99bc-9eb4c154fcc7-insights-runtime-extractor-tls podName:2ee78578-9e17-4d87-99bc-9eb4c154fcc7 nodeName:}" failed. No retries permitted until 2026-07-24 17:20:55.027110828 +0000 UTC m=+50.695521830 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/2ee78578-9e17-4d87-99bc-9eb4c154fcc7-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nbhc9" (UID: "2ee78578-9e17-4d87-99bc-9eb4c154fcc7") : secret "insights-runtime-extractor-tls" not found Jul 24 17:20:55.084977 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:55.084942 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2ee78578-9e17-4d87-99bc-9eb4c154fcc7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nbhc9\" (UID: \"2ee78578-9e17-4d87-99bc-9eb4c154fcc7\") " pod="openshift-insights/insights-runtime-extractor-nbhc9" Jul 24 17:20:55.085439 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:55.084985 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/009f5e78-050b-4c16-8cb3-14dea0ea93ef-metrics-tls\") pod \"dns-default-qsn2t\" (UID: \"009f5e78-050b-4c16-8cb3-14dea0ea93ef\") " pod="openshift-dns/dns-default-qsn2t" Jul 24 17:20:55.088341 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:55.088298 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/009f5e78-050b-4c16-8cb3-14dea0ea93ef-metrics-tls\") pod \"dns-default-qsn2t\" (UID: \"009f5e78-050b-4c16-8cb3-14dea0ea93ef\") " pod="openshift-dns/dns-default-qsn2t" Jul 24 17:20:55.088448 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:55.088299 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/2ee78578-9e17-4d87-99bc-9eb4c154fcc7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nbhc9\" (UID: \"2ee78578-9e17-4d87-99bc-9eb4c154fcc7\") " pod="openshift-insights/insights-runtime-extractor-nbhc9" Jul 24 17:20:55.113839 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:55.113820 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qsn2t" Jul 24 17:20:55.152124 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:55.152104 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nbhc9" Jul 24 17:20:55.274543 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:55.274467 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qsn2t"] Jul 24 17:20:55.278855 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:55.278829 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod009f5e78_050b_4c16_8cb3_14dea0ea93ef.slice/crio-bc252e714c5241d5d5046f43b49b46206f1d149efa14bd84de3f176a7b6022e4 WatchSource:0}: Error finding container bc252e714c5241d5d5046f43b49b46206f1d149efa14bd84de3f176a7b6022e4: Status 404 returned error can't find the container with id bc252e714c5241d5d5046f43b49b46206f1d149efa14bd84de3f176a7b6022e4 Jul 24 17:20:55.313071 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:55.313047 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nbhc9"] Jul 24 17:20:55.315536 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:20:55.315512 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ee78578_9e17_4d87_99bc_9eb4c154fcc7.slice/crio-15ffd3734ceaab40b3725d4ed0a3c034c51b7b28306b0977a3ed94197007f5ca WatchSource:0}: Error finding container 15ffd3734ceaab40b3725d4ed0a3c034c51b7b28306b0977a3ed94197007f5ca: Status 404 returned error can't find the container with id 15ffd3734ceaab40b3725d4ed0a3c034c51b7b28306b0977a3ed94197007f5ca Jul 24 17:20:56.142719 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:56.142679 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nbhc9" event={"ID":"2ee78578-9e17-4d87-99bc-9eb4c154fcc7","Type":"ContainerStarted","Data":"15ffd3734ceaab40b3725d4ed0a3c034c51b7b28306b0977a3ed94197007f5ca"} Jul 24 17:20:56.144208 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:56.144145 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qsn2t" event={"ID":"009f5e78-050b-4c16-8cb3-14dea0ea93ef","Type":"ContainerStarted","Data":"bc252e714c5241d5d5046f43b49b46206f1d149efa14bd84de3f176a7b6022e4"} Jul 24 17:20:58.151709 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:58.151678 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qsn2t" event={"ID":"009f5e78-050b-4c16-8cb3-14dea0ea93ef","Type":"ContainerStarted","Data":"386601edec1fc9999e553ae5a1a0a26fcc7e4be5206ee81ab30bc4d6d963f55e"} Jul 24 17:20:58.152085 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:58.151726 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qsn2t" event={"ID":"009f5e78-050b-4c16-8cb3-14dea0ea93ef","Type":"ContainerStarted","Data":"942da3131fb45ca4b90a9011bd1151996c28d631381093172a9b144df66a33bf"} Jul 24 17:20:58.152085 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:58.151828 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qsn2t" Jul 24 17:20:58.171060 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:20:58.171016 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qsn2t" podStartSLOduration=16.689782616 podStartE2EDuration="19.171003243s" totalImagesPullingTime="2.481220627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:20:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:20:58.170771762 +0000 UTC m=+53.839182787" watchObservedRunningTime="2026-07-24 17:20:58.171003243 +0000 UTC m=+53.839414245" Jul 24 17:21:01.169077 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:01.168963 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nbhc9" event={"ID":"2ee78578-9e17-4d87-99bc-9eb4c154fcc7","Type":"ContainerStarted","Data":"8fa0635f59c2e2fced24f7be4ff198aee1c72c98707a213f695fbb3ef0947b87"} Jul 24 17:21:04.080198 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.080168 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-v6pz6" Jul 24 17:21:04.636694 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.636660 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-cjfxb"] Jul 24 17:21:04.653542 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.653520 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c4497f88-qstkg"] Jul 24 17:21:04.653673 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.653658 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-cjfxb" Jul 24 17:21:04.659466 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.659439 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-cvkl2\"" Jul 24 17:21:04.667163 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.667147 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c4497f88-qstkg" Jul 24 17:21:04.671916 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.671892 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 24 17:21:04.672508 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.672490 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 24 17:21:04.672858 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.672842 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 24 17:21:04.673068 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.673054 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-xvxsh\"" Jul 24 17:21:04.673151 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.673134 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 24 17:21:04.683138 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.683098 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-cjfxb"] Jul 24 17:21:04.683965 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.683946 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c4497f88-qstkg"] Jul 24 17:21:04.746595 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.746564 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cszt2"] Jul 24 17:21:04.760637 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.760605 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjt8z\" (UniqueName: \"kubernetes.io/projected/b7a53a76-3c77-44cd-a7bc-7b40b4587ec9-kube-api-access-wjt8z\") pod \"managed-serviceaccount-addon-agent-65c4497f88-qstkg\" (UID: \"b7a53a76-3c77-44cd-a7bc-7b40b4587ec9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c4497f88-qstkg" Jul 24 17:21:04.760802 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.760727 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhqvz\" (UniqueName: \"kubernetes.io/projected/0bbd2a5a-a58b-45ac-9a87-15349af57712-kube-api-access-nhqvz\") pod \"network-check-source-7d88cb55d8-cjfxb\" (UID: \"0bbd2a5a-a58b-45ac-9a87-15349af57712\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-cjfxb" Jul 24 17:21:04.760802 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.760776 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b7a53a76-3c77-44cd-a7bc-7b40b4587ec9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-65c4497f88-qstkg\" (UID: \"b7a53a76-3c77-44cd-a7bc-7b40b4587ec9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c4497f88-qstkg" Jul 24 17:21:04.771180 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.771025 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-bl5xg"] Jul 24 17:21:04.771678 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.771654 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cszt2" Jul 24 17:21:04.774678 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.774656 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-9r8lz\"" Jul 24 17:21:04.774798 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.774688 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 24 17:21:04.791828 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.791811 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-69489f8bf8-tmxrk"] Jul 24 17:21:04.792254 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.792231 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-bl5xg" Jul 24 17:21:04.795124 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.795104 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 24 17:21:04.795124 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.795115 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-6v4vs\"" Jul 24 17:21:04.795381 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.795364 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 24 17:21:04.813732 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.813713 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cszt2"] Jul 24 17:21:04.813841 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.813745 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-bl5xg"] Jul 24 17:21:04.813841 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.813760 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69489f8bf8-tmxrk"] Jul 24 17:21:04.813841 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.813825 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69489f8bf8-tmxrk" Jul 24 17:21:04.817465 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.817447 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 24 17:21:04.817765 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.817751 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 24 17:21:04.817857 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.817794 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 24 17:21:04.817921 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.817872 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-mqsds\"" Jul 24 17:21:04.824300 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.824283 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 24 17:21:04.861035 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.861003 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d7dbcd57-7669-4990-81f5-bfe66052ac67-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-cszt2\" (UID: \"d7dbcd57-7669-4990-81f5-bfe66052ac67\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cszt2" Jul 24 17:21:04.861161 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.861041 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-khpl5\" (UniqueName: \"kubernetes.io/projected/017adad1-4a9a-4d09-8c33-4f612c9cbd5b-kube-api-access-khpl5\") pod \"image-registry-69489f8bf8-tmxrk\" (UID: \"017adad1-4a9a-4d09-8c33-4f612c9cbd5b\") " pod="openshift-image-registry/image-registry-69489f8bf8-tmxrk" Jul 24 17:21:04.861161 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.861096 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/017adad1-4a9a-4d09-8c33-4f612c9cbd5b-installation-pull-secrets\") pod \"image-registry-69489f8bf8-tmxrk\" (UID: \"017adad1-4a9a-4d09-8c33-4f612c9cbd5b\") " pod="openshift-image-registry/image-registry-69489f8bf8-tmxrk" Jul 24 17:21:04.861161 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.861121 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/017adad1-4a9a-4d09-8c33-4f612c9cbd5b-bound-sa-token\") pod \"image-registry-69489f8bf8-tmxrk\" (UID: \"017adad1-4a9a-4d09-8c33-4f612c9cbd5b\") " pod="openshift-image-registry/image-registry-69489f8bf8-tmxrk" Jul 24 17:21:04.861324 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.861165 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b7a53a76-3c77-44cd-a7bc-7b40b4587ec9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-65c4497f88-qstkg\" (UID: \"b7a53a76-3c77-44cd-a7bc-7b40b4587ec9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c4497f88-qstkg" Jul 24 17:21:04.861324 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.861193 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjt8z\" (UniqueName: \"kubernetes.io/projected/b7a53a76-3c77-44cd-a7bc-7b40b4587ec9-kube-api-access-wjt8z\") pod \"managed-serviceaccount-addon-agent-65c4497f88-qstkg\" (UID: \"b7a53a76-3c77-44cd-a7bc-7b40b4587ec9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c4497f88-qstkg" Jul 24 17:21:04.861324 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.861217 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/017adad1-4a9a-4d09-8c33-4f612c9cbd5b-image-registry-private-configuration\") pod \"image-registry-69489f8bf8-tmxrk\" (UID: \"017adad1-4a9a-4d09-8c33-4f612c9cbd5b\") " pod="openshift-image-registry/image-registry-69489f8bf8-tmxrk" Jul 24 17:21:04.861324 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.861245 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/017adad1-4a9a-4d09-8c33-4f612c9cbd5b-registry-certificates\") pod \"image-registry-69489f8bf8-tmxrk\" (UID: \"017adad1-4a9a-4d09-8c33-4f612c9cbd5b\") " pod="openshift-image-registry/image-registry-69489f8bf8-tmxrk" Jul 24 17:21:04.861324 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.861276 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7m28\" (UniqueName: \"kubernetes.io/projected/078115f0-2fb4-4cc2-89a0-74c58e7d79fa-kube-api-access-g7m28\") pod \"downloads-7c97dc4555-bl5xg\" (UID: \"078115f0-2fb4-4cc2-89a0-74c58e7d79fa\") " pod="openshift-console/downloads-7c97dc4555-bl5xg" Jul 24 17:21:04.861324 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.861299 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/017adad1-4a9a-4d09-8c33-4f612c9cbd5b-ca-trust-extracted\") pod \"image-registry-69489f8bf8-tmxrk\" (UID: \"017adad1-4a9a-4d09-8c33-4f612c9cbd5b\") " pod="openshift-image-registry/image-registry-69489f8bf8-tmxrk" Jul 24 17:21:04.861641 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.861448 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/017adad1-4a9a-4d09-8c33-4f612c9cbd5b-registry-tls\") pod \"image-registry-69489f8bf8-tmxrk\" (UID: \"017adad1-4a9a-4d09-8c33-4f612c9cbd5b\") " pod="openshift-image-registry/image-registry-69489f8bf8-tmxrk" Jul 24 17:21:04.861641 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.861485 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/017adad1-4a9a-4d09-8c33-4f612c9cbd5b-trusted-ca\") pod \"image-registry-69489f8bf8-tmxrk\" (UID: \"017adad1-4a9a-4d09-8c33-4f612c9cbd5b\") " pod="openshift-image-registry/image-registry-69489f8bf8-tmxrk" Jul 24 17:21:04.861641 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.861514 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhqvz\" (UniqueName: \"kubernetes.io/projected/0bbd2a5a-a58b-45ac-9a87-15349af57712-kube-api-access-nhqvz\") pod \"network-check-source-7d88cb55d8-cjfxb\" (UID: \"0bbd2a5a-a58b-45ac-9a87-15349af57712\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-cjfxb" Jul 24 17:21:04.864909 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.864885 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jul 24 17:21:04.875090 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.875065 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b7a53a76-3c77-44cd-a7bc-7b40b4587ec9-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-65c4497f88-qstkg\" (UID: \"b7a53a76-3c77-44cd-a7bc-7b40b4587ec9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c4497f88-qstkg" Jul 24 17:21:04.878288 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.878270 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 24 17:21:04.878565 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.878549 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 24 17:21:04.889454 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.889391 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 24 17:21:04.889454 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.889424 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 24 17:21:04.899504 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.899486 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjt8z\" (UniqueName: \"kubernetes.io/projected/b7a53a76-3c77-44cd-a7bc-7b40b4587ec9-kube-api-access-wjt8z\") pod \"managed-serviceaccount-addon-agent-65c4497f88-qstkg\" (UID: \"b7a53a76-3c77-44cd-a7bc-7b40b4587ec9\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c4497f88-qstkg" Jul 24 17:21:04.899655 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.899636 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhqvz\" (UniqueName: \"kubernetes.io/projected/0bbd2a5a-a58b-45ac-9a87-15349af57712-kube-api-access-nhqvz\") pod \"network-check-source-7d88cb55d8-cjfxb\" (UID: \"0bbd2a5a-a58b-45ac-9a87-15349af57712\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-cjfxb" Jul 24 17:21:04.962245 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.962208 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/017adad1-4a9a-4d09-8c33-4f612c9cbd5b-registry-certificates\") pod \"image-registry-69489f8bf8-tmxrk\" (UID: \"017adad1-4a9a-4d09-8c33-4f612c9cbd5b\") " pod="openshift-image-registry/image-registry-69489f8bf8-tmxrk" Jul 24 17:21:04.962379 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.962252 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7m28\" (UniqueName: \"kubernetes.io/projected/078115f0-2fb4-4cc2-89a0-74c58e7d79fa-kube-api-access-g7m28\") pod \"downloads-7c97dc4555-bl5xg\" (UID: \"078115f0-2fb4-4cc2-89a0-74c58e7d79fa\") " pod="openshift-console/downloads-7c97dc4555-bl5xg" Jul 24 17:21:04.962379 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.962278 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/017adad1-4a9a-4d09-8c33-4f612c9cbd5b-ca-trust-extracted\") pod \"image-registry-69489f8bf8-tmxrk\" (UID: \"017adad1-4a9a-4d09-8c33-4f612c9cbd5b\") " pod="openshift-image-registry/image-registry-69489f8bf8-tmxrk" Jul 24 17:21:04.962502 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.962383 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/017adad1-4a9a-4d09-8c33-4f612c9cbd5b-registry-tls\") pod \"image-registry-69489f8bf8-tmxrk\" (UID: \"017adad1-4a9a-4d09-8c33-4f612c9cbd5b\") " pod="openshift-image-registry/image-registry-69489f8bf8-tmxrk" Jul 24 17:21:04.962502 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.962407 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/017adad1-4a9a-4d09-8c33-4f612c9cbd5b-trusted-ca\") pod \"image-registry-69489f8bf8-tmxrk\" (UID: \"017adad1-4a9a-4d09-8c33-4f612c9cbd5b\") " pod="openshift-image-registry/image-registry-69489f8bf8-tmxrk" Jul 24 17:21:04.962502 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.962435 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d7dbcd57-7669-4990-81f5-bfe66052ac67-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-cszt2\" (UID: \"d7dbcd57-7669-4990-81f5-bfe66052ac67\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cszt2" Jul 24 17:21:04.962502 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.962459 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-khpl5\" (UniqueName: \"kubernetes.io/projected/017adad1-4a9a-4d09-8c33-4f612c9cbd5b-kube-api-access-khpl5\") pod \"image-registry-69489f8bf8-tmxrk\" (UID: \"017adad1-4a9a-4d09-8c33-4f612c9cbd5b\") " pod="openshift-image-registry/image-registry-69489f8bf8-tmxrk" Jul 24 17:21:04.962502 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.962493 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/017adad1-4a9a-4d09-8c33-4f612c9cbd5b-installation-pull-secrets\") pod \"image-registry-69489f8bf8-tmxrk\" (UID: \"017adad1-4a9a-4d09-8c33-4f612c9cbd5b\") " pod="openshift-image-registry/image-registry-69489f8bf8-tmxrk" Jul 24 17:21:04.962732 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.962537 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/017adad1-4a9a-4d09-8c33-4f612c9cbd5b-bound-sa-token\") pod \"image-registry-69489f8bf8-tmxrk\" (UID: \"017adad1-4a9a-4d09-8c33-4f612c9cbd5b\") " pod="openshift-image-registry/image-registry-69489f8bf8-tmxrk" Jul 24 17:21:04.962732 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.962583 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/017adad1-4a9a-4d09-8c33-4f612c9cbd5b-image-registry-private-configuration\") pod \"image-registry-69489f8bf8-tmxrk\" (UID: \"017adad1-4a9a-4d09-8c33-4f612c9cbd5b\") " pod="openshift-image-registry/image-registry-69489f8bf8-tmxrk" Jul 24 17:21:04.962831 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.962795 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/017adad1-4a9a-4d09-8c33-4f612c9cbd5b-ca-trust-extracted\") pod \"image-registry-69489f8bf8-tmxrk\" (UID: \"017adad1-4a9a-4d09-8c33-4f612c9cbd5b\") " pod="openshift-image-registry/image-registry-69489f8bf8-tmxrk" Jul 24 17:21:04.970061 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.965085 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/017adad1-4a9a-4d09-8c33-4f612c9cbd5b-registry-certificates\") pod \"image-registry-69489f8bf8-tmxrk\" (UID: \"017adad1-4a9a-4d09-8c33-4f612c9cbd5b\") " pod="openshift-image-registry/image-registry-69489f8bf8-tmxrk" Jul 24 17:21:04.970061 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.965714 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/017adad1-4a9a-4d09-8c33-4f612c9cbd5b-image-registry-private-configuration\") pod \"image-registry-69489f8bf8-tmxrk\" (UID: \"017adad1-4a9a-4d09-8c33-4f612c9cbd5b\") " pod="openshift-image-registry/image-registry-69489f8bf8-tmxrk" Jul 24 17:21:04.970061 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.965804 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/017adad1-4a9a-4d09-8c33-4f612c9cbd5b-trusted-ca\") pod \"image-registry-69489f8bf8-tmxrk\" (UID: \"017adad1-4a9a-4d09-8c33-4f612c9cbd5b\") " pod="openshift-image-registry/image-registry-69489f8bf8-tmxrk" Jul 24 17:21:04.970061 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.966943 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-cvkl2\"" Jul 24 17:21:04.970061 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.968060 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/017adad1-4a9a-4d09-8c33-4f612c9cbd5b-installation-pull-secrets\") pod \"image-registry-69489f8bf8-tmxrk\" (UID: \"017adad1-4a9a-4d09-8c33-4f612c9cbd5b\") " pod="openshift-image-registry/image-registry-69489f8bf8-tmxrk" Jul 24 17:21:04.970061 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.968619 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/017adad1-4a9a-4d09-8c33-4f612c9cbd5b-registry-tls\") pod \"image-registry-69489f8bf8-tmxrk\" (UID: \"017adad1-4a9a-4d09-8c33-4f612c9cbd5b\") " pod="openshift-image-registry/image-registry-69489f8bf8-tmxrk" Jul 24 17:21:04.972047 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.972017 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/d7dbcd57-7669-4990-81f5-bfe66052ac67-tls-certificates\") pod \"prometheus-operator-admission-webhook-7f8d78f54b-cszt2\" (UID: \"d7dbcd57-7669-4990-81f5-bfe66052ac67\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cszt2" Jul 24 17:21:04.972150 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.972085 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-cjfxb" Jul 24 17:21:04.983409 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.983379 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7m28\" (UniqueName: \"kubernetes.io/projected/078115f0-2fb4-4cc2-89a0-74c58e7d79fa-kube-api-access-g7m28\") pod \"downloads-7c97dc4555-bl5xg\" (UID: \"078115f0-2fb4-4cc2-89a0-74c58e7d79fa\") " pod="openshift-console/downloads-7c97dc4555-bl5xg" Jul 24 17:21:04.987669 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.987641 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/017adad1-4a9a-4d09-8c33-4f612c9cbd5b-bound-sa-token\") pod \"image-registry-69489f8bf8-tmxrk\" (UID: \"017adad1-4a9a-4d09-8c33-4f612c9cbd5b\") " pod="openshift-image-registry/image-registry-69489f8bf8-tmxrk" Jul 24 17:21:04.990420 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.990397 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 24 17:21:04.992756 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:04.992735 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-khpl5\" (UniqueName: \"kubernetes.io/projected/017adad1-4a9a-4d09-8c33-4f612c9cbd5b-kube-api-access-khpl5\") pod \"image-registry-69489f8bf8-tmxrk\" (UID: \"017adad1-4a9a-4d09-8c33-4f612c9cbd5b\") " pod="openshift-image-registry/image-registry-69489f8bf8-tmxrk" Jul 24 17:21:05.007586 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:05.007556 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-xvxsh\"" Jul 24 17:21:05.008576 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:05.008559 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c4497f88-qstkg" Jul 24 17:21:05.085686 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:05.085303 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cszt2" Jul 24 17:21:05.101913 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:05.101868 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-bl5xg" Jul 24 17:21:05.124636 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:05.124544 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-69489f8bf8-tmxrk" Jul 24 17:21:05.146546 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:05.146488 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-cjfxb"] Jul 24 17:21:05.153407 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:21:05.153374 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bbd2a5a_a58b_45ac_9a87_15349af57712.slice/crio-f3b8771749c7afd48696deed5a676ced245ce9a670bb423202e7422cf407ec24 WatchSource:0}: Error finding container f3b8771749c7afd48696deed5a676ced245ce9a670bb423202e7422cf407ec24: Status 404 returned error can't find the container with id f3b8771749c7afd48696deed5a676ced245ce9a670bb423202e7422cf407ec24 Jul 24 17:21:05.187273 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:05.187241 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nbhc9" event={"ID":"2ee78578-9e17-4d87-99bc-9eb4c154fcc7","Type":"ContainerStarted","Data":"7e4849236715d84c8fb8afa0d49dc68cdb1136d9076bd477142db4181ae65e9e"} Jul 24 17:21:05.192260 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:05.192130 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c4497f88-qstkg"] Jul 24 17:21:05.192582 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:05.192527 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-cjfxb" event={"ID":"0bbd2a5a-a58b-45ac-9a87-15349af57712","Type":"ContainerStarted","Data":"f3b8771749c7afd48696deed5a676ced245ce9a670bb423202e7422cf407ec24"} Jul 24 17:21:05.295064 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:05.294961 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cszt2"] Jul 24 17:21:05.302435 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:21:05.302410 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7dbcd57_7669_4990_81f5_bfe66052ac67.slice/crio-d8519d154595ad016b866ad0521837b9f8083d27eb6f68c8d32ee581d9f036f6 WatchSource:0}: Error finding container d8519d154595ad016b866ad0521837b9f8083d27eb6f68c8d32ee581d9f036f6: Status 404 returned error can't find the container with id d8519d154595ad016b866ad0521837b9f8083d27eb6f68c8d32ee581d9f036f6 Jul 24 17:21:05.315888 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:05.315866 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-bl5xg"] Jul 24 17:21:05.318776 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:21:05.318748 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod078115f0_2fb4_4cc2_89a0_74c58e7d79fa.slice/crio-3c9900a6c339cb06d2e66aa485ad0716d4b82865a8b17381ca99b77b5c7afe49 WatchSource:0}: Error finding container 3c9900a6c339cb06d2e66aa485ad0716d4b82865a8b17381ca99b77b5c7afe49: Status 404 returned error can't find the container with id 3c9900a6c339cb06d2e66aa485ad0716d4b82865a8b17381ca99b77b5c7afe49 Jul 24 17:21:05.365447 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:05.365420 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-69489f8bf8-tmxrk"] Jul 24 17:21:05.368687 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:21:05.368660 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod017adad1_4a9a_4d09_8c33_4f612c9cbd5b.slice/crio-7cae79036c0f737388eef5f84ee21737e772686871f6d3fc4744e8892a8d562f WatchSource:0}: Error finding container 7cae79036c0f737388eef5f84ee21737e772686871f6d3fc4744e8892a8d562f: Status 404 returned error can't find the container with id 7cae79036c0f737388eef5f84ee21737e772686871f6d3fc4744e8892a8d562f Jul 24 17:21:06.203530 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:06.203435 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cszt2" event={"ID":"d7dbcd57-7669-4990-81f5-bfe66052ac67","Type":"ContainerStarted","Data":"d8519d154595ad016b866ad0521837b9f8083d27eb6f68c8d32ee581d9f036f6"} Jul 24 17:21:06.206984 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:06.206209 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69489f8bf8-tmxrk" event={"ID":"017adad1-4a9a-4d09-8c33-4f612c9cbd5b","Type":"ContainerStarted","Data":"479fb56c5592a2c67f89a207225c08920b763293fdcd57349409cad0950d14b9"} Jul 24 17:21:06.206984 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:06.206260 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-69489f8bf8-tmxrk" event={"ID":"017adad1-4a9a-4d09-8c33-4f612c9cbd5b","Type":"ContainerStarted","Data":"7cae79036c0f737388eef5f84ee21737e772686871f6d3fc4744e8892a8d562f"} Jul 24 17:21:06.206984 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:06.206932 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-69489f8bf8-tmxrk" Jul 24 17:21:06.208933 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:06.208853 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-bl5xg" event={"ID":"078115f0-2fb4-4cc2-89a0-74c58e7d79fa","Type":"ContainerStarted","Data":"3c9900a6c339cb06d2e66aa485ad0716d4b82865a8b17381ca99b77b5c7afe49"} Jul 24 17:21:06.219762 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:06.219710 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c4497f88-qstkg" event={"ID":"b7a53a76-3c77-44cd-a7bc-7b40b4587ec9","Type":"ContainerStarted","Data":"64f109f7375410671fa61010e299d67da10b960014aaf26d4e86e1aad120a3e0"} Jul 24 17:21:06.231423 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:06.230455 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-69489f8bf8-tmxrk" podStartSLOduration=2.230438747 podStartE2EDuration="2.230438747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:21:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:21:06.229722401 +0000 UTC m=+61.898133450" watchObservedRunningTime="2026-07-24 17:21:06.230438747 +0000 UTC m=+61.898849774" Jul 24 17:21:07.107913 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:07.107878 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7654f97c47-td8x8"] Jul 24 17:21:07.111097 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:07.111073 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7654f97c47-td8x8" Jul 24 17:21:07.114935 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:07.114540 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 24 17:21:07.118894 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:07.117586 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 24 17:21:07.118894 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:07.117830 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-c9fdb\"" Jul 24 17:21:07.118894 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:07.118069 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 24 17:21:07.118894 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:07.118270 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 24 17:21:07.118894 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:07.118496 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 24 17:21:07.122932 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:07.122913 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7654f97c47-td8x8"] Jul 24 17:21:07.183169 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:07.182785 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c1d69734-b0b9-4ef3-bc8e-b423be5cea80-console-config\") pod \"console-7654f97c47-td8x8\" (UID: \"c1d69734-b0b9-4ef3-bc8e-b423be5cea80\") " pod="openshift-console/console-7654f97c47-td8x8" Jul 24 17:21:07.183169 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:07.182860 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c1d69734-b0b9-4ef3-bc8e-b423be5cea80-console-serving-cert\") pod \"console-7654f97c47-td8x8\" (UID: \"c1d69734-b0b9-4ef3-bc8e-b423be5cea80\") " pod="openshift-console/console-7654f97c47-td8x8" Jul 24 17:21:07.183169 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:07.182890 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c1d69734-b0b9-4ef3-bc8e-b423be5cea80-console-oauth-config\") pod \"console-7654f97c47-td8x8\" (UID: \"c1d69734-b0b9-4ef3-bc8e-b423be5cea80\") " pod="openshift-console/console-7654f97c47-td8x8" Jul 24 17:21:07.183169 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:07.182951 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txqvz\" (UniqueName: \"kubernetes.io/projected/c1d69734-b0b9-4ef3-bc8e-b423be5cea80-kube-api-access-txqvz\") pod \"console-7654f97c47-td8x8\" (UID: \"c1d69734-b0b9-4ef3-bc8e-b423be5cea80\") " pod="openshift-console/console-7654f97c47-td8x8" Jul 24 17:21:07.183169 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:07.182992 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c1d69734-b0b9-4ef3-bc8e-b423be5cea80-oauth-serving-cert\") pod \"console-7654f97c47-td8x8\" (UID: \"c1d69734-b0b9-4ef3-bc8e-b423be5cea80\") " pod="openshift-console/console-7654f97c47-td8x8" Jul 24 17:21:07.183169 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:07.183020 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c1d69734-b0b9-4ef3-bc8e-b423be5cea80-service-ca\") pod \"console-7654f97c47-td8x8\" (UID: \"c1d69734-b0b9-4ef3-bc8e-b423be5cea80\") " pod="openshift-console/console-7654f97c47-td8x8" Jul 24 17:21:07.287076 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:07.283672 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txqvz\" (UniqueName: \"kubernetes.io/projected/c1d69734-b0b9-4ef3-bc8e-b423be5cea80-kube-api-access-txqvz\") pod \"console-7654f97c47-td8x8\" (UID: \"c1d69734-b0b9-4ef3-bc8e-b423be5cea80\") " pod="openshift-console/console-7654f97c47-td8x8" Jul 24 17:21:07.287076 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:07.283734 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c1d69734-b0b9-4ef3-bc8e-b423be5cea80-oauth-serving-cert\") pod \"console-7654f97c47-td8x8\" (UID: \"c1d69734-b0b9-4ef3-bc8e-b423be5cea80\") " pod="openshift-console/console-7654f97c47-td8x8" Jul 24 17:21:07.287076 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:07.283761 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c1d69734-b0b9-4ef3-bc8e-b423be5cea80-service-ca\") pod \"console-7654f97c47-td8x8\" (UID: \"c1d69734-b0b9-4ef3-bc8e-b423be5cea80\") " pod="openshift-console/console-7654f97c47-td8x8" Jul 24 17:21:07.287076 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:07.283824 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c1d69734-b0b9-4ef3-bc8e-b423be5cea80-console-config\") pod \"console-7654f97c47-td8x8\" (UID: \"c1d69734-b0b9-4ef3-bc8e-b423be5cea80\") " pod="openshift-console/console-7654f97c47-td8x8" Jul 24 17:21:07.287076 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:07.283896 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c1d69734-b0b9-4ef3-bc8e-b423be5cea80-console-serving-cert\") pod \"console-7654f97c47-td8x8\" (UID: \"c1d69734-b0b9-4ef3-bc8e-b423be5cea80\") " pod="openshift-console/console-7654f97c47-td8x8" Jul 24 17:21:07.287076 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:07.283923 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c1d69734-b0b9-4ef3-bc8e-b423be5cea80-console-oauth-config\") pod \"console-7654f97c47-td8x8\" (UID: \"c1d69734-b0b9-4ef3-bc8e-b423be5cea80\") " pod="openshift-console/console-7654f97c47-td8x8" Jul 24 17:21:07.287076 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:07.285213 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c1d69734-b0b9-4ef3-bc8e-b423be5cea80-oauth-serving-cert\") pod \"console-7654f97c47-td8x8\" (UID: \"c1d69734-b0b9-4ef3-bc8e-b423be5cea80\") " pod="openshift-console/console-7654f97c47-td8x8" Jul 24 17:21:07.287076 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:07.285798 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c1d69734-b0b9-4ef3-bc8e-b423be5cea80-service-ca\") pod \"console-7654f97c47-td8x8\" (UID: \"c1d69734-b0b9-4ef3-bc8e-b423be5cea80\") " pod="openshift-console/console-7654f97c47-td8x8" Jul 24 17:21:07.287076 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:07.286383 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c1d69734-b0b9-4ef3-bc8e-b423be5cea80-console-config\") pod \"console-7654f97c47-td8x8\" (UID: \"c1d69734-b0b9-4ef3-bc8e-b423be5cea80\") " pod="openshift-console/console-7654f97c47-td8x8" Jul 24 17:21:07.290142 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:07.290096 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c1d69734-b0b9-4ef3-bc8e-b423be5cea80-console-serving-cert\") pod \"console-7654f97c47-td8x8\" (UID: \"c1d69734-b0b9-4ef3-bc8e-b423be5cea80\") " pod="openshift-console/console-7654f97c47-td8x8" Jul 24 17:21:07.291272 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:07.291249 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c1d69734-b0b9-4ef3-bc8e-b423be5cea80-console-oauth-config\") pod \"console-7654f97c47-td8x8\" (UID: \"c1d69734-b0b9-4ef3-bc8e-b423be5cea80\") " pod="openshift-console/console-7654f97c47-td8x8" Jul 24 17:21:07.308964 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:07.308940 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txqvz\" (UniqueName: \"kubernetes.io/projected/c1d69734-b0b9-4ef3-bc8e-b423be5cea80-kube-api-access-txqvz\") pod \"console-7654f97c47-td8x8\" (UID: \"c1d69734-b0b9-4ef3-bc8e-b423be5cea80\") " pod="openshift-console/console-7654f97c47-td8x8" Jul 24 17:21:07.431009 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:07.430921 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7654f97c47-td8x8" Jul 24 17:21:08.157592 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:08.157562 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qsn2t" Jul 24 17:21:09.289445 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:09.289399 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8b8fb98bb-vpn46"] Jul 24 17:21:09.294188 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:09.294163 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b8fb98bb-vpn46" Jul 24 17:21:09.309510 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:09.309486 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 24 17:21:09.317311 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:09.317239 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8b8fb98bb-vpn46"] Jul 24 17:21:09.401787 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:09.401744 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76386c7f-1505-4002-8955-a6335ffde6e5-service-ca\") pod \"console-8b8fb98bb-vpn46\" (UID: \"76386c7f-1505-4002-8955-a6335ffde6e5\") " pod="openshift-console/console-8b8fb98bb-vpn46" Jul 24 17:21:09.401934 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:09.401813 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76386c7f-1505-4002-8955-a6335ffde6e5-console-config\") pod \"console-8b8fb98bb-vpn46\" (UID: \"76386c7f-1505-4002-8955-a6335ffde6e5\") " pod="openshift-console/console-8b8fb98bb-vpn46" Jul 24 17:21:09.401934 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:09.401860 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76386c7f-1505-4002-8955-a6335ffde6e5-oauth-serving-cert\") pod \"console-8b8fb98bb-vpn46\" (UID: \"76386c7f-1505-4002-8955-a6335ffde6e5\") " pod="openshift-console/console-8b8fb98bb-vpn46" Jul 24 17:21:09.401934 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:09.401883 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76386c7f-1505-4002-8955-a6335ffde6e5-trusted-ca-bundle\") pod \"console-8b8fb98bb-vpn46\" (UID: \"76386c7f-1505-4002-8955-a6335ffde6e5\") " pod="openshift-console/console-8b8fb98bb-vpn46" Jul 24 17:21:09.401934 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:09.401911 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5kptv\" (UniqueName: \"kubernetes.io/projected/76386c7f-1505-4002-8955-a6335ffde6e5-kube-api-access-5kptv\") pod \"console-8b8fb98bb-vpn46\" (UID: \"76386c7f-1505-4002-8955-a6335ffde6e5\") " pod="openshift-console/console-8b8fb98bb-vpn46" Jul 24 17:21:09.402106 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:09.401974 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76386c7f-1505-4002-8955-a6335ffde6e5-console-serving-cert\") pod \"console-8b8fb98bb-vpn46\" (UID: \"76386c7f-1505-4002-8955-a6335ffde6e5\") " pod="openshift-console/console-8b8fb98bb-vpn46" Jul 24 17:21:09.402106 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:09.402007 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76386c7f-1505-4002-8955-a6335ffde6e5-console-oauth-config\") pod \"console-8b8fb98bb-vpn46\" (UID: \"76386c7f-1505-4002-8955-a6335ffde6e5\") " pod="openshift-console/console-8b8fb98bb-vpn46" Jul 24 17:21:09.502939 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:09.502395 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76386c7f-1505-4002-8955-a6335ffde6e5-console-oauth-config\") pod \"console-8b8fb98bb-vpn46\" (UID: \"76386c7f-1505-4002-8955-a6335ffde6e5\") " pod="openshift-console/console-8b8fb98bb-vpn46" Jul 24 17:21:09.502939 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:09.502468 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76386c7f-1505-4002-8955-a6335ffde6e5-service-ca\") pod \"console-8b8fb98bb-vpn46\" (UID: \"76386c7f-1505-4002-8955-a6335ffde6e5\") " pod="openshift-console/console-8b8fb98bb-vpn46" Jul 24 17:21:09.502939 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:09.502512 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76386c7f-1505-4002-8955-a6335ffde6e5-console-config\") pod \"console-8b8fb98bb-vpn46\" (UID: \"76386c7f-1505-4002-8955-a6335ffde6e5\") " pod="openshift-console/console-8b8fb98bb-vpn46" Jul 24 17:21:09.502939 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:09.502558 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76386c7f-1505-4002-8955-a6335ffde6e5-oauth-serving-cert\") pod \"console-8b8fb98bb-vpn46\" (UID: \"76386c7f-1505-4002-8955-a6335ffde6e5\") " pod="openshift-console/console-8b8fb98bb-vpn46" Jul 24 17:21:09.502939 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:09.502586 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76386c7f-1505-4002-8955-a6335ffde6e5-trusted-ca-bundle\") pod \"console-8b8fb98bb-vpn46\" (UID: \"76386c7f-1505-4002-8955-a6335ffde6e5\") " pod="openshift-console/console-8b8fb98bb-vpn46" Jul 24 17:21:09.502939 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:09.502613 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5kptv\" (UniqueName: \"kubernetes.io/projected/76386c7f-1505-4002-8955-a6335ffde6e5-kube-api-access-5kptv\") pod \"console-8b8fb98bb-vpn46\" (UID: \"76386c7f-1505-4002-8955-a6335ffde6e5\") " pod="openshift-console/console-8b8fb98bb-vpn46" Jul 24 17:21:09.502939 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:09.502653 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76386c7f-1505-4002-8955-a6335ffde6e5-console-serving-cert\") pod \"console-8b8fb98bb-vpn46\" (UID: \"76386c7f-1505-4002-8955-a6335ffde6e5\") " pod="openshift-console/console-8b8fb98bb-vpn46" Jul 24 17:21:09.503495 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:09.503472 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76386c7f-1505-4002-8955-a6335ffde6e5-oauth-serving-cert\") pod \"console-8b8fb98bb-vpn46\" (UID: \"76386c7f-1505-4002-8955-a6335ffde6e5\") " pod="openshift-console/console-8b8fb98bb-vpn46" Jul 24 17:21:09.503860 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:09.503803 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76386c7f-1505-4002-8955-a6335ffde6e5-console-config\") pod \"console-8b8fb98bb-vpn46\" (UID: \"76386c7f-1505-4002-8955-a6335ffde6e5\") " pod="openshift-console/console-8b8fb98bb-vpn46" Jul 24 17:21:09.503860 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:09.503842 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76386c7f-1505-4002-8955-a6335ffde6e5-service-ca\") pod \"console-8b8fb98bb-vpn46\" (UID: \"76386c7f-1505-4002-8955-a6335ffde6e5\") " pod="openshift-console/console-8b8fb98bb-vpn46" Jul 24 17:21:09.504504 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:09.504458 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76386c7f-1505-4002-8955-a6335ffde6e5-trusted-ca-bundle\") pod \"console-8b8fb98bb-vpn46\" (UID: \"76386c7f-1505-4002-8955-a6335ffde6e5\") " pod="openshift-console/console-8b8fb98bb-vpn46" Jul 24 17:21:09.505380 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:09.505356 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76386c7f-1505-4002-8955-a6335ffde6e5-console-oauth-config\") pod \"console-8b8fb98bb-vpn46\" (UID: \"76386c7f-1505-4002-8955-a6335ffde6e5\") " pod="openshift-console/console-8b8fb98bb-vpn46" Jul 24 17:21:09.506050 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:09.506006 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76386c7f-1505-4002-8955-a6335ffde6e5-console-serving-cert\") pod \"console-8b8fb98bb-vpn46\" (UID: \"76386c7f-1505-4002-8955-a6335ffde6e5\") " pod="openshift-console/console-8b8fb98bb-vpn46" Jul 24 17:21:09.512806 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:09.512765 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5kptv\" (UniqueName: \"kubernetes.io/projected/76386c7f-1505-4002-8955-a6335ffde6e5-kube-api-access-5kptv\") pod \"console-8b8fb98bb-vpn46\" (UID: \"76386c7f-1505-4002-8955-a6335ffde6e5\") " pod="openshift-console/console-8b8fb98bb-vpn46" Jul 24 17:21:09.606702 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:09.606632 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b8fb98bb-vpn46" Jul 24 17:21:10.511722 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:10.511605 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9c7af4e-bb66-40e8-936c-d9d62240e05f-metrics-certs\") pod \"network-metrics-daemon-njwgg\" (UID: \"c9c7af4e-bb66-40e8-936c-d9d62240e05f\") " pod="openshift-multus/network-metrics-daemon-njwgg" Jul 24 17:21:10.514787 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:10.514763 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 17:21:10.525088 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:10.525058 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c9c7af4e-bb66-40e8-936c-d9d62240e05f-metrics-certs\") pod \"network-metrics-daemon-njwgg\" (UID: \"c9c7af4e-bb66-40e8-936c-d9d62240e05f\") " pod="openshift-multus/network-metrics-daemon-njwgg" Jul 24 17:21:10.612048 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:10.612012 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8dd24b3b-de29-4d73-9b9a-519287ab38c0-original-pull-secret\") pod \"global-pull-secret-syncer-7smjt\" (UID: \"8dd24b3b-de29-4d73-9b9a-519287ab38c0\") " pod="kube-system/global-pull-secret-syncer-7smjt" Jul 24 17:21:10.612205 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:10.612075 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l6tmb\" (UniqueName: \"kubernetes.io/projected/b51ad1bf-cbce-4045-aee9-4997201a35cd-kube-api-access-l6tmb\") pod \"network-check-target-nsllf\" (UID: \"b51ad1bf-cbce-4045-aee9-4997201a35cd\") " pod="openshift-network-diagnostics/network-check-target-nsllf" Jul 24 17:21:10.615747 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:10.615722 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 17:21:10.615871 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:10.615794 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l6tmb\" (UniqueName: \"kubernetes.io/projected/b51ad1bf-cbce-4045-aee9-4997201a35cd-kube-api-access-l6tmb\") pod \"network-check-target-nsllf\" (UID: \"b51ad1bf-cbce-4045-aee9-4997201a35cd\") " pod="openshift-network-diagnostics/network-check-target-nsllf" Jul 24 17:21:10.625594 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:10.625562 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/8dd24b3b-de29-4d73-9b9a-519287ab38c0-original-pull-secret\") pod \"global-pull-secret-syncer-7smjt\" (UID: \"8dd24b3b-de29-4d73-9b9a-519287ab38c0\") " pod="kube-system/global-pull-secret-syncer-7smjt" Jul 24 17:21:10.629227 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:10.629043 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-jwvtx\"" Jul 24 17:21:10.637211 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:10.637186 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-njwgg" Jul 24 17:21:10.820798 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:10.820541 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8rjf6\"" Jul 24 17:21:10.828740 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:10.828715 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-nsllf" Jul 24 17:21:10.921033 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:10.921004 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7smjt" Jul 24 17:21:12.315117 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:12.315009 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8b8fb98bb-vpn46"] Jul 24 17:21:12.320389 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:21:12.320358 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76386c7f_1505_4002_8955_a6335ffde6e5.slice/crio-2882e8ef9e39945707358bdec62600f7422afd3a4616cecb2146eec5c11665db WatchSource:0}: Error finding container 2882e8ef9e39945707358bdec62600f7422afd3a4616cecb2146eec5c11665db: Status 404 returned error can't find the container with id 2882e8ef9e39945707358bdec62600f7422afd3a4616cecb2146eec5c11665db Jul 24 17:21:12.342226 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:12.341865 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7654f97c47-td8x8"] Jul 24 17:21:12.346928 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:12.346843 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7smjt"] Jul 24 17:21:12.583507 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:12.583478 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-nsllf"] Jul 24 17:21:12.586189 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:21:12.586126 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb51ad1bf_cbce_4045_aee9_4997201a35cd.slice/crio-3bbad0e9f2d3629c6233b646680c41e3ad652d3889329ea476295b27d7838a55 WatchSource:0}: Error finding container 3bbad0e9f2d3629c6233b646680c41e3ad652d3889329ea476295b27d7838a55: Status 404 returned error can't find the container with id 3bbad0e9f2d3629c6233b646680c41e3ad652d3889329ea476295b27d7838a55 Jul 24 17:21:12.586632 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:12.586613 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-njwgg"] Jul 24 17:21:12.589238 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:21:12.589212 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc9c7af4e_bb66_40e8_936c_d9d62240e05f.slice/crio-d8446047986035cbceff488b95d62f5df1e376a3a9a3f2bbcfe2e45499e7deac WatchSource:0}: Error finding container d8446047986035cbceff488b95d62f5df1e376a3a9a3f2bbcfe2e45499e7deac: Status 404 returned error can't find the container with id d8446047986035cbceff488b95d62f5df1e376a3a9a3f2bbcfe2e45499e7deac Jul 24 17:21:13.287414 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.287351 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c4497f88-qstkg" event={"ID":"b7a53a76-3c77-44cd-a7bc-7b40b4587ec9","Type":"ContainerStarted","Data":"96e6381ec911fc648101d6a5779254d93b070eed7bab7e80d83ec350d1566165"} Jul 24 17:21:13.289052 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.289000 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b8fb98bb-vpn46" event={"ID":"76386c7f-1505-4002-8955-a6335ffde6e5","Type":"ContainerStarted","Data":"2882e8ef9e39945707358bdec62600f7422afd3a4616cecb2146eec5c11665db"} Jul 24 17:21:13.290472 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.290403 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-njwgg" event={"ID":"c9c7af4e-bb66-40e8-936c-d9d62240e05f","Type":"ContainerStarted","Data":"d8446047986035cbceff488b95d62f5df1e376a3a9a3f2bbcfe2e45499e7deac"} Jul 24 17:21:13.294232 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.294173 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7smjt" event={"ID":"8dd24b3b-de29-4d73-9b9a-519287ab38c0","Type":"ContainerStarted","Data":"ea506b03c09179bb91c14f085dd3b71bdba2a6f7e3aaf855dbc58255e2219335"} Jul 24 17:21:13.298127 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.297599 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nbhc9" event={"ID":"2ee78578-9e17-4d87-99bc-9eb4c154fcc7","Type":"ContainerStarted","Data":"4a04da4f520fe2e34c673bed96b9084faac2806c85ca70d1fce67edae3463321"} Jul 24 17:21:13.302244 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.301822 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-cjfxb" event={"ID":"0bbd2a5a-a58b-45ac-9a87-15349af57712","Type":"ContainerStarted","Data":"452fc193fbfbe5df101ad464aa4de6e4da393f7570646d7acb110d35d2c9268c"} Jul 24 17:21:13.304175 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.304065 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7654f97c47-td8x8" event={"ID":"c1d69734-b0b9-4ef3-bc8e-b423be5cea80","Type":"ContainerStarted","Data":"988045a20f378e8a02f942e9d50657f01ca8830eb42c58755380a0d75f62c4a8"} Jul 24 17:21:13.306312 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.305407 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-65c4497f88-qstkg" podStartSLOduration=2.4014378069999998 podStartE2EDuration="9.305390439s" totalImagesPullingTime="6.903952632s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:21:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:21:13.304925692 +0000 UTC m=+68.973336717" watchObservedRunningTime="2026-07-24 17:21:13.305390439 +0000 UTC m=+68.973801463" Jul 24 17:21:13.311203 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.310755 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cszt2" event={"ID":"d7dbcd57-7669-4990-81f5-bfe66052ac67","Type":"ContainerStarted","Data":"36383bc23e2e09278208d5c1d3f75102f5af8494fa585b9e82ca2aed49c92af5"} Jul 24 17:21:13.311375 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.311315 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cszt2" Jul 24 17:21:13.314976 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.314908 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nsllf" event={"ID":"b51ad1bf-cbce-4045-aee9-4997201a35cd","Type":"ContainerStarted","Data":"dcbd07f3957c791bd163449a5972b920068ba932a4bbacc911318b3f9a082263"} Jul 24 17:21:13.314976 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.314947 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-nsllf" event={"ID":"b51ad1bf-cbce-4045-aee9-4997201a35cd","Type":"ContainerStarted","Data":"3bbad0e9f2d3629c6233b646680c41e3ad652d3889329ea476295b27d7838a55"} Jul 24 17:21:13.315922 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.315875 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-nsllf" Jul 24 17:21:13.317978 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.317963 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cszt2" Jul 24 17:21:13.324177 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.324130 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-cjfxb" podStartSLOduration=2.374258346 podStartE2EDuration="9.324117968s" totalImagesPullingTime="6.949859622s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:21:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:21:13.322681416 +0000 UTC m=+68.991092433" watchObservedRunningTime="2026-07-24 17:21:13.324117968 +0000 UTC m=+68.992528973" Jul 24 17:21:13.366567 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.366530 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nbhc9" podStartSLOduration=17.708150438 podStartE2EDuration="34.366516516s" totalImagesPullingTime="16.658366078s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:20:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:21:13.34717507 +0000 UTC m=+69.015586110" watchObservedRunningTime="2026-07-24 17:21:13.366516516 +0000 UTC m=+69.034927537" Jul 24 17:21:13.366902 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.366852 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-7f8d78f54b-cszt2" podStartSLOduration=2.634089799 podStartE2EDuration="9.366847934s" totalImagesPullingTime="6.732758135s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:21:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:21:13.365758034 +0000 UTC m=+69.034169059" watchObservedRunningTime="2026-07-24 17:21:13.366847934 +0000 UTC m=+69.035258958" Jul 24 17:21:13.383874 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.383261 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-nsllf" podStartSLOduration=69.38324352 podStartE2EDuration="1m9.38324352s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:20:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:21:13.38251325 +0000 UTC m=+69.050924279" watchObservedRunningTime="2026-07-24 17:21:13.38324352 +0000 UTC m=+69.051654547" Jul 24 17:21:13.516436 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.515074 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-gnmr5"] Jul 24 17:21:13.541458 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.539999 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-gnmr5"] Jul 24 17:21:13.541458 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.540113 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-gnmr5" Jul 24 17:21:13.544438 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.543566 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 24 17:21:13.544438 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.543903 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-cs4dd\"" Jul 24 17:21:13.544438 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.544197 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 24 17:21:13.544438 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.544416 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 24 17:21:13.544714 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.544611 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 24 17:21:13.547363 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.547158 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 24 17:21:13.639475 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.639223 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfqq7\" (UniqueName: \"kubernetes.io/projected/1be59003-7ba3-4f21-a4c2-e07549584507-kube-api-access-hfqq7\") pod \"prometheus-operator-84d69f794d-gnmr5\" (UID: \"1be59003-7ba3-4f21-a4c2-e07549584507\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gnmr5" Jul 24 17:21:13.639475 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.639270 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1be59003-7ba3-4f21-a4c2-e07549584507-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-gnmr5\" (UID: \"1be59003-7ba3-4f21-a4c2-e07549584507\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gnmr5" Jul 24 17:21:13.639475 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.639302 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1be59003-7ba3-4f21-a4c2-e07549584507-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-gnmr5\" (UID: \"1be59003-7ba3-4f21-a4c2-e07549584507\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gnmr5" Jul 24 17:21:13.639475 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.639356 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1be59003-7ba3-4f21-a4c2-e07549584507-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-gnmr5\" (UID: \"1be59003-7ba3-4f21-a4c2-e07549584507\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gnmr5" Jul 24 17:21:13.741882 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.740009 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfqq7\" (UniqueName: \"kubernetes.io/projected/1be59003-7ba3-4f21-a4c2-e07549584507-kube-api-access-hfqq7\") pod \"prometheus-operator-84d69f794d-gnmr5\" (UID: \"1be59003-7ba3-4f21-a4c2-e07549584507\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gnmr5" Jul 24 17:21:13.741882 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.740111 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1be59003-7ba3-4f21-a4c2-e07549584507-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-gnmr5\" (UID: \"1be59003-7ba3-4f21-a4c2-e07549584507\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gnmr5" Jul 24 17:21:13.741882 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.740142 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1be59003-7ba3-4f21-a4c2-e07549584507-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-gnmr5\" (UID: \"1be59003-7ba3-4f21-a4c2-e07549584507\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gnmr5" Jul 24 17:21:13.741882 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.740220 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1be59003-7ba3-4f21-a4c2-e07549584507-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-gnmr5\" (UID: \"1be59003-7ba3-4f21-a4c2-e07549584507\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gnmr5" Jul 24 17:21:13.741882 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.741292 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1be59003-7ba3-4f21-a4c2-e07549584507-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-gnmr5\" (UID: \"1be59003-7ba3-4f21-a4c2-e07549584507\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gnmr5" Jul 24 17:21:13.758607 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.758558 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfqq7\" (UniqueName: \"kubernetes.io/projected/1be59003-7ba3-4f21-a4c2-e07549584507-kube-api-access-hfqq7\") pod \"prometheus-operator-84d69f794d-gnmr5\" (UID: \"1be59003-7ba3-4f21-a4c2-e07549584507\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gnmr5" Jul 24 17:21:13.761585 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.761548 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1be59003-7ba3-4f21-a4c2-e07549584507-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-gnmr5\" (UID: \"1be59003-7ba3-4f21-a4c2-e07549584507\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gnmr5" Jul 24 17:21:13.770835 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.770789 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/1be59003-7ba3-4f21-a4c2-e07549584507-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-gnmr5\" (UID: \"1be59003-7ba3-4f21-a4c2-e07549584507\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-gnmr5" Jul 24 17:21:13.858003 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:13.857749 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-gnmr5" Jul 24 17:21:14.409281 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:14.409181 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-gnmr5"] Jul 24 17:21:14.412726 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:21:14.412696 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1be59003_7ba3_4f21_a4c2_e07549584507.slice/crio-05863294f1f7c2fad39a7790368c927fc67d1c0402b7b718a7b31da1c3c6e59e WatchSource:0}: Error finding container 05863294f1f7c2fad39a7790368c927fc67d1c0402b7b718a7b31da1c3c6e59e: Status 404 returned error can't find the container with id 05863294f1f7c2fad39a7790368c927fc67d1c0402b7b718a7b31da1c3c6e59e Jul 24 17:21:15.341729 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:15.340947 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-njwgg" event={"ID":"c9c7af4e-bb66-40e8-936c-d9d62240e05f","Type":"ContainerStarted","Data":"1171feaa086665f603f02d4184c8c017270cf84f5a86859255680893b4866541"} Jul 24 17:21:15.341729 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:15.341014 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-njwgg" event={"ID":"c9c7af4e-bb66-40e8-936c-d9d62240e05f","Type":"ContainerStarted","Data":"6ccf03a47fec4cb4528ae897148bbbecbe21e397e02ceb09bbe035e6f893a510"} Jul 24 17:21:15.345568 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:15.344294 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-gnmr5" event={"ID":"1be59003-7ba3-4f21-a4c2-e07549584507","Type":"ContainerStarted","Data":"05863294f1f7c2fad39a7790368c927fc67d1c0402b7b718a7b31da1c3c6e59e"} Jul 24 17:21:15.360228 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:15.360177 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-njwgg" podStartSLOduration=69.707312567 podStartE2EDuration="1m11.360157996s" totalImagesPullingTime="1.652845429s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:20:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:21:15.357366609 +0000 UTC m=+71.025777630" watchObservedRunningTime="2026-07-24 17:21:15.360157996 +0000 UTC m=+71.028569022" Jul 24 17:21:26.390450 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:26.390414 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b8fb98bb-vpn46" event={"ID":"76386c7f-1505-4002-8955-a6335ffde6e5","Type":"ContainerStarted","Data":"73249a3fee7c95f53e1aaeadcf6d3ae0f1d222c3336a7074cecb63224b611ef2"} Jul 24 17:21:26.392473 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:26.392445 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7smjt" event={"ID":"8dd24b3b-de29-4d73-9b9a-519287ab38c0","Type":"ContainerStarted","Data":"92f05b3eba29192c42700e80f9c3e8b40f8a91bc6f2d8b94e7ee47995796b4e6"} Jul 24 17:21:26.393941 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:26.393922 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7654f97c47-td8x8" event={"ID":"c1d69734-b0b9-4ef3-bc8e-b423be5cea80","Type":"ContainerStarted","Data":"2e837d1c82a46fa1e92e38c9cba0cf064b0edb51bb85237f1947d82f1cd3cca6"} Jul 24 17:21:26.395912 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:26.395888 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-gnmr5" event={"ID":"1be59003-7ba3-4f21-a4c2-e07549584507","Type":"ContainerStarted","Data":"d9c0aaee3e7237908ae91a4207e6766ada52f0505bcf4385b104789ff9f18475"} Jul 24 17:21:26.395986 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:26.395940 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-gnmr5" event={"ID":"1be59003-7ba3-4f21-a4c2-e07549584507","Type":"ContainerStarted","Data":"c86aec404a2491a1e0182e896407b33ca584efd3a178f10e040870fbc220598d"} Jul 24 17:21:26.398066 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:26.398035 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-bl5xg" event={"ID":"078115f0-2fb4-4cc2-89a0-74c58e7d79fa","Type":"ContainerStarted","Data":"8b4b845a43be2e44468fdb64fe4a46616357093471a1bfcafffa0b2e4714acce"} Jul 24 17:21:26.398419 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:26.398402 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-bl5xg" Jul 24 17:21:26.412386 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:26.412369 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-bl5xg" Jul 24 17:21:26.428919 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:26.428866 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8b8fb98bb-vpn46" podStartSLOduration=4.056253759 podStartE2EDuration="17.428849741s" totalImagesPullingTime="13.372595982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:21:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:21:26.418153118 +0000 UTC m=+82.086564147" watchObservedRunningTime="2026-07-24 17:21:26.428849741 +0000 UTC m=+82.097260765" Jul 24 17:21:26.454441 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:26.454390 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7654f97c47-td8x8" podStartSLOduration=6.107977947 podStartE2EDuration="19.454374282s" totalImagesPullingTime="13.346396335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:21:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:21:26.453166538 +0000 UTC m=+82.121577563" watchObservedRunningTime="2026-07-24 17:21:26.454374282 +0000 UTC m=+82.122785308" Jul 24 17:21:26.478315 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:26.478261 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-gnmr5" podStartSLOduration=2.1963995 podStartE2EDuration="13.478248184s" totalImagesPullingTime="11.281848684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:21:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:21:26.47655101 +0000 UTC m=+82.144962033" watchObservedRunningTime="2026-07-24 17:21:26.478248184 +0000 UTC m=+82.146659207" Jul 24 17:21:26.505291 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:26.505233 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7smjt" podStartSLOduration=68.159824225 podStartE2EDuration="1m21.505220368s" totalImagesPullingTime="13.345396143s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 17:20:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:21:26.504483653 +0000 UTC m=+82.172894679" watchObservedRunningTime="2026-07-24 17:21:26.505220368 +0000 UTC m=+82.173631392" Jul 24 17:21:26.537388 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:26.537305 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-bl5xg" podStartSLOduration=1.876284541 podStartE2EDuration="22.53728775s" totalImagesPullingTime="20.661003209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:21:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:21:26.535654851 +0000 UTC m=+82.204065876" watchObservedRunningTime="2026-07-24 17:21:26.53728775 +0000 UTC m=+82.205698773" Jul 24 17:21:27.431947 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:27.431915 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7654f97c47-td8x8" Jul 24 17:21:27.432441 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:27.432415 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7654f97c47-td8x8" Jul 24 17:21:27.437946 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:27.437922 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7654f97c47-td8x8" Jul 24 17:21:28.234664 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:28.234634 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-69489f8bf8-tmxrk" Jul 24 17:21:28.410567 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:28.410536 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7654f97c47-td8x8" Jul 24 17:21:28.869319 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:28.869281 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-w56p6"] Jul 24 17:21:28.925491 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:28.925460 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w56p6" Jul 24 17:21:28.928658 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:28.928117 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 24 17:21:28.928658 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:28.928117 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-crq8q\"" Jul 24 17:21:28.928658 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:28.928213 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 24 17:21:28.931259 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:28.931238 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-w56p6"] Jul 24 17:21:28.931407 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:28.931292 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-svd9m"] Jul 24 17:21:28.946886 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:28.946854 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bwxn7"] Jul 24 17:21:28.947013 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:28.946995 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-svd9m" Jul 24 17:21:28.949860 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:28.949839 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 24 17:21:28.949985 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:28.949922 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 24 17:21:28.949985 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:28.949928 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-bglnl\"" Jul 24 17:21:28.950135 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:28.950120 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 24 17:21:28.961987 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:28.961966 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-svd9m"] Jul 24 17:21:28.961987 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:28.961979 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bwxn7" Jul 24 17:21:28.965653 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:28.965630 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 24 17:21:28.965817 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:28.965673 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 24 17:21:28.965896 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:28.965725 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ggxqm\"" Jul 24 17:21:28.965896 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:28.965805 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 24 17:21:28.971788 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:28.971762 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/85035b30-6f00-407e-99b1-c3eae43f6950-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-w56p6\" (UID: \"85035b30-6f00-407e-99b1-c3eae43f6950\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w56p6" Jul 24 17:21:28.971889 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:28.971807 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85035b30-6f00-407e-99b1-c3eae43f6950-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-w56p6\" (UID: \"85035b30-6f00-407e-99b1-c3eae43f6950\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w56p6" Jul 24 17:21:28.971889 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:28.971842 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/85035b30-6f00-407e-99b1-c3eae43f6950-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-w56p6\" (UID: \"85035b30-6f00-407e-99b1-c3eae43f6950\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w56p6" Jul 24 17:21:28.971889 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:28.971871 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpzcs\" (UniqueName: \"kubernetes.io/projected/85035b30-6f00-407e-99b1-c3eae43f6950-kube-api-access-tpzcs\") pod \"openshift-state-metrics-b8f49f5c6-w56p6\" (UID: \"85035b30-6f00-407e-99b1-c3eae43f6950\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w56p6" Jul 24 17:21:29.073089 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.073058 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/85035b30-6f00-407e-99b1-c3eae43f6950-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-w56p6\" (UID: \"85035b30-6f00-407e-99b1-c3eae43f6950\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w56p6" Jul 24 17:21:29.073257 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.073095 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a3fef7c5-29be-4c9c-8f7e-c3256ed730b2-node-exporter-textfile\") pod \"node-exporter-bwxn7\" (UID: \"a3fef7c5-29be-4c9c-8f7e-c3256ed730b2\") " pod="openshift-monitoring/node-exporter-bwxn7" Jul 24 17:21:29.073257 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.073130 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/aa0f5571-f91b-404f-b68d-08459015cf14-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-svd9m\" (UID: \"aa0f5571-f91b-404f-b68d-08459015cf14\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-svd9m" Jul 24 17:21:29.073257 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.073163 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85035b30-6f00-407e-99b1-c3eae43f6950-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-w56p6\" (UID: \"85035b30-6f00-407e-99b1-c3eae43f6950\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w56p6" Jul 24 17:21:29.073257 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.073215 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxp7d\" (UniqueName: \"kubernetes.io/projected/a3fef7c5-29be-4c9c-8f7e-c3256ed730b2-kube-api-access-bxp7d\") pod \"node-exporter-bwxn7\" (UID: \"a3fef7c5-29be-4c9c-8f7e-c3256ed730b2\") " pod="openshift-monitoring/node-exporter-bwxn7" Jul 24 17:21:29.073257 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:21:29.073228 2570 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 24 17:21:29.073257 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.073243 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/85035b30-6f00-407e-99b1-c3eae43f6950-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-w56p6\" (UID: \"85035b30-6f00-407e-99b1-c3eae43f6950\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w56p6" Jul 24 17:21:29.073665 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.073270 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3fef7c5-29be-4c9c-8f7e-c3256ed730b2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bwxn7\" (UID: \"a3fef7c5-29be-4c9c-8f7e-c3256ed730b2\") " pod="openshift-monitoring/node-exporter-bwxn7" Jul 24 17:21:29.073665 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:21:29.073301 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/85035b30-6f00-407e-99b1-c3eae43f6950-openshift-state-metrics-tls podName:85035b30-6f00-407e-99b1-c3eae43f6950 nodeName:}" failed. No retries permitted until 2026-07-24 17:21:29.573278453 +0000 UTC m=+85.241689460 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/85035b30-6f00-407e-99b1-c3eae43f6950-openshift-state-metrics-tls") pod "openshift-state-metrics-b8f49f5c6-w56p6" (UID: "85035b30-6f00-407e-99b1-c3eae43f6950") : secret "openshift-state-metrics-tls" not found Jul 24 17:21:29.073665 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.073559 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a3fef7c5-29be-4c9c-8f7e-c3256ed730b2-node-exporter-accelerators-collector-config\") pod \"node-exporter-bwxn7\" (UID: \"a3fef7c5-29be-4c9c-8f7e-c3256ed730b2\") " pod="openshift-monitoring/node-exporter-bwxn7" Jul 24 17:21:29.073665 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.073596 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a3fef7c5-29be-4c9c-8f7e-c3256ed730b2-node-exporter-tls\") pod \"node-exporter-bwxn7\" (UID: \"a3fef7c5-29be-4c9c-8f7e-c3256ed730b2\") " pod="openshift-monitoring/node-exporter-bwxn7" Jul 24 17:21:29.073665 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.073630 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpzcs\" (UniqueName: \"kubernetes.io/projected/85035b30-6f00-407e-99b1-c3eae43f6950-kube-api-access-tpzcs\") pod \"openshift-state-metrics-b8f49f5c6-w56p6\" (UID: \"85035b30-6f00-407e-99b1-c3eae43f6950\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w56p6" Jul 24 17:21:29.073665 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.073662 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa0f5571-f91b-404f-b68d-08459015cf14-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-svd9m\" (UID: \"aa0f5571-f91b-404f-b68d-08459015cf14\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-svd9m" Jul 24 17:21:29.073980 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.073684 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3fef7c5-29be-4c9c-8f7e-c3256ed730b2-sys\") pod \"node-exporter-bwxn7\" (UID: \"a3fef7c5-29be-4c9c-8f7e-c3256ed730b2\") " pod="openshift-monitoring/node-exporter-bwxn7" Jul 24 17:21:29.073980 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.073710 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/aa0f5571-f91b-404f-b68d-08459015cf14-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-svd9m\" (UID: \"aa0f5571-f91b-404f-b68d-08459015cf14\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-svd9m" Jul 24 17:21:29.073980 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.073815 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a3fef7c5-29be-4c9c-8f7e-c3256ed730b2-root\") pod \"node-exporter-bwxn7\" (UID: \"a3fef7c5-29be-4c9c-8f7e-c3256ed730b2\") " pod="openshift-monitoring/node-exporter-bwxn7" Jul 24 17:21:29.073980 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.073873 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa0f5571-f91b-404f-b68d-08459015cf14-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-svd9m\" (UID: \"aa0f5571-f91b-404f-b68d-08459015cf14\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-svd9m" Jul 24 17:21:29.073980 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.073881 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/85035b30-6f00-407e-99b1-c3eae43f6950-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-w56p6\" (UID: \"85035b30-6f00-407e-99b1-c3eae43f6950\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w56p6" Jul 24 17:21:29.073980 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.073901 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa0f5571-f91b-404f-b68d-08459015cf14-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-svd9m\" (UID: \"aa0f5571-f91b-404f-b68d-08459015cf14\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-svd9m" Jul 24 17:21:29.073980 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.073963 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3fef7c5-29be-4c9c-8f7e-c3256ed730b2-metrics-client-ca\") pod \"node-exporter-bwxn7\" (UID: \"a3fef7c5-29be-4c9c-8f7e-c3256ed730b2\") " pod="openshift-monitoring/node-exporter-bwxn7" Jul 24 17:21:29.074239 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.074014 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8625t\" (UniqueName: \"kubernetes.io/projected/aa0f5571-f91b-404f-b68d-08459015cf14-kube-api-access-8625t\") pod \"kube-state-metrics-56d9f944b4-svd9m\" (UID: \"aa0f5571-f91b-404f-b68d-08459015cf14\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-svd9m" Jul 24 17:21:29.074239 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.074042 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a3fef7c5-29be-4c9c-8f7e-c3256ed730b2-node-exporter-wtmp\") pod \"node-exporter-bwxn7\" (UID: \"a3fef7c5-29be-4c9c-8f7e-c3256ed730b2\") " pod="openshift-monitoring/node-exporter-bwxn7" Jul 24 17:21:29.076299 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.076271 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/85035b30-6f00-407e-99b1-c3eae43f6950-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-w56p6\" (UID: \"85035b30-6f00-407e-99b1-c3eae43f6950\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w56p6" Jul 24 17:21:29.087298 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.087274 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpzcs\" (UniqueName: \"kubernetes.io/projected/85035b30-6f00-407e-99b1-c3eae43f6950-kube-api-access-tpzcs\") pod \"openshift-state-metrics-b8f49f5c6-w56p6\" (UID: \"85035b30-6f00-407e-99b1-c3eae43f6950\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w56p6" Jul 24 17:21:29.174879 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.174798 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a3fef7c5-29be-4c9c-8f7e-c3256ed730b2-root\") pod \"node-exporter-bwxn7\" (UID: \"a3fef7c5-29be-4c9c-8f7e-c3256ed730b2\") " pod="openshift-monitoring/node-exporter-bwxn7" Jul 24 17:21:29.174879 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.174846 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa0f5571-f91b-404f-b68d-08459015cf14-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-svd9m\" (UID: \"aa0f5571-f91b-404f-b68d-08459015cf14\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-svd9m" Jul 24 17:21:29.174879 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.174868 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa0f5571-f91b-404f-b68d-08459015cf14-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-svd9m\" (UID: \"aa0f5571-f91b-404f-b68d-08459015cf14\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-svd9m" Jul 24 17:21:29.175142 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.174917 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/a3fef7c5-29be-4c9c-8f7e-c3256ed730b2-root\") pod \"node-exporter-bwxn7\" (UID: \"a3fef7c5-29be-4c9c-8f7e-c3256ed730b2\") " pod="openshift-monitoring/node-exporter-bwxn7" Jul 24 17:21:29.175142 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.174991 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3fef7c5-29be-4c9c-8f7e-c3256ed730b2-metrics-client-ca\") pod \"node-exporter-bwxn7\" (UID: \"a3fef7c5-29be-4c9c-8f7e-c3256ed730b2\") " pod="openshift-monitoring/node-exporter-bwxn7" Jul 24 17:21:29.175142 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.175039 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8625t\" (UniqueName: \"kubernetes.io/projected/aa0f5571-f91b-404f-b68d-08459015cf14-kube-api-access-8625t\") pod \"kube-state-metrics-56d9f944b4-svd9m\" (UID: \"aa0f5571-f91b-404f-b68d-08459015cf14\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-svd9m" Jul 24 17:21:29.175142 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.175065 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a3fef7c5-29be-4c9c-8f7e-c3256ed730b2-node-exporter-wtmp\") pod \"node-exporter-bwxn7\" (UID: \"a3fef7c5-29be-4c9c-8f7e-c3256ed730b2\") " pod="openshift-monitoring/node-exporter-bwxn7" Jul 24 17:21:29.175142 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.175103 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a3fef7c5-29be-4c9c-8f7e-c3256ed730b2-node-exporter-textfile\") pod \"node-exporter-bwxn7\" (UID: \"a3fef7c5-29be-4c9c-8f7e-c3256ed730b2\") " pod="openshift-monitoring/node-exporter-bwxn7" Jul 24 17:21:29.175142 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.175137 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/aa0f5571-f91b-404f-b68d-08459015cf14-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-svd9m\" (UID: \"aa0f5571-f91b-404f-b68d-08459015cf14\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-svd9m" Jul 24 17:21:29.175464 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.175174 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxp7d\" (UniqueName: \"kubernetes.io/projected/a3fef7c5-29be-4c9c-8f7e-c3256ed730b2-kube-api-access-bxp7d\") pod \"node-exporter-bwxn7\" (UID: \"a3fef7c5-29be-4c9c-8f7e-c3256ed730b2\") " pod="openshift-monitoring/node-exporter-bwxn7" Jul 24 17:21:29.175464 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.175200 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3fef7c5-29be-4c9c-8f7e-c3256ed730b2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bwxn7\" (UID: \"a3fef7c5-29be-4c9c-8f7e-c3256ed730b2\") " pod="openshift-monitoring/node-exporter-bwxn7" Jul 24 17:21:29.175464 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.175225 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a3fef7c5-29be-4c9c-8f7e-c3256ed730b2-node-exporter-accelerators-collector-config\") pod \"node-exporter-bwxn7\" (UID: \"a3fef7c5-29be-4c9c-8f7e-c3256ed730b2\") " pod="openshift-monitoring/node-exporter-bwxn7" Jul 24 17:21:29.175464 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.175252 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a3fef7c5-29be-4c9c-8f7e-c3256ed730b2-node-exporter-tls\") pod \"node-exporter-bwxn7\" (UID: \"a3fef7c5-29be-4c9c-8f7e-c3256ed730b2\") " pod="openshift-monitoring/node-exporter-bwxn7" Jul 24 17:21:29.175464 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.175256 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/a3fef7c5-29be-4c9c-8f7e-c3256ed730b2-node-exporter-wtmp\") pod \"node-exporter-bwxn7\" (UID: \"a3fef7c5-29be-4c9c-8f7e-c3256ed730b2\") " pod="openshift-monitoring/node-exporter-bwxn7" Jul 24 17:21:29.175464 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.175292 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa0f5571-f91b-404f-b68d-08459015cf14-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-svd9m\" (UID: \"aa0f5571-f91b-404f-b68d-08459015cf14\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-svd9m" Jul 24 17:21:29.175464 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.175315 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3fef7c5-29be-4c9c-8f7e-c3256ed730b2-sys\") pod \"node-exporter-bwxn7\" (UID: \"a3fef7c5-29be-4c9c-8f7e-c3256ed730b2\") " pod="openshift-monitoring/node-exporter-bwxn7" Jul 24 17:21:29.175464 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.175368 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/aa0f5571-f91b-404f-b68d-08459015cf14-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-svd9m\" (UID: \"aa0f5571-f91b-404f-b68d-08459015cf14\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-svd9m" Jul 24 17:21:29.176021 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.175850 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a3fef7c5-29be-4c9c-8f7e-c3256ed730b2-sys\") pod \"node-exporter-bwxn7\" (UID: \"a3fef7c5-29be-4c9c-8f7e-c3256ed730b2\") " pod="openshift-monitoring/node-exporter-bwxn7" Jul 24 17:21:29.176021 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.175880 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/a3fef7c5-29be-4c9c-8f7e-c3256ed730b2-node-exporter-accelerators-collector-config\") pod \"node-exporter-bwxn7\" (UID: \"a3fef7c5-29be-4c9c-8f7e-c3256ed730b2\") " pod="openshift-monitoring/node-exporter-bwxn7" Jul 24 17:21:29.176222 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.176100 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/a3fef7c5-29be-4c9c-8f7e-c3256ed730b2-node-exporter-textfile\") pod \"node-exporter-bwxn7\" (UID: \"a3fef7c5-29be-4c9c-8f7e-c3256ed730b2\") " pod="openshift-monitoring/node-exporter-bwxn7" Jul 24 17:21:29.176222 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.176213 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aa0f5571-f91b-404f-b68d-08459015cf14-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-svd9m\" (UID: \"aa0f5571-f91b-404f-b68d-08459015cf14\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-svd9m" Jul 24 17:21:29.176496 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.176445 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/aa0f5571-f91b-404f-b68d-08459015cf14-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-svd9m\" (UID: \"aa0f5571-f91b-404f-b68d-08459015cf14\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-svd9m" Jul 24 17:21:29.176496 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.176473 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/aa0f5571-f91b-404f-b68d-08459015cf14-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-svd9m\" (UID: \"aa0f5571-f91b-404f-b68d-08459015cf14\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-svd9m" Jul 24 17:21:29.176658 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.176609 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a3fef7c5-29be-4c9c-8f7e-c3256ed730b2-metrics-client-ca\") pod \"node-exporter-bwxn7\" (UID: \"a3fef7c5-29be-4c9c-8f7e-c3256ed730b2\") " pod="openshift-monitoring/node-exporter-bwxn7" Jul 24 17:21:29.178099 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.178078 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/aa0f5571-f91b-404f-b68d-08459015cf14-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-svd9m\" (UID: \"aa0f5571-f91b-404f-b68d-08459015cf14\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-svd9m" Jul 24 17:21:29.178369 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.178344 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aa0f5571-f91b-404f-b68d-08459015cf14-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-svd9m\" (UID: \"aa0f5571-f91b-404f-b68d-08459015cf14\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-svd9m" Jul 24 17:21:29.178771 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.178749 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/a3fef7c5-29be-4c9c-8f7e-c3256ed730b2-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bwxn7\" (UID: \"a3fef7c5-29be-4c9c-8f7e-c3256ed730b2\") " pod="openshift-monitoring/node-exporter-bwxn7" Jul 24 17:21:29.179494 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.179472 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/a3fef7c5-29be-4c9c-8f7e-c3256ed730b2-node-exporter-tls\") pod \"node-exporter-bwxn7\" (UID: \"a3fef7c5-29be-4c9c-8f7e-c3256ed730b2\") " pod="openshift-monitoring/node-exporter-bwxn7" Jul 24 17:21:29.195048 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.195020 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8625t\" (UniqueName: \"kubernetes.io/projected/aa0f5571-f91b-404f-b68d-08459015cf14-kube-api-access-8625t\") pod \"kube-state-metrics-56d9f944b4-svd9m\" (UID: \"aa0f5571-f91b-404f-b68d-08459015cf14\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-svd9m" Jul 24 17:21:29.195144 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.195093 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxp7d\" (UniqueName: \"kubernetes.io/projected/a3fef7c5-29be-4c9c-8f7e-c3256ed730b2-kube-api-access-bxp7d\") pod \"node-exporter-bwxn7\" (UID: \"a3fef7c5-29be-4c9c-8f7e-c3256ed730b2\") " pod="openshift-monitoring/node-exporter-bwxn7" Jul 24 17:21:29.258103 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.258062 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-svd9m" Jul 24 17:21:29.273262 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.273241 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bwxn7" Jul 24 17:21:29.411917 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.411872 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bwxn7" event={"ID":"a3fef7c5-29be-4c9c-8f7e-c3256ed730b2","Type":"ContainerStarted","Data":"134d5b25ca2cb29f5da6cb0f4dbe277d1f8d77059fa2f425e0765acbe885df05"} Jul 24 17:21:29.433867 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.433800 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-svd9m"] Jul 24 17:21:29.436797 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:21:29.436770 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa0f5571_f91b_404f_b68d_08459015cf14.slice/crio-9772c37b0725aa988b5d718ad5a8ebfd2104d7151e1a34bb0d4e2bd2d2f905c8 WatchSource:0}: Error finding container 9772c37b0725aa988b5d718ad5a8ebfd2104d7151e1a34bb0d4e2bd2d2f905c8: Status 404 returned error can't find the container with id 9772c37b0725aa988b5d718ad5a8ebfd2104d7151e1a34bb0d4e2bd2d2f905c8 Jul 24 17:21:29.583733 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.583700 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/85035b30-6f00-407e-99b1-c3eae43f6950-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-w56p6\" (UID: \"85035b30-6f00-407e-99b1-c3eae43f6950\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w56p6" Jul 24 17:21:29.586588 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.586560 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/85035b30-6f00-407e-99b1-c3eae43f6950-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-w56p6\" (UID: \"85035b30-6f00-407e-99b1-c3eae43f6950\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w56p6" Jul 24 17:21:29.606868 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.606842 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8b8fb98bb-vpn46" Jul 24 17:21:29.606975 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.606904 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8b8fb98bb-vpn46" Jul 24 17:21:29.612580 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.612561 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8b8fb98bb-vpn46" Jul 24 17:21:29.838395 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:29.838286 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w56p6" Jul 24 17:21:30.039854 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:30.039633 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-w56p6"] Jul 24 17:21:30.420582 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:30.420527 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-svd9m" event={"ID":"aa0f5571-f91b-404f-b68d-08459015cf14","Type":"ContainerStarted","Data":"9772c37b0725aa988b5d718ad5a8ebfd2104d7151e1a34bb0d4e2bd2d2f905c8"} Jul 24 17:21:30.423961 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:30.423913 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w56p6" event={"ID":"85035b30-6f00-407e-99b1-c3eae43f6950","Type":"ContainerStarted","Data":"7ce853a5bd786b66144140f7778bf8b841a3aa507efc9e6bf09480a624368794"} Jul 24 17:21:30.424103 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:30.423977 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w56p6" event={"ID":"85035b30-6f00-407e-99b1-c3eae43f6950","Type":"ContainerStarted","Data":"462c84c86ee244edcdbfdddce21fce25404bf404edb063e3e1c6379f52aa586b"} Jul 24 17:21:30.424103 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:30.424007 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w56p6" event={"ID":"85035b30-6f00-407e-99b1-c3eae43f6950","Type":"ContainerStarted","Data":"8fba67028ba70caa09ba150f9af9f395b8d138f8a5d56043fcbf2925559b2a07"} Jul 24 17:21:30.429394 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:30.429283 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8b8fb98bb-vpn46" Jul 24 17:21:30.480860 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:30.480828 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7654f97c47-td8x8"] Jul 24 17:21:32.435998 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:32.435822 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-svd9m" event={"ID":"aa0f5571-f91b-404f-b68d-08459015cf14","Type":"ContainerStarted","Data":"ba0a54e7f99dd0c269eb28e15d8f8d7a6a5a9bf9481a8b58d83ba2dc821b2078"} Jul 24 17:21:32.435998 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:32.435934 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-svd9m" event={"ID":"aa0f5571-f91b-404f-b68d-08459015cf14","Type":"ContainerStarted","Data":"da5f81bdc8d892a2ddf2b0dedf361062e8191e4524ba95209d573fc5691963df"} Jul 24 17:21:32.438779 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:32.438690 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w56p6" event={"ID":"85035b30-6f00-407e-99b1-c3eae43f6950","Type":"ContainerStarted","Data":"eb15c0e5477422f1dad56c42650c44def708d4a2ebbeb112397f6d103129e3ab"} Jul 24 17:21:32.440634 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:32.440522 2570 generic.go:356] "Generic (PLEG): container finished" podID="a3fef7c5-29be-4c9c-8f7e-c3256ed730b2" containerID="f373c3df309ea32c226a253741df24d33cac70e9c44384c2389c87be4b60dc03" exitCode=0 Jul 24 17:21:32.440634 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:32.440586 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bwxn7" event={"ID":"a3fef7c5-29be-4c9c-8f7e-c3256ed730b2","Type":"ContainerDied","Data":"f373c3df309ea32c226a253741df24d33cac70e9c44384c2389c87be4b60dc03"} Jul 24 17:21:32.482871 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:32.482487 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-w56p6" podStartSLOduration=2.56731852 podStartE2EDuration="4.482464749s" totalImagesPullingTime="1.915146229s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:21:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:21:32.480971859 +0000 UTC m=+88.149382896" watchObservedRunningTime="2026-07-24 17:21:32.482464749 +0000 UTC m=+88.150875777" Jul 24 17:21:33.447507 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:33.447473 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bwxn7" event={"ID":"a3fef7c5-29be-4c9c-8f7e-c3256ed730b2","Type":"ContainerStarted","Data":"96fac90db9e66cdfbbb3ea13b226efa4e6033137180009b141d37518f72455a7"} Jul 24 17:21:33.448057 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:33.447536 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bwxn7" event={"ID":"a3fef7c5-29be-4c9c-8f7e-c3256ed730b2","Type":"ContainerStarted","Data":"3efff0be2e11ab6c8731ebc6b6996ad664bc88b881e2ce1629fdaa16c0709e42"} Jul 24 17:21:33.450269 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:33.450235 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-svd9m" event={"ID":"aa0f5571-f91b-404f-b68d-08459015cf14","Type":"ContainerStarted","Data":"c91685818bf02054261ef64e11c38909dab011aae0ff7a73d1893c3d6638894b"} Jul 24 17:21:33.470262 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:33.470207 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bwxn7" podStartSLOduration=2.622063537 podStartE2EDuration="5.470187536s" totalImagesPullingTime="2.72413038s" totalInitContainerRuntime="123.993619ms" isStatefulPod=true podCreationTimestamp="2026-07-24 17:21:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:21:33.4689576 +0000 UTC m=+89.137368624" watchObservedRunningTime="2026-07-24 17:21:33.470187536 +0000 UTC m=+89.138598561" Jul 24 17:21:33.495607 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:33.495563 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-svd9m" podStartSLOduration=2.89728234 podStartE2EDuration="5.495547676s" totalImagesPullingTime="2.598265336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:21:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:21:33.49397143 +0000 UTC m=+89.162382490" watchObservedRunningTime="2026-07-24 17:21:33.495547676 +0000 UTC m=+89.163958700" Jul 24 17:21:34.110667 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:34.110634 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6b449d66d7-cvb9n"] Jul 24 17:21:34.154215 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:34.154184 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6b449d66d7-cvb9n"] Jul 24 17:21:34.154406 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:34.154371 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6b449d66d7-cvb9n" Jul 24 17:21:34.165851 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:34.165825 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 24 17:21:34.165969 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:34.165873 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 24 17:21:34.165969 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:34.165884 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 24 17:21:34.165969 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:34.165950 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 24 17:21:34.166253 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:34.166233 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 24 17:21:34.166438 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:34.166417 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-t6f8g\"" Jul 24 17:21:34.195782 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:34.195759 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 24 17:21:34.228421 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:34.228393 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4b9781aa-7018-4d87-9d63-d8a2c3c1b24d-federate-client-tls\") pod \"telemeter-client-6b449d66d7-cvb9n\" (UID: \"4b9781aa-7018-4d87-9d63-d8a2c3c1b24d\") " pod="openshift-monitoring/telemeter-client-6b449d66d7-cvb9n" Jul 24 17:21:34.228543 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:34.228424 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b9781aa-7018-4d87-9d63-d8a2c3c1b24d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6b449d66d7-cvb9n\" (UID: \"4b9781aa-7018-4d87-9d63-d8a2c3c1b24d\") " pod="openshift-monitoring/telemeter-client-6b449d66d7-cvb9n" Jul 24 17:21:34.228543 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:34.228489 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4b9781aa-7018-4d87-9d63-d8a2c3c1b24d-telemeter-client-tls\") pod \"telemeter-client-6b449d66d7-cvb9n\" (UID: \"4b9781aa-7018-4d87-9d63-d8a2c3c1b24d\") " pod="openshift-monitoring/telemeter-client-6b449d66d7-cvb9n" Jul 24 17:21:34.228647 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:34.228583 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b9781aa-7018-4d87-9d63-d8a2c3c1b24d-metrics-client-ca\") pod \"telemeter-client-6b449d66d7-cvb9n\" (UID: \"4b9781aa-7018-4d87-9d63-d8a2c3c1b24d\") " pod="openshift-monitoring/telemeter-client-6b449d66d7-cvb9n" Jul 24 17:21:34.228696 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:34.228643 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5h2sq\" (UniqueName: \"kubernetes.io/projected/4b9781aa-7018-4d87-9d63-d8a2c3c1b24d-kube-api-access-5h2sq\") pod \"telemeter-client-6b449d66d7-cvb9n\" (UID: \"4b9781aa-7018-4d87-9d63-d8a2c3c1b24d\") " pod="openshift-monitoring/telemeter-client-6b449d66d7-cvb9n" Jul 24 17:21:34.228696 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:34.228680 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4b9781aa-7018-4d87-9d63-d8a2c3c1b24d-secret-telemeter-client\") pod \"telemeter-client-6b449d66d7-cvb9n\" (UID: \"4b9781aa-7018-4d87-9d63-d8a2c3c1b24d\") " pod="openshift-monitoring/telemeter-client-6b449d66d7-cvb9n" Jul 24 17:21:34.228806 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:34.228744 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b9781aa-7018-4d87-9d63-d8a2c3c1b24d-serving-certs-ca-bundle\") pod \"telemeter-client-6b449d66d7-cvb9n\" (UID: \"4b9781aa-7018-4d87-9d63-d8a2c3c1b24d\") " pod="openshift-monitoring/telemeter-client-6b449d66d7-cvb9n" Jul 24 17:21:34.228806 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:34.228785 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4b9781aa-7018-4d87-9d63-d8a2c3c1b24d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6b449d66d7-cvb9n\" (UID: \"4b9781aa-7018-4d87-9d63-d8a2c3c1b24d\") " pod="openshift-monitoring/telemeter-client-6b449d66d7-cvb9n" Jul 24 17:21:34.330206 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:34.330165 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4b9781aa-7018-4d87-9d63-d8a2c3c1b24d-federate-client-tls\") pod \"telemeter-client-6b449d66d7-cvb9n\" (UID: \"4b9781aa-7018-4d87-9d63-d8a2c3c1b24d\") " pod="openshift-monitoring/telemeter-client-6b449d66d7-cvb9n" Jul 24 17:21:34.330387 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:34.330217 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b9781aa-7018-4d87-9d63-d8a2c3c1b24d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6b449d66d7-cvb9n\" (UID: \"4b9781aa-7018-4d87-9d63-d8a2c3c1b24d\") " pod="openshift-monitoring/telemeter-client-6b449d66d7-cvb9n" Jul 24 17:21:34.330458 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:34.330382 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4b9781aa-7018-4d87-9d63-d8a2c3c1b24d-telemeter-client-tls\") pod \"telemeter-client-6b449d66d7-cvb9n\" (UID: \"4b9781aa-7018-4d87-9d63-d8a2c3c1b24d\") " pod="openshift-monitoring/telemeter-client-6b449d66d7-cvb9n" Jul 24 17:21:34.330458 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:34.330433 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b9781aa-7018-4d87-9d63-d8a2c3c1b24d-metrics-client-ca\") pod \"telemeter-client-6b449d66d7-cvb9n\" (UID: \"4b9781aa-7018-4d87-9d63-d8a2c3c1b24d\") " pod="openshift-monitoring/telemeter-client-6b449d66d7-cvb9n" Jul 24 17:21:34.330571 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:34.330487 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5h2sq\" (UniqueName: \"kubernetes.io/projected/4b9781aa-7018-4d87-9d63-d8a2c3c1b24d-kube-api-access-5h2sq\") pod \"telemeter-client-6b449d66d7-cvb9n\" (UID: \"4b9781aa-7018-4d87-9d63-d8a2c3c1b24d\") " pod="openshift-monitoring/telemeter-client-6b449d66d7-cvb9n" Jul 24 17:21:34.330571 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:34.330528 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4b9781aa-7018-4d87-9d63-d8a2c3c1b24d-secret-telemeter-client\") pod \"telemeter-client-6b449d66d7-cvb9n\" (UID: \"4b9781aa-7018-4d87-9d63-d8a2c3c1b24d\") " pod="openshift-monitoring/telemeter-client-6b449d66d7-cvb9n" Jul 24 17:21:34.330571 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:34.330558 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b9781aa-7018-4d87-9d63-d8a2c3c1b24d-serving-certs-ca-bundle\") pod \"telemeter-client-6b449d66d7-cvb9n\" (UID: \"4b9781aa-7018-4d87-9d63-d8a2c3c1b24d\") " pod="openshift-monitoring/telemeter-client-6b449d66d7-cvb9n" Jul 24 17:21:34.330712 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:34.330594 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4b9781aa-7018-4d87-9d63-d8a2c3c1b24d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6b449d66d7-cvb9n\" (UID: \"4b9781aa-7018-4d87-9d63-d8a2c3c1b24d\") " pod="openshift-monitoring/telemeter-client-6b449d66d7-cvb9n" Jul 24 17:21:34.331166 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:34.331142 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b9781aa-7018-4d87-9d63-d8a2c3c1b24d-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6b449d66d7-cvb9n\" (UID: \"4b9781aa-7018-4d87-9d63-d8a2c3c1b24d\") " pod="openshift-monitoring/telemeter-client-6b449d66d7-cvb9n" Jul 24 17:21:34.331293 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:34.331218 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b9781aa-7018-4d87-9d63-d8a2c3c1b24d-serving-certs-ca-bundle\") pod \"telemeter-client-6b449d66d7-cvb9n\" (UID: \"4b9781aa-7018-4d87-9d63-d8a2c3c1b24d\") " pod="openshift-monitoring/telemeter-client-6b449d66d7-cvb9n" Jul 24 17:21:34.331656 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:34.331628 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b9781aa-7018-4d87-9d63-d8a2c3c1b24d-metrics-client-ca\") pod \"telemeter-client-6b449d66d7-cvb9n\" (UID: \"4b9781aa-7018-4d87-9d63-d8a2c3c1b24d\") " pod="openshift-monitoring/telemeter-client-6b449d66d7-cvb9n" Jul 24 17:21:34.333532 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:34.333489 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4b9781aa-7018-4d87-9d63-d8a2c3c1b24d-federate-client-tls\") pod \"telemeter-client-6b449d66d7-cvb9n\" (UID: \"4b9781aa-7018-4d87-9d63-d8a2c3c1b24d\") " pod="openshift-monitoring/telemeter-client-6b449d66d7-cvb9n" Jul 24 17:21:34.334198 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:34.334172 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4b9781aa-7018-4d87-9d63-d8a2c3c1b24d-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6b449d66d7-cvb9n\" (UID: \"4b9781aa-7018-4d87-9d63-d8a2c3c1b24d\") " pod="openshift-monitoring/telemeter-client-6b449d66d7-cvb9n" Jul 24 17:21:34.334299 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:34.334172 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4b9781aa-7018-4d87-9d63-d8a2c3c1b24d-telemeter-client-tls\") pod \"telemeter-client-6b449d66d7-cvb9n\" (UID: \"4b9781aa-7018-4d87-9d63-d8a2c3c1b24d\") " pod="openshift-monitoring/telemeter-client-6b449d66d7-cvb9n" Jul 24 17:21:34.334299 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:34.334263 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4b9781aa-7018-4d87-9d63-d8a2c3c1b24d-secret-telemeter-client\") pod \"telemeter-client-6b449d66d7-cvb9n\" (UID: \"4b9781aa-7018-4d87-9d63-d8a2c3c1b24d\") " pod="openshift-monitoring/telemeter-client-6b449d66d7-cvb9n" Jul 24 17:21:34.339824 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:34.339805 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5h2sq\" (UniqueName: \"kubernetes.io/projected/4b9781aa-7018-4d87-9d63-d8a2c3c1b24d-kube-api-access-5h2sq\") pod \"telemeter-client-6b449d66d7-cvb9n\" (UID: \"4b9781aa-7018-4d87-9d63-d8a2c3c1b24d\") " pod="openshift-monitoring/telemeter-client-6b449d66d7-cvb9n" Jul 24 17:21:34.465372 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:34.465278 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6b449d66d7-cvb9n" Jul 24 17:21:34.642112 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:34.642084 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6b449d66d7-cvb9n"] Jul 24 17:21:34.643948 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:21:34.643918 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b9781aa_7018_4d87_9d63_d8a2c3c1b24d.slice/crio-5201880345e36c8c098bd1aede4f292cdcd0983e9d643336a620e7473d868268 WatchSource:0}: Error finding container 5201880345e36c8c098bd1aede4f292cdcd0983e9d643336a620e7473d868268: Status 404 returned error can't find the container with id 5201880345e36c8c098bd1aede4f292cdcd0983e9d643336a620e7473d868268 Jul 24 17:21:35.460191 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:35.460153 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b449d66d7-cvb9n" event={"ID":"4b9781aa-7018-4d87-9d63-d8a2c3c1b24d","Type":"ContainerStarted","Data":"5201880345e36c8c098bd1aede4f292cdcd0983e9d643336a620e7473d868268"} Jul 24 17:21:37.470760 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:37.470728 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b449d66d7-cvb9n" event={"ID":"4b9781aa-7018-4d87-9d63-d8a2c3c1b24d","Type":"ContainerStarted","Data":"87b1935585320d83797a2d8d4270b4e143c8c8bb8c7316bbe1ccf50154d70afb"} Jul 24 17:21:39.480647 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:39.480613 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b449d66d7-cvb9n" event={"ID":"4b9781aa-7018-4d87-9d63-d8a2c3c1b24d","Type":"ContainerStarted","Data":"5252c5945cb6c3f3f48cab0e48b091aea0ea485daa545ac8b6068fca22793137"} Jul 24 17:21:39.481038 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:39.480672 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6b449d66d7-cvb9n" event={"ID":"4b9781aa-7018-4d87-9d63-d8a2c3c1b24d","Type":"ContainerStarted","Data":"1382cc03339c9a3b8c0a42f6ff94785eba2ab0468953aa998336f450868153dd"} Jul 24 17:21:39.505995 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:39.505955 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6b449d66d7-cvb9n" podStartSLOduration=1.6697424490000001 podStartE2EDuration="5.505937384s" totalImagesPullingTime="3.836194935s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:21:34 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:21:39.505810792 +0000 UTC m=+95.174221816" watchObservedRunningTime="2026-07-24 17:21:39.505937384 +0000 UTC m=+95.174348411" Jul 24 17:21:40.241526 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:40.241497 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c79c6fdfc-d7d6g"] Jul 24 17:21:40.263990 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:40.263967 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c79c6fdfc-d7d6g" Jul 24 17:21:40.276520 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:40.276493 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c79c6fdfc-d7d6g"] Jul 24 17:21:40.382380 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:40.382326 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0cfb1f6-7db1-46a5-9950-dec847b4df43-console-config\") pod \"console-7c79c6fdfc-d7d6g\" (UID: \"a0cfb1f6-7db1-46a5-9950-dec847b4df43\") " pod="openshift-console/console-7c79c6fdfc-d7d6g" Jul 24 17:21:40.382541 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:40.382389 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0cfb1f6-7db1-46a5-9950-dec847b4df43-trusted-ca-bundle\") pod \"console-7c79c6fdfc-d7d6g\" (UID: \"a0cfb1f6-7db1-46a5-9950-dec847b4df43\") " pod="openshift-console/console-7c79c6fdfc-d7d6g" Jul 24 17:21:40.382541 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:40.382417 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0cfb1f6-7db1-46a5-9950-dec847b4df43-service-ca\") pod \"console-7c79c6fdfc-d7d6g\" (UID: \"a0cfb1f6-7db1-46a5-9950-dec847b4df43\") " pod="openshift-console/console-7c79c6fdfc-d7d6g" Jul 24 17:21:40.382541 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:40.382449 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wtmg\" (UniqueName: \"kubernetes.io/projected/a0cfb1f6-7db1-46a5-9950-dec847b4df43-kube-api-access-6wtmg\") pod \"console-7c79c6fdfc-d7d6g\" (UID: \"a0cfb1f6-7db1-46a5-9950-dec847b4df43\") " pod="openshift-console/console-7c79c6fdfc-d7d6g" Jul 24 17:21:40.382541 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:40.382485 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0cfb1f6-7db1-46a5-9950-dec847b4df43-console-oauth-config\") pod \"console-7c79c6fdfc-d7d6g\" (UID: \"a0cfb1f6-7db1-46a5-9950-dec847b4df43\") " pod="openshift-console/console-7c79c6fdfc-d7d6g" Jul 24 17:21:40.382541 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:40.382509 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0cfb1f6-7db1-46a5-9950-dec847b4df43-console-serving-cert\") pod \"console-7c79c6fdfc-d7d6g\" (UID: \"a0cfb1f6-7db1-46a5-9950-dec847b4df43\") " pod="openshift-console/console-7c79c6fdfc-d7d6g" Jul 24 17:21:40.382541 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:40.382532 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0cfb1f6-7db1-46a5-9950-dec847b4df43-oauth-serving-cert\") pod \"console-7c79c6fdfc-d7d6g\" (UID: \"a0cfb1f6-7db1-46a5-9950-dec847b4df43\") " pod="openshift-console/console-7c79c6fdfc-d7d6g" Jul 24 17:21:40.486202 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:40.486158 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wtmg\" (UniqueName: \"kubernetes.io/projected/a0cfb1f6-7db1-46a5-9950-dec847b4df43-kube-api-access-6wtmg\") pod \"console-7c79c6fdfc-d7d6g\" (UID: \"a0cfb1f6-7db1-46a5-9950-dec847b4df43\") " pod="openshift-console/console-7c79c6fdfc-d7d6g" Jul 24 17:21:40.486740 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:40.486221 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0cfb1f6-7db1-46a5-9950-dec847b4df43-console-oauth-config\") pod \"console-7c79c6fdfc-d7d6g\" (UID: \"a0cfb1f6-7db1-46a5-9950-dec847b4df43\") " pod="openshift-console/console-7c79c6fdfc-d7d6g" Jul 24 17:21:40.486740 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:40.486252 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0cfb1f6-7db1-46a5-9950-dec847b4df43-console-serving-cert\") pod \"console-7c79c6fdfc-d7d6g\" (UID: \"a0cfb1f6-7db1-46a5-9950-dec847b4df43\") " pod="openshift-console/console-7c79c6fdfc-d7d6g" Jul 24 17:21:40.486740 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:40.486288 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0cfb1f6-7db1-46a5-9950-dec847b4df43-oauth-serving-cert\") pod \"console-7c79c6fdfc-d7d6g\" (UID: \"a0cfb1f6-7db1-46a5-9950-dec847b4df43\") " pod="openshift-console/console-7c79c6fdfc-d7d6g" Jul 24 17:21:40.486740 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:40.486376 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0cfb1f6-7db1-46a5-9950-dec847b4df43-console-config\") pod \"console-7c79c6fdfc-d7d6g\" (UID: \"a0cfb1f6-7db1-46a5-9950-dec847b4df43\") " pod="openshift-console/console-7c79c6fdfc-d7d6g" Jul 24 17:21:40.486740 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:40.486406 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0cfb1f6-7db1-46a5-9950-dec847b4df43-trusted-ca-bundle\") pod \"console-7c79c6fdfc-d7d6g\" (UID: \"a0cfb1f6-7db1-46a5-9950-dec847b4df43\") " pod="openshift-console/console-7c79c6fdfc-d7d6g" Jul 24 17:21:40.486740 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:40.486434 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0cfb1f6-7db1-46a5-9950-dec847b4df43-service-ca\") pod \"console-7c79c6fdfc-d7d6g\" (UID: \"a0cfb1f6-7db1-46a5-9950-dec847b4df43\") " pod="openshift-console/console-7c79c6fdfc-d7d6g" Jul 24 17:21:40.487388 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:40.487173 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0cfb1f6-7db1-46a5-9950-dec847b4df43-service-ca\") pod \"console-7c79c6fdfc-d7d6g\" (UID: \"a0cfb1f6-7db1-46a5-9950-dec847b4df43\") " pod="openshift-console/console-7c79c6fdfc-d7d6g" Jul 24 17:21:40.488269 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:40.487974 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0cfb1f6-7db1-46a5-9950-dec847b4df43-console-config\") pod \"console-7c79c6fdfc-d7d6g\" (UID: \"a0cfb1f6-7db1-46a5-9950-dec847b4df43\") " pod="openshift-console/console-7c79c6fdfc-d7d6g" Jul 24 17:21:40.488390 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:40.488271 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0cfb1f6-7db1-46a5-9950-dec847b4df43-trusted-ca-bundle\") pod \"console-7c79c6fdfc-d7d6g\" (UID: \"a0cfb1f6-7db1-46a5-9950-dec847b4df43\") " pod="openshift-console/console-7c79c6fdfc-d7d6g" Jul 24 17:21:40.489048 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:40.489024 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0cfb1f6-7db1-46a5-9950-dec847b4df43-oauth-serving-cert\") pod \"console-7c79c6fdfc-d7d6g\" (UID: \"a0cfb1f6-7db1-46a5-9950-dec847b4df43\") " pod="openshift-console/console-7c79c6fdfc-d7d6g" Jul 24 17:21:40.490454 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:40.490435 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0cfb1f6-7db1-46a5-9950-dec847b4df43-console-oauth-config\") pod \"console-7c79c6fdfc-d7d6g\" (UID: \"a0cfb1f6-7db1-46a5-9950-dec847b4df43\") " pod="openshift-console/console-7c79c6fdfc-d7d6g" Jul 24 17:21:40.490788 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:40.490767 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0cfb1f6-7db1-46a5-9950-dec847b4df43-console-serving-cert\") pod \"console-7c79c6fdfc-d7d6g\" (UID: \"a0cfb1f6-7db1-46a5-9950-dec847b4df43\") " pod="openshift-console/console-7c79c6fdfc-d7d6g" Jul 24 17:21:40.495293 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:40.495240 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wtmg\" (UniqueName: \"kubernetes.io/projected/a0cfb1f6-7db1-46a5-9950-dec847b4df43-kube-api-access-6wtmg\") pod \"console-7c79c6fdfc-d7d6g\" (UID: \"a0cfb1f6-7db1-46a5-9950-dec847b4df43\") " pod="openshift-console/console-7c79c6fdfc-d7d6g" Jul 24 17:21:40.574968 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:40.574935 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c79c6fdfc-d7d6g" Jul 24 17:21:40.734578 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:40.732445 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c79c6fdfc-d7d6g"] Jul 24 17:21:41.496038 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:41.495995 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c79c6fdfc-d7d6g" event={"ID":"a0cfb1f6-7db1-46a5-9950-dec847b4df43","Type":"ContainerStarted","Data":"52170a9d7c00dd3407d8c00662bc7240a480b1b7d7b9b27b84551bfaa8b63519"} Jul 24 17:21:41.496556 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:41.496055 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c79c6fdfc-d7d6g" event={"ID":"a0cfb1f6-7db1-46a5-9950-dec847b4df43","Type":"ContainerStarted","Data":"f77d4e67fee7c2a461fa1800702f2e2bd0ea2714b48e8282dfbc07949cca8be2"} Jul 24 17:21:41.530536 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:41.530485 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c79c6fdfc-d7d6g" podStartSLOduration=1.530469257 podStartE2EDuration="1.530469257s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:21:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:21:41.529834297 +0000 UTC m=+97.198245320" watchObservedRunningTime="2026-07-24 17:21:41.530469257 +0000 UTC m=+97.198880281" Jul 24 17:21:45.347082 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:45.347056 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-nsllf" Jul 24 17:21:50.575559 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:50.575528 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c79c6fdfc-d7d6g" Jul 24 17:21:50.575989 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:50.575582 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c79c6fdfc-d7d6g" Jul 24 17:21:50.580276 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:50.580256 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c79c6fdfc-d7d6g" Jul 24 17:21:51.536643 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:51.536606 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c79c6fdfc-d7d6g" Jul 24 17:21:51.586628 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:51.586570 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8b8fb98bb-vpn46"] Jul 24 17:21:56.454799 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:56.454739 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7654f97c47-td8x8" podUID="c1d69734-b0b9-4ef3-bc8e-b423be5cea80" containerName="console" containerID="cri-o://2e837d1c82a46fa1e92e38c9cba0cf064b0edb51bb85237f1947d82f1cd3cca6" gracePeriod=15 Jul 24 17:21:56.693725 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:56.693704 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7654f97c47-td8x8" Jul 24 17:21:56.807778 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:56.807699 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c1d69734-b0b9-4ef3-bc8e-b423be5cea80-console-oauth-config\") pod \"c1d69734-b0b9-4ef3-bc8e-b423be5cea80\" (UID: \"c1d69734-b0b9-4ef3-bc8e-b423be5cea80\") " Jul 24 17:21:56.807778 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:56.807759 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c1d69734-b0b9-4ef3-bc8e-b423be5cea80-console-config\") pod \"c1d69734-b0b9-4ef3-bc8e-b423be5cea80\" (UID: \"c1d69734-b0b9-4ef3-bc8e-b423be5cea80\") " Jul 24 17:21:56.807969 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:56.807798 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c1d69734-b0b9-4ef3-bc8e-b423be5cea80-service-ca\") pod \"c1d69734-b0b9-4ef3-bc8e-b423be5cea80\" (UID: \"c1d69734-b0b9-4ef3-bc8e-b423be5cea80\") " Jul 24 17:21:56.807969 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:56.807822 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c1d69734-b0b9-4ef3-bc8e-b423be5cea80-console-serving-cert\") pod \"c1d69734-b0b9-4ef3-bc8e-b423be5cea80\" (UID: \"c1d69734-b0b9-4ef3-bc8e-b423be5cea80\") " Jul 24 17:21:56.807969 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:56.807850 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txqvz\" (UniqueName: \"kubernetes.io/projected/c1d69734-b0b9-4ef3-bc8e-b423be5cea80-kube-api-access-txqvz\") pod \"c1d69734-b0b9-4ef3-bc8e-b423be5cea80\" (UID: \"c1d69734-b0b9-4ef3-bc8e-b423be5cea80\") " Jul 24 17:21:56.807969 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:56.807886 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c1d69734-b0b9-4ef3-bc8e-b423be5cea80-oauth-serving-cert\") pod \"c1d69734-b0b9-4ef3-bc8e-b423be5cea80\" (UID: \"c1d69734-b0b9-4ef3-bc8e-b423be5cea80\") " Jul 24 17:21:56.808258 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:56.808229 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1d69734-b0b9-4ef3-bc8e-b423be5cea80-service-ca" (OuterVolumeSpecName: "service-ca") pod "c1d69734-b0b9-4ef3-bc8e-b423be5cea80" (UID: "c1d69734-b0b9-4ef3-bc8e-b423be5cea80"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 17:21:56.808258 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:56.808157 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1d69734-b0b9-4ef3-bc8e-b423be5cea80-console-config" (OuterVolumeSpecName: "console-config") pod "c1d69734-b0b9-4ef3-bc8e-b423be5cea80" (UID: "c1d69734-b0b9-4ef3-bc8e-b423be5cea80"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 17:21:56.808655 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:56.808300 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c1d69734-b0b9-4ef3-bc8e-b423be5cea80-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c1d69734-b0b9-4ef3-bc8e-b423be5cea80" (UID: "c1d69734-b0b9-4ef3-bc8e-b423be5cea80"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 17:21:56.810235 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:56.810205 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1d69734-b0b9-4ef3-bc8e-b423be5cea80-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c1d69734-b0b9-4ef3-bc8e-b423be5cea80" (UID: "c1d69734-b0b9-4ef3-bc8e-b423be5cea80"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 17:21:56.810364 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:56.810272 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c1d69734-b0b9-4ef3-bc8e-b423be5cea80-kube-api-access-txqvz" (OuterVolumeSpecName: "kube-api-access-txqvz") pod "c1d69734-b0b9-4ef3-bc8e-b423be5cea80" (UID: "c1d69734-b0b9-4ef3-bc8e-b423be5cea80"). InnerVolumeSpecName "kube-api-access-txqvz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 17:21:56.810364 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:56.810276 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c1d69734-b0b9-4ef3-bc8e-b423be5cea80-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c1d69734-b0b9-4ef3-bc8e-b423be5cea80" (UID: "c1d69734-b0b9-4ef3-bc8e-b423be5cea80"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 17:21:56.909367 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:56.909321 2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c1d69734-b0b9-4ef3-bc8e-b423be5cea80-service-ca\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:21:56.909463 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:56.909369 2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c1d69734-b0b9-4ef3-bc8e-b423be5cea80-console-serving-cert\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:21:56.909463 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:56.909379 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txqvz\" (UniqueName: \"kubernetes.io/projected/c1d69734-b0b9-4ef3-bc8e-b423be5cea80-kube-api-access-txqvz\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:21:56.909463 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:56.909390 2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c1d69734-b0b9-4ef3-bc8e-b423be5cea80-oauth-serving-cert\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:21:56.909463 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:56.909398 2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c1d69734-b0b9-4ef3-bc8e-b423be5cea80-console-oauth-config\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:21:56.909463 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:56.909406 2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c1d69734-b0b9-4ef3-bc8e-b423be5cea80-console-config\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:21:57.558852 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:57.558819 2570 generic.go:356] "Generic (PLEG): container finished" podID="c1d69734-b0b9-4ef3-bc8e-b423be5cea80" containerID="2e837d1c82a46fa1e92e38c9cba0cf064b0edb51bb85237f1947d82f1cd3cca6" exitCode=0 Jul 24 17:21:57.559229 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:57.558864 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7654f97c47-td8x8" Jul 24 17:21:57.559229 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:57.558881 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7654f97c47-td8x8" event={"ID":"c1d69734-b0b9-4ef3-bc8e-b423be5cea80","Type":"ContainerDied","Data":"2e837d1c82a46fa1e92e38c9cba0cf064b0edb51bb85237f1947d82f1cd3cca6"} Jul 24 17:21:57.559229 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:57.558923 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7654f97c47-td8x8" event={"ID":"c1d69734-b0b9-4ef3-bc8e-b423be5cea80","Type":"ContainerDied","Data":"988045a20f378e8a02f942e9d50657f01ca8830eb42c58755380a0d75f62c4a8"} Jul 24 17:21:57.559229 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:57.558942 2570 scope.go:117] "RemoveContainer" containerID="2e837d1c82a46fa1e92e38c9cba0cf064b0edb51bb85237f1947d82f1cd3cca6" Jul 24 17:21:57.569210 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:57.569195 2570 scope.go:117] "RemoveContainer" containerID="2e837d1c82a46fa1e92e38c9cba0cf064b0edb51bb85237f1947d82f1cd3cca6" Jul 24 17:21:57.569504 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:21:57.569483 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e837d1c82a46fa1e92e38c9cba0cf064b0edb51bb85237f1947d82f1cd3cca6\": container with ID starting with 2e837d1c82a46fa1e92e38c9cba0cf064b0edb51bb85237f1947d82f1cd3cca6 not found: ID does not exist" containerID="2e837d1c82a46fa1e92e38c9cba0cf064b0edb51bb85237f1947d82f1cd3cca6" Jul 24 17:21:57.569574 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:57.569511 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e837d1c82a46fa1e92e38c9cba0cf064b0edb51bb85237f1947d82f1cd3cca6"} err="failed to get container status \"2e837d1c82a46fa1e92e38c9cba0cf064b0edb51bb85237f1947d82f1cd3cca6\": rpc error: code = NotFound desc = could not find container \"2e837d1c82a46fa1e92e38c9cba0cf064b0edb51bb85237f1947d82f1cd3cca6\": container with ID starting with 2e837d1c82a46fa1e92e38c9cba0cf064b0edb51bb85237f1947d82f1cd3cca6 not found: ID does not exist" Jul 24 17:21:57.587683 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:57.587662 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7654f97c47-td8x8"] Jul 24 17:21:57.595928 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:57.595905 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7654f97c47-td8x8"] Jul 24 17:21:58.912885 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:21:58.912846 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c1d69734-b0b9-4ef3-bc8e-b423be5cea80" path="/var/lib/kubelet/pods/c1d69734-b0b9-4ef3-bc8e-b423be5cea80/volumes" Jul 24 17:22:16.609035 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:16.608968 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-8b8fb98bb-vpn46" podUID="76386c7f-1505-4002-8955-a6335ffde6e5" containerName="console" containerID="cri-o://73249a3fee7c95f53e1aaeadcf6d3ae0f1d222c3336a7074cecb63224b611ef2" gracePeriod=15 Jul 24 17:22:16.882576 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:16.882515 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b8fb98bb-vpn46" Jul 24 17:22:16.952145 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:16.952114 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76386c7f-1505-4002-8955-a6335ffde6e5-console-config\") pod \"76386c7f-1505-4002-8955-a6335ffde6e5\" (UID: \"76386c7f-1505-4002-8955-a6335ffde6e5\") " Jul 24 17:22:16.952314 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:16.952154 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76386c7f-1505-4002-8955-a6335ffde6e5-console-serving-cert\") pod \"76386c7f-1505-4002-8955-a6335ffde6e5\" (UID: \"76386c7f-1505-4002-8955-a6335ffde6e5\") " Jul 24 17:22:16.952314 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:16.952188 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76386c7f-1505-4002-8955-a6335ffde6e5-console-oauth-config\") pod \"76386c7f-1505-4002-8955-a6335ffde6e5\" (UID: \"76386c7f-1505-4002-8955-a6335ffde6e5\") " Jul 24 17:22:16.952314 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:16.952209 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76386c7f-1505-4002-8955-a6335ffde6e5-trusted-ca-bundle\") pod \"76386c7f-1505-4002-8955-a6335ffde6e5\" (UID: \"76386c7f-1505-4002-8955-a6335ffde6e5\") " Jul 24 17:22:16.952314 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:16.952232 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76386c7f-1505-4002-8955-a6335ffde6e5-oauth-serving-cert\") pod \"76386c7f-1505-4002-8955-a6335ffde6e5\" (UID: \"76386c7f-1505-4002-8955-a6335ffde6e5\") " Jul 24 17:22:16.952314 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:16.952277 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76386c7f-1505-4002-8955-a6335ffde6e5-service-ca\") pod \"76386c7f-1505-4002-8955-a6335ffde6e5\" (UID: \"76386c7f-1505-4002-8955-a6335ffde6e5\") " Jul 24 17:22:16.952590 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:16.952316 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5kptv\" (UniqueName: \"kubernetes.io/projected/76386c7f-1505-4002-8955-a6335ffde6e5-kube-api-access-5kptv\") pod \"76386c7f-1505-4002-8955-a6335ffde6e5\" (UID: \"76386c7f-1505-4002-8955-a6335ffde6e5\") " Jul 24 17:22:16.952590 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:16.952549 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76386c7f-1505-4002-8955-a6335ffde6e5-console-config" (OuterVolumeSpecName: "console-config") pod "76386c7f-1505-4002-8955-a6335ffde6e5" (UID: "76386c7f-1505-4002-8955-a6335ffde6e5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 17:22:16.952723 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:16.952695 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76386c7f-1505-4002-8955-a6335ffde6e5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "76386c7f-1505-4002-8955-a6335ffde6e5" (UID: "76386c7f-1505-4002-8955-a6335ffde6e5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 17:22:16.952779 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:16.952724 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76386c7f-1505-4002-8955-a6335ffde6e5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "76386c7f-1505-4002-8955-a6335ffde6e5" (UID: "76386c7f-1505-4002-8955-a6335ffde6e5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 17:22:16.952827 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:16.952767 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76386c7f-1505-4002-8955-a6335ffde6e5-service-ca" (OuterVolumeSpecName: "service-ca") pod "76386c7f-1505-4002-8955-a6335ffde6e5" (UID: "76386c7f-1505-4002-8955-a6335ffde6e5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 17:22:16.952971 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:16.952956 2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/76386c7f-1505-4002-8955-a6335ffde6e5-service-ca\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:22:16.953030 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:16.952975 2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/76386c7f-1505-4002-8955-a6335ffde6e5-console-config\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:22:16.953030 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:16.952984 2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/76386c7f-1505-4002-8955-a6335ffde6e5-trusted-ca-bundle\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:22:16.953030 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:16.952993 2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/76386c7f-1505-4002-8955-a6335ffde6e5-oauth-serving-cert\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:22:16.954818 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:16.954791 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76386c7f-1505-4002-8955-a6335ffde6e5-kube-api-access-5kptv" (OuterVolumeSpecName: "kube-api-access-5kptv") pod "76386c7f-1505-4002-8955-a6335ffde6e5" (UID: "76386c7f-1505-4002-8955-a6335ffde6e5"). InnerVolumeSpecName "kube-api-access-5kptv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 17:22:16.955044 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:16.955025 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76386c7f-1505-4002-8955-a6335ffde6e5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "76386c7f-1505-4002-8955-a6335ffde6e5" (UID: "76386c7f-1505-4002-8955-a6335ffde6e5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 17:22:16.955121 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:16.955102 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/76386c7f-1505-4002-8955-a6335ffde6e5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "76386c7f-1505-4002-8955-a6335ffde6e5" (UID: "76386c7f-1505-4002-8955-a6335ffde6e5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 17:22:17.053911 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:17.053891 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5kptv\" (UniqueName: \"kubernetes.io/projected/76386c7f-1505-4002-8955-a6335ffde6e5-kube-api-access-5kptv\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:22:17.053911 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:17.053909 2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/76386c7f-1505-4002-8955-a6335ffde6e5-console-serving-cert\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:22:17.054047 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:17.053918 2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/76386c7f-1505-4002-8955-a6335ffde6e5-console-oauth-config\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:22:17.647664 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:17.647627 2570 generic.go:356] "Generic (PLEG): container finished" podID="76386c7f-1505-4002-8955-a6335ffde6e5" containerID="73249a3fee7c95f53e1aaeadcf6d3ae0f1d222c3336a7074cecb63224b611ef2" exitCode=0 Jul 24 17:22:17.648045 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:17.647676 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8b8fb98bb-vpn46" Jul 24 17:22:17.648045 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:17.647675 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b8fb98bb-vpn46" event={"ID":"76386c7f-1505-4002-8955-a6335ffde6e5","Type":"ContainerDied","Data":"73249a3fee7c95f53e1aaeadcf6d3ae0f1d222c3336a7074cecb63224b611ef2"} Jul 24 17:22:17.648045 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:17.647805 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8b8fb98bb-vpn46" event={"ID":"76386c7f-1505-4002-8955-a6335ffde6e5","Type":"ContainerDied","Data":"2882e8ef9e39945707358bdec62600f7422afd3a4616cecb2146eec5c11665db"} Jul 24 17:22:17.648045 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:17.647837 2570 scope.go:117] "RemoveContainer" containerID="73249a3fee7c95f53e1aaeadcf6d3ae0f1d222c3336a7074cecb63224b611ef2" Jul 24 17:22:17.661762 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:17.661746 2570 scope.go:117] "RemoveContainer" containerID="73249a3fee7c95f53e1aaeadcf6d3ae0f1d222c3336a7074cecb63224b611ef2" Jul 24 17:22:17.662002 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:22:17.661984 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73249a3fee7c95f53e1aaeadcf6d3ae0f1d222c3336a7074cecb63224b611ef2\": container with ID starting with 73249a3fee7c95f53e1aaeadcf6d3ae0f1d222c3336a7074cecb63224b611ef2 not found: ID does not exist" containerID="73249a3fee7c95f53e1aaeadcf6d3ae0f1d222c3336a7074cecb63224b611ef2" Jul 24 17:22:17.662062 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:17.662015 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73249a3fee7c95f53e1aaeadcf6d3ae0f1d222c3336a7074cecb63224b611ef2"} err="failed to get container status \"73249a3fee7c95f53e1aaeadcf6d3ae0f1d222c3336a7074cecb63224b611ef2\": rpc error: code = NotFound desc = could not find container \"73249a3fee7c95f53e1aaeadcf6d3ae0f1d222c3336a7074cecb63224b611ef2\": container with ID starting with 73249a3fee7c95f53e1aaeadcf6d3ae0f1d222c3336a7074cecb63224b611ef2 not found: ID does not exist" Jul 24 17:22:17.668819 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:17.668796 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-8b8fb98bb-vpn46"] Jul 24 17:22:17.672654 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:17.672635 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-8b8fb98bb-vpn46"] Jul 24 17:22:18.912258 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:18.912212 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76386c7f-1505-4002-8955-a6335ffde6e5" path="/var/lib/kubelet/pods/76386c7f-1505-4002-8955-a6335ffde6e5/volumes" Jul 24 17:22:47.957737 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:47.957706 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-786b854969-wv4p4"] Jul 24 17:22:47.958170 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:47.957995 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c1d69734-b0b9-4ef3-bc8e-b423be5cea80" containerName="console" Jul 24 17:22:47.958170 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:47.958009 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="c1d69734-b0b9-4ef3-bc8e-b423be5cea80" containerName="console" Jul 24 17:22:47.958170 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:47.958026 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76386c7f-1505-4002-8955-a6335ffde6e5" containerName="console" Jul 24 17:22:47.958170 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:47.958031 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="76386c7f-1505-4002-8955-a6335ffde6e5" containerName="console" Jul 24 17:22:47.958170 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:47.958077 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="76386c7f-1505-4002-8955-a6335ffde6e5" containerName="console" Jul 24 17:22:47.958170 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:47.958086 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="c1d69734-b0b9-4ef3-bc8e-b423be5cea80" containerName="console" Jul 24 17:22:47.960518 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:47.960502 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-786b854969-wv4p4" Jul 24 17:22:47.988408 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:47.988376 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-786b854969-wv4p4"] Jul 24 17:22:48.081037 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:48.081007 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8bcd125-2d3a-4176-aead-97a2d3aae766-oauth-serving-cert\") pod \"console-786b854969-wv4p4\" (UID: \"a8bcd125-2d3a-4176-aead-97a2d3aae766\") " pod="openshift-console/console-786b854969-wv4p4" Jul 24 17:22:48.081182 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:48.081048 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8bcd125-2d3a-4176-aead-97a2d3aae766-console-serving-cert\") pod \"console-786b854969-wv4p4\" (UID: \"a8bcd125-2d3a-4176-aead-97a2d3aae766\") " pod="openshift-console/console-786b854969-wv4p4" Jul 24 17:22:48.081182 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:48.081084 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8bcd125-2d3a-4176-aead-97a2d3aae766-trusted-ca-bundle\") pod \"console-786b854969-wv4p4\" (UID: \"a8bcd125-2d3a-4176-aead-97a2d3aae766\") " pod="openshift-console/console-786b854969-wv4p4" Jul 24 17:22:48.081182 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:48.081129 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8bcd125-2d3a-4176-aead-97a2d3aae766-console-config\") pod \"console-786b854969-wv4p4\" (UID: \"a8bcd125-2d3a-4176-aead-97a2d3aae766\") " pod="openshift-console/console-786b854969-wv4p4" Jul 24 17:22:48.081371 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:48.081177 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8bcd125-2d3a-4176-aead-97a2d3aae766-service-ca\") pod \"console-786b854969-wv4p4\" (UID: \"a8bcd125-2d3a-4176-aead-97a2d3aae766\") " pod="openshift-console/console-786b854969-wv4p4" Jul 24 17:22:48.081371 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:48.081214 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qtpc\" (UniqueName: \"kubernetes.io/projected/a8bcd125-2d3a-4176-aead-97a2d3aae766-kube-api-access-9qtpc\") pod \"console-786b854969-wv4p4\" (UID: \"a8bcd125-2d3a-4176-aead-97a2d3aae766\") " pod="openshift-console/console-786b854969-wv4p4" Jul 24 17:22:48.081371 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:48.081280 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8bcd125-2d3a-4176-aead-97a2d3aae766-console-oauth-config\") pod \"console-786b854969-wv4p4\" (UID: \"a8bcd125-2d3a-4176-aead-97a2d3aae766\") " pod="openshift-console/console-786b854969-wv4p4" Jul 24 17:22:48.181592 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:48.181565 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8bcd125-2d3a-4176-aead-97a2d3aae766-service-ca\") pod \"console-786b854969-wv4p4\" (UID: \"a8bcd125-2d3a-4176-aead-97a2d3aae766\") " pod="openshift-console/console-786b854969-wv4p4" Jul 24 17:22:48.181592 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:48.181593 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qtpc\" (UniqueName: \"kubernetes.io/projected/a8bcd125-2d3a-4176-aead-97a2d3aae766-kube-api-access-9qtpc\") pod \"console-786b854969-wv4p4\" (UID: \"a8bcd125-2d3a-4176-aead-97a2d3aae766\") " pod="openshift-console/console-786b854969-wv4p4" Jul 24 17:22:48.181793 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:48.181619 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8bcd125-2d3a-4176-aead-97a2d3aae766-console-oauth-config\") pod \"console-786b854969-wv4p4\" (UID: \"a8bcd125-2d3a-4176-aead-97a2d3aae766\") " pod="openshift-console/console-786b854969-wv4p4" Jul 24 17:22:48.181793 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:48.181732 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8bcd125-2d3a-4176-aead-97a2d3aae766-oauth-serving-cert\") pod \"console-786b854969-wv4p4\" (UID: \"a8bcd125-2d3a-4176-aead-97a2d3aae766\") " pod="openshift-console/console-786b854969-wv4p4" Jul 24 17:22:48.181793 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:48.181763 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8bcd125-2d3a-4176-aead-97a2d3aae766-console-serving-cert\") pod \"console-786b854969-wv4p4\" (UID: \"a8bcd125-2d3a-4176-aead-97a2d3aae766\") " pod="openshift-console/console-786b854969-wv4p4" Jul 24 17:22:48.181793 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:48.181791 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8bcd125-2d3a-4176-aead-97a2d3aae766-trusted-ca-bundle\") pod \"console-786b854969-wv4p4\" (UID: \"a8bcd125-2d3a-4176-aead-97a2d3aae766\") " pod="openshift-console/console-786b854969-wv4p4" Jul 24 17:22:48.181995 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:48.181825 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8bcd125-2d3a-4176-aead-97a2d3aae766-console-config\") pod \"console-786b854969-wv4p4\" (UID: \"a8bcd125-2d3a-4176-aead-97a2d3aae766\") " pod="openshift-console/console-786b854969-wv4p4" Jul 24 17:22:48.182403 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:48.182376 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8bcd125-2d3a-4176-aead-97a2d3aae766-oauth-serving-cert\") pod \"console-786b854969-wv4p4\" (UID: \"a8bcd125-2d3a-4176-aead-97a2d3aae766\") " pod="openshift-console/console-786b854969-wv4p4" Jul 24 17:22:48.182403 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:48.182389 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8bcd125-2d3a-4176-aead-97a2d3aae766-service-ca\") pod \"console-786b854969-wv4p4\" (UID: \"a8bcd125-2d3a-4176-aead-97a2d3aae766\") " pod="openshift-console/console-786b854969-wv4p4" Jul 24 17:22:48.182744 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:48.182507 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8bcd125-2d3a-4176-aead-97a2d3aae766-console-config\") pod \"console-786b854969-wv4p4\" (UID: \"a8bcd125-2d3a-4176-aead-97a2d3aae766\") " pod="openshift-console/console-786b854969-wv4p4" Jul 24 17:22:48.182744 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:48.182671 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8bcd125-2d3a-4176-aead-97a2d3aae766-trusted-ca-bundle\") pod \"console-786b854969-wv4p4\" (UID: \"a8bcd125-2d3a-4176-aead-97a2d3aae766\") " pod="openshift-console/console-786b854969-wv4p4" Jul 24 17:22:48.184297 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:48.184269 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8bcd125-2d3a-4176-aead-97a2d3aae766-console-serving-cert\") pod \"console-786b854969-wv4p4\" (UID: \"a8bcd125-2d3a-4176-aead-97a2d3aae766\") " pod="openshift-console/console-786b854969-wv4p4" Jul 24 17:22:48.184297 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:48.184290 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8bcd125-2d3a-4176-aead-97a2d3aae766-console-oauth-config\") pod \"console-786b854969-wv4p4\" (UID: \"a8bcd125-2d3a-4176-aead-97a2d3aae766\") " pod="openshift-console/console-786b854969-wv4p4" Jul 24 17:22:48.190263 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:48.190242 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qtpc\" (UniqueName: \"kubernetes.io/projected/a8bcd125-2d3a-4176-aead-97a2d3aae766-kube-api-access-9qtpc\") pod \"console-786b854969-wv4p4\" (UID: \"a8bcd125-2d3a-4176-aead-97a2d3aae766\") " pod="openshift-console/console-786b854969-wv4p4" Jul 24 17:22:48.269949 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:48.269901 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-786b854969-wv4p4" Jul 24 17:22:48.395440 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:48.395417 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-786b854969-wv4p4"] Jul 24 17:22:48.397402 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:22:48.397380 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8bcd125_2d3a_4176_aead_97a2d3aae766.slice/crio-700602ced233fbf955514e72d814ec114632eb3ad820b7e0bf3b5d9fed0bf4f4 WatchSource:0}: Error finding container 700602ced233fbf955514e72d814ec114632eb3ad820b7e0bf3b5d9fed0bf4f4: Status 404 returned error can't find the container with id 700602ced233fbf955514e72d814ec114632eb3ad820b7e0bf3b5d9fed0bf4f4 Jul 24 17:22:48.768528 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:48.768493 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-786b854969-wv4p4" event={"ID":"a8bcd125-2d3a-4176-aead-97a2d3aae766","Type":"ContainerStarted","Data":"4544968925eef9844c81f531052f5e2336899e041a2a0dd9c6c20a4ce98938ad"} Jul 24 17:22:48.768729 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:48.768542 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-786b854969-wv4p4" event={"ID":"a8bcd125-2d3a-4176-aead-97a2d3aae766","Type":"ContainerStarted","Data":"700602ced233fbf955514e72d814ec114632eb3ad820b7e0bf3b5d9fed0bf4f4"} Jul 24 17:22:48.787549 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:48.786825 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-786b854969-wv4p4" podStartSLOduration=1.786807609 podStartE2EDuration="1.786807609s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:22:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:22:48.786468479 +0000 UTC m=+164.454879503" watchObservedRunningTime="2026-07-24 17:22:48.786807609 +0000 UTC m=+164.455218649" Jul 24 17:22:58.270763 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:58.270674 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-786b854969-wv4p4" Jul 24 17:22:58.270763 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:58.270734 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-786b854969-wv4p4" Jul 24 17:22:58.275912 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:58.275889 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-786b854969-wv4p4" Jul 24 17:22:58.810754 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:58.810728 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-786b854969-wv4p4" Jul 24 17:22:58.859791 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:22:58.859764 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c79c6fdfc-d7d6g"] Jul 24 17:23:23.885207 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:23:23.885148 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7c79c6fdfc-d7d6g" podUID="a0cfb1f6-7db1-46a5-9950-dec847b4df43" containerName="console" containerID="cri-o://52170a9d7c00dd3407d8c00662bc7240a480b1b7d7b9b27b84551bfaa8b63519" gracePeriod=15 Jul 24 17:23:24.124688 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:23:24.124662 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c79c6fdfc-d7d6g" Jul 24 17:23:24.138895 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:23:24.138838 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0cfb1f6-7db1-46a5-9950-dec847b4df43-oauth-serving-cert\") pod \"a0cfb1f6-7db1-46a5-9950-dec847b4df43\" (UID: \"a0cfb1f6-7db1-46a5-9950-dec847b4df43\") " Jul 24 17:23:24.138895 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:23:24.138873 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0cfb1f6-7db1-46a5-9950-dec847b4df43-console-oauth-config\") pod \"a0cfb1f6-7db1-46a5-9950-dec847b4df43\" (UID: \"a0cfb1f6-7db1-46a5-9950-dec847b4df43\") " Jul 24 17:23:24.139035 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:23:24.138898 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0cfb1f6-7db1-46a5-9950-dec847b4df43-service-ca\") pod \"a0cfb1f6-7db1-46a5-9950-dec847b4df43\" (UID: \"a0cfb1f6-7db1-46a5-9950-dec847b4df43\") " Jul 24 17:23:24.139035 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:23:24.138942 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0cfb1f6-7db1-46a5-9950-dec847b4df43-console-config\") pod \"a0cfb1f6-7db1-46a5-9950-dec847b4df43\" (UID: \"a0cfb1f6-7db1-46a5-9950-dec847b4df43\") " Jul 24 17:23:24.139035 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:23:24.138956 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0cfb1f6-7db1-46a5-9950-dec847b4df43-trusted-ca-bundle\") pod \"a0cfb1f6-7db1-46a5-9950-dec847b4df43\" (UID: \"a0cfb1f6-7db1-46a5-9950-dec847b4df43\") " Jul 24 17:23:24.139035 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:23:24.138982 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6wtmg\" (UniqueName: \"kubernetes.io/projected/a0cfb1f6-7db1-46a5-9950-dec847b4df43-kube-api-access-6wtmg\") pod \"a0cfb1f6-7db1-46a5-9950-dec847b4df43\" (UID: \"a0cfb1f6-7db1-46a5-9950-dec847b4df43\") " Jul 24 17:23:24.139035 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:23:24.139019 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0cfb1f6-7db1-46a5-9950-dec847b4df43-console-serving-cert\") pod \"a0cfb1f6-7db1-46a5-9950-dec847b4df43\" (UID: \"a0cfb1f6-7db1-46a5-9950-dec847b4df43\") " Jul 24 17:23:24.139278 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:23:24.139236 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0cfb1f6-7db1-46a5-9950-dec847b4df43-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a0cfb1f6-7db1-46a5-9950-dec847b4df43" (UID: "a0cfb1f6-7db1-46a5-9950-dec847b4df43"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 17:23:24.139351 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:23:24.139274 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0cfb1f6-7db1-46a5-9950-dec847b4df43-service-ca" (OuterVolumeSpecName: "service-ca") pod "a0cfb1f6-7db1-46a5-9950-dec847b4df43" (UID: "a0cfb1f6-7db1-46a5-9950-dec847b4df43"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 17:23:24.139351 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:23:24.139320 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0cfb1f6-7db1-46a5-9950-dec847b4df43-console-config" (OuterVolumeSpecName: "console-config") pod "a0cfb1f6-7db1-46a5-9950-dec847b4df43" (UID: "a0cfb1f6-7db1-46a5-9950-dec847b4df43"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 17:23:24.139707 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:23:24.139686 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a0cfb1f6-7db1-46a5-9950-dec847b4df43-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a0cfb1f6-7db1-46a5-9950-dec847b4df43" (UID: "a0cfb1f6-7db1-46a5-9950-dec847b4df43"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 17:23:24.141003 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:23:24.140982 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0cfb1f6-7db1-46a5-9950-dec847b4df43-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a0cfb1f6-7db1-46a5-9950-dec847b4df43" (UID: "a0cfb1f6-7db1-46a5-9950-dec847b4df43"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 17:23:24.141877 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:23:24.141857 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a0cfb1f6-7db1-46a5-9950-dec847b4df43-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a0cfb1f6-7db1-46a5-9950-dec847b4df43" (UID: "a0cfb1f6-7db1-46a5-9950-dec847b4df43"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 17:23:24.141929 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:23:24.141878 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0cfb1f6-7db1-46a5-9950-dec847b4df43-kube-api-access-6wtmg" (OuterVolumeSpecName: "kube-api-access-6wtmg") pod "a0cfb1f6-7db1-46a5-9950-dec847b4df43" (UID: "a0cfb1f6-7db1-46a5-9950-dec847b4df43"). InnerVolumeSpecName "kube-api-access-6wtmg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 17:23:24.239928 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:23:24.239904 2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a0cfb1f6-7db1-46a5-9950-dec847b4df43-oauth-serving-cert\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:23:24.239928 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:23:24.239926 2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a0cfb1f6-7db1-46a5-9950-dec847b4df43-console-oauth-config\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:23:24.240077 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:23:24.239937 2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a0cfb1f6-7db1-46a5-9950-dec847b4df43-service-ca\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:23:24.240077 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:23:24.239945 2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a0cfb1f6-7db1-46a5-9950-dec847b4df43-console-config\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:23:24.240077 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:23:24.239954 2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a0cfb1f6-7db1-46a5-9950-dec847b4df43-trusted-ca-bundle\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:23:24.240077 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:23:24.239962 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6wtmg\" (UniqueName: \"kubernetes.io/projected/a0cfb1f6-7db1-46a5-9950-dec847b4df43-kube-api-access-6wtmg\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:23:24.240077 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:23:24.239970 2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a0cfb1f6-7db1-46a5-9950-dec847b4df43-console-serving-cert\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:23:24.904991 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:23:24.904960 2570 generic.go:356] "Generic (PLEG): container finished" podID="a0cfb1f6-7db1-46a5-9950-dec847b4df43" containerID="52170a9d7c00dd3407d8c00662bc7240a480b1b7d7b9b27b84551bfaa8b63519" exitCode=0 Jul 24 17:23:24.905405 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:23:24.905016 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c79c6fdfc-d7d6g" Jul 24 17:23:24.905405 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:23:24.905028 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c79c6fdfc-d7d6g" event={"ID":"a0cfb1f6-7db1-46a5-9950-dec847b4df43","Type":"ContainerDied","Data":"52170a9d7c00dd3407d8c00662bc7240a480b1b7d7b9b27b84551bfaa8b63519"} Jul 24 17:23:24.905405 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:23:24.905090 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c79c6fdfc-d7d6g" event={"ID":"a0cfb1f6-7db1-46a5-9950-dec847b4df43","Type":"ContainerDied","Data":"f77d4e67fee7c2a461fa1800702f2e2bd0ea2714b48e8282dfbc07949cca8be2"} Jul 24 17:23:24.905405 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:23:24.905110 2570 scope.go:117] "RemoveContainer" containerID="52170a9d7c00dd3407d8c00662bc7240a480b1b7d7b9b27b84551bfaa8b63519" Jul 24 17:23:24.914030 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:23:24.914011 2570 scope.go:117] "RemoveContainer" containerID="52170a9d7c00dd3407d8c00662bc7240a480b1b7d7b9b27b84551bfaa8b63519" Jul 24 17:23:24.914315 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:23:24.914289 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"52170a9d7c00dd3407d8c00662bc7240a480b1b7d7b9b27b84551bfaa8b63519\": container with ID starting with 52170a9d7c00dd3407d8c00662bc7240a480b1b7d7b9b27b84551bfaa8b63519 not found: ID does not exist" containerID="52170a9d7c00dd3407d8c00662bc7240a480b1b7d7b9b27b84551bfaa8b63519" Jul 24 17:23:24.914441 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:23:24.914325 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"52170a9d7c00dd3407d8c00662bc7240a480b1b7d7b9b27b84551bfaa8b63519"} err="failed to get container status \"52170a9d7c00dd3407d8c00662bc7240a480b1b7d7b9b27b84551bfaa8b63519\": rpc error: code = NotFound desc = could not find container \"52170a9d7c00dd3407d8c00662bc7240a480b1b7d7b9b27b84551bfaa8b63519\": container with ID starting with 52170a9d7c00dd3407d8c00662bc7240a480b1b7d7b9b27b84551bfaa8b63519 not found: ID does not exist" Jul 24 17:23:24.928787 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:23:24.928767 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c79c6fdfc-d7d6g"] Jul 24 17:23:24.934664 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:23:24.934644 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c79c6fdfc-d7d6g"] Jul 24 17:23:26.912738 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:23:26.912705 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0cfb1f6-7db1-46a5-9950-dec847b4df43" path="/var/lib/kubelet/pods/a0cfb1f6-7db1-46a5-9950-dec847b4df43/volumes" Jul 24 17:24:39.796644 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:39.796563 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggggj"] Jul 24 17:24:39.797101 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:39.796862 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0cfb1f6-7db1-46a5-9950-dec847b4df43" containerName="console" Jul 24 17:24:39.797101 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:39.796874 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0cfb1f6-7db1-46a5-9950-dec847b4df43" containerName="console" Jul 24 17:24:39.797101 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:39.796917 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0cfb1f6-7db1-46a5-9950-dec847b4df43" containerName="console" Jul 24 17:24:39.798897 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:39.798881 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggggj" Jul 24 17:24:39.802483 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:39.802463 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 24 17:24:39.802612 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:39.802501 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-kx7tb\"" Jul 24 17:24:39.803453 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:39.803434 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 24 17:24:39.809471 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:39.809452 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggggj"] Jul 24 17:24:39.852707 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:39.852681 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjsbn\" (UniqueName: \"kubernetes.io/projected/51b7311c-e258-4aea-8c16-12a1ef74f106-kube-api-access-fjsbn\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggggj\" (UID: \"51b7311c-e258-4aea-8c16-12a1ef74f106\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggggj" Jul 24 17:24:39.852815 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:39.852727 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51b7311c-e258-4aea-8c16-12a1ef74f106-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggggj\" (UID: \"51b7311c-e258-4aea-8c16-12a1ef74f106\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggggj" Jul 24 17:24:39.852815 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:39.852757 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51b7311c-e258-4aea-8c16-12a1ef74f106-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggggj\" (UID: \"51b7311c-e258-4aea-8c16-12a1ef74f106\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggggj" Jul 24 17:24:39.953968 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:39.953947 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51b7311c-e258-4aea-8c16-12a1ef74f106-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggggj\" (UID: \"51b7311c-e258-4aea-8c16-12a1ef74f106\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggggj" Jul 24 17:24:39.954067 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:39.953992 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjsbn\" (UniqueName: \"kubernetes.io/projected/51b7311c-e258-4aea-8c16-12a1ef74f106-kube-api-access-fjsbn\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggggj\" (UID: \"51b7311c-e258-4aea-8c16-12a1ef74f106\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggggj" Jul 24 17:24:39.954067 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:39.954039 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51b7311c-e258-4aea-8c16-12a1ef74f106-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggggj\" (UID: \"51b7311c-e258-4aea-8c16-12a1ef74f106\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggggj" Jul 24 17:24:39.954393 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:39.954373 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51b7311c-e258-4aea-8c16-12a1ef74f106-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggggj\" (UID: \"51b7311c-e258-4aea-8c16-12a1ef74f106\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggggj" Jul 24 17:24:39.954446 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:39.954393 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51b7311c-e258-4aea-8c16-12a1ef74f106-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggggj\" (UID: \"51b7311c-e258-4aea-8c16-12a1ef74f106\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggggj" Jul 24 17:24:39.964221 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:39.964196 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjsbn\" (UniqueName: \"kubernetes.io/projected/51b7311c-e258-4aea-8c16-12a1ef74f106-kube-api-access-fjsbn\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggggj\" (UID: \"51b7311c-e258-4aea-8c16-12a1ef74f106\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggggj" Jul 24 17:24:40.108912 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:40.108893 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggggj" Jul 24 17:24:40.235745 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:40.235673 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggggj"] Jul 24 17:24:40.238269 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:24:40.238236 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51b7311c_e258_4aea_8c16_12a1ef74f106.slice/crio-02dbfc446b827fdd43c923500aef25b039807ac59042bfd648921bd97df02d7f WatchSource:0}: Error finding container 02dbfc446b827fdd43c923500aef25b039807ac59042bfd648921bd97df02d7f: Status 404 returned error can't find the container with id 02dbfc446b827fdd43c923500aef25b039807ac59042bfd648921bd97df02d7f Jul 24 17:24:41.181488 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:41.181450 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggggj" event={"ID":"51b7311c-e258-4aea-8c16-12a1ef74f106","Type":"ContainerStarted","Data":"02dbfc446b827fdd43c923500aef25b039807ac59042bfd648921bd97df02d7f"} Jul 24 17:24:47.207895 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:47.207857 2570 generic.go:356] "Generic (PLEG): container finished" podID="51b7311c-e258-4aea-8c16-12a1ef74f106" containerID="e953cbf13e3c4d1f379cfc9244d0cd11b245de070868d5bb4d00f2fcdcd0a347" exitCode=0 Jul 24 17:24:47.208241 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:47.207946 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggggj" event={"ID":"51b7311c-e258-4aea-8c16-12a1ef74f106","Type":"ContainerDied","Data":"e953cbf13e3c4d1f379cfc9244d0cd11b245de070868d5bb4d00f2fcdcd0a347"} Jul 24 17:24:50.221183 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:50.221148 2570 generic.go:356] "Generic (PLEG): container finished" podID="51b7311c-e258-4aea-8c16-12a1ef74f106" containerID="5eaac7dc8fca543ce81761efea1e89dab07604d101fc6ca76481ef11c67be327" exitCode=0 Jul 24 17:24:50.221582 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:50.221194 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggggj" event={"ID":"51b7311c-e258-4aea-8c16-12a1ef74f106","Type":"ContainerDied","Data":"5eaac7dc8fca543ce81761efea1e89dab07604d101fc6ca76481ef11c67be327"} Jul 24 17:24:50.420367 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:50.420325 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-8zcr2"] Jul 24 17:24:50.427584 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:50.427554 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-8zcr2" Jul 24 17:24:50.430299 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:50.430278 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-9mzrf\"" Jul 24 17:24:50.430439 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:50.430283 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 24 17:24:50.430563 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:50.430549 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 24 17:24:50.433609 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:50.433586 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-8zcr2"] Jul 24 17:24:50.545909 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:50.545860 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lr6zx\" (UniqueName: \"kubernetes.io/projected/570217e5-96e2-45e6-9954-c03ee80ac59b-kube-api-access-lr6zx\") pod \"cert-manager-55b4d954d5-8zcr2\" (UID: \"570217e5-96e2-45e6-9954-c03ee80ac59b\") " pod="cert-manager/cert-manager-55b4d954d5-8zcr2" Jul 24 17:24:50.545909 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:50.545904 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/570217e5-96e2-45e6-9954-c03ee80ac59b-bound-sa-token\") pod \"cert-manager-55b4d954d5-8zcr2\" (UID: \"570217e5-96e2-45e6-9954-c03ee80ac59b\") " pod="cert-manager/cert-manager-55b4d954d5-8zcr2" Jul 24 17:24:50.647128 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:50.647107 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lr6zx\" (UniqueName: \"kubernetes.io/projected/570217e5-96e2-45e6-9954-c03ee80ac59b-kube-api-access-lr6zx\") pod \"cert-manager-55b4d954d5-8zcr2\" (UID: \"570217e5-96e2-45e6-9954-c03ee80ac59b\") " pod="cert-manager/cert-manager-55b4d954d5-8zcr2" Jul 24 17:24:50.647252 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:50.647155 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/570217e5-96e2-45e6-9954-c03ee80ac59b-bound-sa-token\") pod \"cert-manager-55b4d954d5-8zcr2\" (UID: \"570217e5-96e2-45e6-9954-c03ee80ac59b\") " pod="cert-manager/cert-manager-55b4d954d5-8zcr2" Jul 24 17:24:50.657414 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:50.657387 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/570217e5-96e2-45e6-9954-c03ee80ac59b-bound-sa-token\") pod \"cert-manager-55b4d954d5-8zcr2\" (UID: \"570217e5-96e2-45e6-9954-c03ee80ac59b\") " pod="cert-manager/cert-manager-55b4d954d5-8zcr2" Jul 24 17:24:50.657536 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:50.657490 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lr6zx\" (UniqueName: \"kubernetes.io/projected/570217e5-96e2-45e6-9954-c03ee80ac59b-kube-api-access-lr6zx\") pod \"cert-manager-55b4d954d5-8zcr2\" (UID: \"570217e5-96e2-45e6-9954-c03ee80ac59b\") " pod="cert-manager/cert-manager-55b4d954d5-8zcr2" Jul 24 17:24:50.737217 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:50.737192 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-8zcr2" Jul 24 17:24:50.881594 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:50.881553 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-8zcr2"] Jul 24 17:24:50.887192 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:24:50.887167 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod570217e5_96e2_45e6_9954_c03ee80ac59b.slice/crio-a07707571f6b50bd01d6c6b5e63455040cfd35fed9a26db9f331c15880de2505 WatchSource:0}: Error finding container a07707571f6b50bd01d6c6b5e63455040cfd35fed9a26db9f331c15880de2505: Status 404 returned error can't find the container with id a07707571f6b50bd01d6c6b5e63455040cfd35fed9a26db9f331c15880de2505 Jul 24 17:24:51.226574 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:51.226541 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-8zcr2" event={"ID":"570217e5-96e2-45e6-9954-c03ee80ac59b","Type":"ContainerStarted","Data":"a07707571f6b50bd01d6c6b5e63455040cfd35fed9a26db9f331c15880de2505"} Jul 24 17:24:55.247865 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:55.247820 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-8zcr2" event={"ID":"570217e5-96e2-45e6-9954-c03ee80ac59b","Type":"ContainerStarted","Data":"981c19e3c660abe12e7edd490406e9bf06f11448aea5aa6c29103abec72e3229"} Jul 24 17:24:55.266895 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:55.266849 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-8zcr2" podStartSLOduration=1.886241524 podStartE2EDuration="5.266831425s" totalImagesPullingTime="3.380589901s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:24:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:24:55.2655319 +0000 UTC m=+290.933942925" watchObservedRunningTime="2026-07-24 17:24:55.266831425 +0000 UTC m=+290.935242454" Jul 24 17:24:57.258959 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:57.258885 2570 generic.go:356] "Generic (PLEG): container finished" podID="51b7311c-e258-4aea-8c16-12a1ef74f106" containerID="532a484192d63d4029a3b2c55039968327cef1ac91ad868ebad2d66fae05770d" exitCode=0 Jul 24 17:24:57.259270 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:57.258977 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggggj" event={"ID":"51b7311c-e258-4aea-8c16-12a1ef74f106","Type":"ContainerDied","Data":"532a484192d63d4029a3b2c55039968327cef1ac91ad868ebad2d66fae05770d"} Jul 24 17:24:58.387292 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:58.387273 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggggj" Jul 24 17:24:58.521400 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:58.521312 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51b7311c-e258-4aea-8c16-12a1ef74f106-bundle\") pod \"51b7311c-e258-4aea-8c16-12a1ef74f106\" (UID: \"51b7311c-e258-4aea-8c16-12a1ef74f106\") " Jul 24 17:24:58.521549 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:58.521404 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjsbn\" (UniqueName: \"kubernetes.io/projected/51b7311c-e258-4aea-8c16-12a1ef74f106-kube-api-access-fjsbn\") pod \"51b7311c-e258-4aea-8c16-12a1ef74f106\" (UID: \"51b7311c-e258-4aea-8c16-12a1ef74f106\") " Jul 24 17:24:58.521549 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:58.521444 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51b7311c-e258-4aea-8c16-12a1ef74f106-util\") pod \"51b7311c-e258-4aea-8c16-12a1ef74f106\" (UID: \"51b7311c-e258-4aea-8c16-12a1ef74f106\") " Jul 24 17:24:58.521664 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:58.521641 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51b7311c-e258-4aea-8c16-12a1ef74f106-bundle" (OuterVolumeSpecName: "bundle") pod "51b7311c-e258-4aea-8c16-12a1ef74f106" (UID: "51b7311c-e258-4aea-8c16-12a1ef74f106"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 17:24:58.523689 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:58.523661 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51b7311c-e258-4aea-8c16-12a1ef74f106-kube-api-access-fjsbn" (OuterVolumeSpecName: "kube-api-access-fjsbn") pod "51b7311c-e258-4aea-8c16-12a1ef74f106" (UID: "51b7311c-e258-4aea-8c16-12a1ef74f106"). InnerVolumeSpecName "kube-api-access-fjsbn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 17:24:58.525726 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:58.525702 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51b7311c-e258-4aea-8c16-12a1ef74f106-util" (OuterVolumeSpecName: "util") pod "51b7311c-e258-4aea-8c16-12a1ef74f106" (UID: "51b7311c-e258-4aea-8c16-12a1ef74f106"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 17:24:58.621998 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:58.621967 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjsbn\" (UniqueName: \"kubernetes.io/projected/51b7311c-e258-4aea-8c16-12a1ef74f106-kube-api-access-fjsbn\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:24:58.621998 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:58.621996 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/51b7311c-e258-4aea-8c16-12a1ef74f106-util\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:24:58.621998 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:58.622006 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/51b7311c-e258-4aea-8c16-12a1ef74f106-bundle\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:24:59.269392 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:59.269315 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggggj" Jul 24 17:24:59.269392 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:59.269358 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fggggj" event={"ID":"51b7311c-e258-4aea-8c16-12a1ef74f106","Type":"ContainerDied","Data":"02dbfc446b827fdd43c923500aef25b039807ac59042bfd648921bd97df02d7f"} Jul 24 17:24:59.269577 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:24:59.269400 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="02dbfc446b827fdd43c923500aef25b039807ac59042bfd648921bd97df02d7f" Jul 24 17:25:04.152244 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:04.152213 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xlft4"] Jul 24 17:25:04.152609 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:04.152529 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51b7311c-e258-4aea-8c16-12a1ef74f106" containerName="util" Jul 24 17:25:04.152609 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:04.152541 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="51b7311c-e258-4aea-8c16-12a1ef74f106" containerName="util" Jul 24 17:25:04.152609 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:04.152555 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51b7311c-e258-4aea-8c16-12a1ef74f106" containerName="pull" Jul 24 17:25:04.152609 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:04.152560 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="51b7311c-e258-4aea-8c16-12a1ef74f106" containerName="pull" Jul 24 17:25:04.152609 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:04.152586 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51b7311c-e258-4aea-8c16-12a1ef74f106" containerName="extract" Jul 24 17:25:04.152609 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:04.152593 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="51b7311c-e258-4aea-8c16-12a1ef74f106" containerName="extract" Jul 24 17:25:04.152792 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:04.152644 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="51b7311c-e258-4aea-8c16-12a1ef74f106" containerName="extract" Jul 24 17:25:04.223069 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:04.223037 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xlft4"] Jul 24 17:25:04.223209 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:04.223136 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xlft4" Jul 24 17:25:04.226257 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:04.226225 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 24 17:25:04.226257 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:04.226244 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 24 17:25:04.227368 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:04.227353 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-jsb99\"" Jul 24 17:25:04.361623 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:04.361591 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/053433c7-574d-4963-8c31-20e7d6dd7353-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xlft4\" (UID: \"053433c7-574d-4963-8c31-20e7d6dd7353\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xlft4" Jul 24 17:25:04.361764 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:04.361644 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r7755\" (UniqueName: \"kubernetes.io/projected/053433c7-574d-4963-8c31-20e7d6dd7353-kube-api-access-r7755\") pod \"openshift-lws-operator-fd8ccff4c-xlft4\" (UID: \"053433c7-574d-4963-8c31-20e7d6dd7353\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xlft4" Jul 24 17:25:04.462444 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:04.462380 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r7755\" (UniqueName: \"kubernetes.io/projected/053433c7-574d-4963-8c31-20e7d6dd7353-kube-api-access-r7755\") pod \"openshift-lws-operator-fd8ccff4c-xlft4\" (UID: \"053433c7-574d-4963-8c31-20e7d6dd7353\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xlft4" Jul 24 17:25:04.462444 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:04.462428 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/053433c7-574d-4963-8c31-20e7d6dd7353-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xlft4\" (UID: \"053433c7-574d-4963-8c31-20e7d6dd7353\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xlft4" Jul 24 17:25:04.462741 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:04.462727 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/053433c7-574d-4963-8c31-20e7d6dd7353-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xlft4\" (UID: \"053433c7-574d-4963-8c31-20e7d6dd7353\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xlft4" Jul 24 17:25:04.471657 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:04.471627 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r7755\" (UniqueName: \"kubernetes.io/projected/053433c7-574d-4963-8c31-20e7d6dd7353-kube-api-access-r7755\") pod \"openshift-lws-operator-fd8ccff4c-xlft4\" (UID: \"053433c7-574d-4963-8c31-20e7d6dd7353\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xlft4" Jul 24 17:25:04.531722 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:04.531699 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xlft4" Jul 24 17:25:04.698585 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:04.698558 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xlft4"] Jul 24 17:25:04.701319 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:25:04.701288 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod053433c7_574d_4963_8c31_20e7d6dd7353.slice/crio-9b2bd8d96125f8356d75aa09dfc3214e7c17c55b27f046b0690f8bc37adaf4ba WatchSource:0}: Error finding container 9b2bd8d96125f8356d75aa09dfc3214e7c17c55b27f046b0690f8bc37adaf4ba: Status 404 returned error can't find the container with id 9b2bd8d96125f8356d75aa09dfc3214e7c17c55b27f046b0690f8bc37adaf4ba Jul 24 17:25:04.729461 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:04.729415 2570 kubelet.go:1648] "Image garbage collection succeeded" Jul 24 17:25:05.294942 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:05.294898 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xlft4" event={"ID":"053433c7-574d-4963-8c31-20e7d6dd7353","Type":"ContainerStarted","Data":"9b2bd8d96125f8356d75aa09dfc3214e7c17c55b27f046b0690f8bc37adaf4ba"} Jul 24 17:25:07.304834 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:07.304791 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xlft4" event={"ID":"053433c7-574d-4963-8c31-20e7d6dd7353","Type":"ContainerStarted","Data":"b398d5837f6e1a2ed6ed7fcc3a2f3c7fdb40088575cb57dda2601a33ba52893b"} Jul 24 17:25:07.323388 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:07.323345 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xlft4" podStartSLOduration=1.279012738 podStartE2EDuration="3.323315162s" totalImagesPullingTime="2.044302424s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:25:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:25:07.322979967 +0000 UTC m=+302.991390991" watchObservedRunningTime="2026-07-24 17:25:07.323315162 +0000 UTC m=+302.991726189" Jul 24 17:25:24.529757 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:24.529727 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6"] Jul 24 17:25:24.534417 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:24.533148 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6" Jul 24 17:25:24.536718 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:24.536688 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-2dnfg\"" Jul 24 17:25:24.536966 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:24.536943 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 24 17:25:24.537232 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:24.537218 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 24 17:25:24.537326 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:24.537217 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 24 17:25:24.537326 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:24.537222 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 24 17:25:24.552929 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:24.552904 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6"] Jul 24 17:25:24.607672 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:24.607635 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h7jgg\" (UniqueName: \"kubernetes.io/projected/bcefe486-3f20-4ee8-8a1c-07e898c7dac7-kube-api-access-h7jgg\") pod \"opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6\" (UID: \"bcefe486-3f20-4ee8-8a1c-07e898c7dac7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6" Jul 24 17:25:24.607775 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:24.607684 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcefe486-3f20-4ee8-8a1c-07e898c7dac7-tmp\") pod \"opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6\" (UID: \"bcefe486-3f20-4ee8-8a1c-07e898c7dac7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6" Jul 24 17:25:24.607775 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:24.607739 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bcefe486-3f20-4ee8-8a1c-07e898c7dac7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6\" (UID: \"bcefe486-3f20-4ee8-8a1c-07e898c7dac7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6" Jul 24 17:25:24.607775 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:24.607755 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bcefe486-3f20-4ee8-8a1c-07e898c7dac7-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6\" (UID: \"bcefe486-3f20-4ee8-8a1c-07e898c7dac7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6" Jul 24 17:25:24.607879 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:24.607775 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bcefe486-3f20-4ee8-8a1c-07e898c7dac7-manifests\") pod \"opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6\" (UID: \"bcefe486-3f20-4ee8-8a1c-07e898c7dac7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6" Jul 24 17:25:24.709020 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:24.708990 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h7jgg\" (UniqueName: \"kubernetes.io/projected/bcefe486-3f20-4ee8-8a1c-07e898c7dac7-kube-api-access-h7jgg\") pod \"opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6\" (UID: \"bcefe486-3f20-4ee8-8a1c-07e898c7dac7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6" Jul 24 17:25:24.709169 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:24.709031 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcefe486-3f20-4ee8-8a1c-07e898c7dac7-tmp\") pod \"opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6\" (UID: \"bcefe486-3f20-4ee8-8a1c-07e898c7dac7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6" Jul 24 17:25:24.709209 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:24.709161 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bcefe486-3f20-4ee8-8a1c-07e898c7dac7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6\" (UID: \"bcefe486-3f20-4ee8-8a1c-07e898c7dac7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6" Jul 24 17:25:24.709209 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:24.709203 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bcefe486-3f20-4ee8-8a1c-07e898c7dac7-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6\" (UID: \"bcefe486-3f20-4ee8-8a1c-07e898c7dac7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6" Jul 24 17:25:24.709288 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:24.709229 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bcefe486-3f20-4ee8-8a1c-07e898c7dac7-manifests\") pod \"opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6\" (UID: \"bcefe486-3f20-4ee8-8a1c-07e898c7dac7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6" Jul 24 17:25:24.709615 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:24.709593 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/bcefe486-3f20-4ee8-8a1c-07e898c7dac7-manifests\") pod \"opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6\" (UID: \"bcefe486-3f20-4ee8-8a1c-07e898c7dac7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6" Jul 24 17:25:24.711364 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:24.711321 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/bcefe486-3f20-4ee8-8a1c-07e898c7dac7-tmp\") pod \"opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6\" (UID: \"bcefe486-3f20-4ee8-8a1c-07e898c7dac7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6" Jul 24 17:25:24.711620 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:24.711601 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bcefe486-3f20-4ee8-8a1c-07e898c7dac7-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6\" (UID: \"bcefe486-3f20-4ee8-8a1c-07e898c7dac7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6" Jul 24 17:25:24.711697 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:24.711601 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/bcefe486-3f20-4ee8-8a1c-07e898c7dac7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6\" (UID: \"bcefe486-3f20-4ee8-8a1c-07e898c7dac7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6" Jul 24 17:25:24.724638 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:24.724618 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h7jgg\" (UniqueName: \"kubernetes.io/projected/bcefe486-3f20-4ee8-8a1c-07e898c7dac7-kube-api-access-h7jgg\") pod \"opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6\" (UID: \"bcefe486-3f20-4ee8-8a1c-07e898c7dac7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6" Jul 24 17:25:24.846433 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:24.846377 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6" Jul 24 17:25:24.979191 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:24.979170 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6"] Jul 24 17:25:24.981987 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:25:24.981955 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcefe486_3f20_4ee8_8a1c_07e898c7dac7.slice/crio-1df925300afab95d93a2ae0c6e1d62273fc2e9442270f8c4eb23e14f00adda40 WatchSource:0}: Error finding container 1df925300afab95d93a2ae0c6e1d62273fc2e9442270f8c4eb23e14f00adda40: Status 404 returned error can't find the container with id 1df925300afab95d93a2ae0c6e1d62273fc2e9442270f8c4eb23e14f00adda40 Jul 24 17:25:24.983844 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:24.983831 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 17:25:25.384645 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:25.384612 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6" event={"ID":"bcefe486-3f20-4ee8-8a1c-07e898c7dac7","Type":"ContainerStarted","Data":"1df925300afab95d93a2ae0c6e1d62273fc2e9442270f8c4eb23e14f00adda40"} Jul 24 17:25:28.400102 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:28.400063 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6" event={"ID":"bcefe486-3f20-4ee8-8a1c-07e898c7dac7","Type":"ContainerStarted","Data":"9c6ebe8f3a4ee05cea628209281e8e87446acd6d5c2bbc45f2da547cd21134cb"} Jul 24 17:25:29.405232 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:29.405160 2570 generic.go:356] "Generic (PLEG): container finished" podID="bcefe486-3f20-4ee8-8a1c-07e898c7dac7" containerID="9c6ebe8f3a4ee05cea628209281e8e87446acd6d5c2bbc45f2da547cd21134cb" exitCode=0 Jul 24 17:25:29.405616 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:29.405252 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6" event={"ID":"bcefe486-3f20-4ee8-8a1c-07e898c7dac7","Type":"ContainerDied","Data":"9c6ebe8f3a4ee05cea628209281e8e87446acd6d5c2bbc45f2da547cd21134cb"} Jul 24 17:25:30.411769 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:30.411735 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6" event={"ID":"bcefe486-3f20-4ee8-8a1c-07e898c7dac7","Type":"ContainerStarted","Data":"99b45a8813d5c6f3a2f096b5db5f66797fd98c2a15f65bea47347c230512f641"} Jul 24 17:25:30.412142 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:30.411925 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6" Jul 24 17:25:30.435011 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:30.434957 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6" podStartSLOduration=1.7826289549999998 podStartE2EDuration="6.434939628s" totalImagesPullingTime="3.586669457s" totalInitContainerRuntime="1.065641216s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:25:24 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:25:30.434249667 +0000 UTC m=+326.102660691" watchObservedRunningTime="2026-07-24 17:25:30.434939628 +0000 UTC m=+326.103350652" Jul 24 17:25:41.417884 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:41.417856 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6" Jul 24 17:25:44.329826 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:44.329795 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6bd989cf94-psc42"] Jul 24 17:25:44.340549 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:44.340517 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6bd989cf94-psc42" Jul 24 17:25:44.343995 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:44.343971 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 24 17:25:44.344145 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:44.344033 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 24 17:25:44.344145 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:44.344033 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 24 17:25:44.344487 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:44.344467 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 24 17:25:44.350048 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:44.350028 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6bd989cf94-psc42"] Jul 24 17:25:44.467442 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:44.467413 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78a4bd00-791d-4dea-b8bb-18b39dca5133-tmp\") pod \"kube-auth-proxy-6bd989cf94-psc42\" (UID: \"78a4bd00-791d-4dea-b8bb-18b39dca5133\") " pod="openshift-ingress/kube-auth-proxy-6bd989cf94-psc42" Jul 24 17:25:44.467617 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:44.467456 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78a4bd00-791d-4dea-b8bb-18b39dca5133-tls-certs\") pod \"kube-auth-proxy-6bd989cf94-psc42\" (UID: \"78a4bd00-791d-4dea-b8bb-18b39dca5133\") " pod="openshift-ingress/kube-auth-proxy-6bd989cf94-psc42" Jul 24 17:25:44.467617 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:44.467514 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgrp6\" (UniqueName: \"kubernetes.io/projected/78a4bd00-791d-4dea-b8bb-18b39dca5133-kube-api-access-jgrp6\") pod \"kube-auth-proxy-6bd989cf94-psc42\" (UID: \"78a4bd00-791d-4dea-b8bb-18b39dca5133\") " pod="openshift-ingress/kube-auth-proxy-6bd989cf94-psc42" Jul 24 17:25:44.517823 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:44.517788 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-wqlns"] Jul 24 17:25:44.521253 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:44.521238 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-wqlns" Jul 24 17:25:44.524166 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:44.524141 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 24 17:25:44.524419 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:44.524405 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-649tq\"" Jul 24 17:25:44.533930 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:44.533907 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-wqlns"] Jul 24 17:25:44.568771 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:44.568745 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78a4bd00-791d-4dea-b8bb-18b39dca5133-tls-certs\") pod \"kube-auth-proxy-6bd989cf94-psc42\" (UID: \"78a4bd00-791d-4dea-b8bb-18b39dca5133\") " pod="openshift-ingress/kube-auth-proxy-6bd989cf94-psc42" Jul 24 17:25:44.568892 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:44.568807 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hfpwm\" (UniqueName: \"kubernetes.io/projected/f09b18a6-1bb4-4dbe-8844-3cd914ab2119-kube-api-access-hfpwm\") pod \"odh-model-controller-7998c67dc4-wqlns\" (UID: \"f09b18a6-1bb4-4dbe-8844-3cd914ab2119\") " pod="opendatahub/odh-model-controller-7998c67dc4-wqlns" Jul 24 17:25:44.568892 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:44.568840 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgrp6\" (UniqueName: \"kubernetes.io/projected/78a4bd00-791d-4dea-b8bb-18b39dca5133-kube-api-access-jgrp6\") pod \"kube-auth-proxy-6bd989cf94-psc42\" (UID: \"78a4bd00-791d-4dea-b8bb-18b39dca5133\") " pod="openshift-ingress/kube-auth-proxy-6bd989cf94-psc42" Jul 24 17:25:44.569026 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:44.568994 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f09b18a6-1bb4-4dbe-8844-3cd914ab2119-cert\") pod \"odh-model-controller-7998c67dc4-wqlns\" (UID: \"f09b18a6-1bb4-4dbe-8844-3cd914ab2119\") " pod="opendatahub/odh-model-controller-7998c67dc4-wqlns" Jul 24 17:25:44.569206 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:44.569186 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78a4bd00-791d-4dea-b8bb-18b39dca5133-tmp\") pod \"kube-auth-proxy-6bd989cf94-psc42\" (UID: \"78a4bd00-791d-4dea-b8bb-18b39dca5133\") " pod="openshift-ingress/kube-auth-proxy-6bd989cf94-psc42" Jul 24 17:25:44.571418 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:44.571394 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/78a4bd00-791d-4dea-b8bb-18b39dca5133-tls-certs\") pod \"kube-auth-proxy-6bd989cf94-psc42\" (UID: \"78a4bd00-791d-4dea-b8bb-18b39dca5133\") " pod="openshift-ingress/kube-auth-proxy-6bd989cf94-psc42" Jul 24 17:25:44.571490 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:44.571458 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/78a4bd00-791d-4dea-b8bb-18b39dca5133-tmp\") pod \"kube-auth-proxy-6bd989cf94-psc42\" (UID: \"78a4bd00-791d-4dea-b8bb-18b39dca5133\") " pod="openshift-ingress/kube-auth-proxy-6bd989cf94-psc42" Jul 24 17:25:44.578787 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:44.578768 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgrp6\" (UniqueName: \"kubernetes.io/projected/78a4bd00-791d-4dea-b8bb-18b39dca5133-kube-api-access-jgrp6\") pod \"kube-auth-proxy-6bd989cf94-psc42\" (UID: \"78a4bd00-791d-4dea-b8bb-18b39dca5133\") " pod="openshift-ingress/kube-auth-proxy-6bd989cf94-psc42" Jul 24 17:25:44.651712 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:44.651692 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6bd989cf94-psc42" Jul 24 17:25:44.670532 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:44.670508 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hfpwm\" (UniqueName: \"kubernetes.io/projected/f09b18a6-1bb4-4dbe-8844-3cd914ab2119-kube-api-access-hfpwm\") pod \"odh-model-controller-7998c67dc4-wqlns\" (UID: \"f09b18a6-1bb4-4dbe-8844-3cd914ab2119\") " pod="opendatahub/odh-model-controller-7998c67dc4-wqlns" Jul 24 17:25:44.670646 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:44.670553 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f09b18a6-1bb4-4dbe-8844-3cd914ab2119-cert\") pod \"odh-model-controller-7998c67dc4-wqlns\" (UID: \"f09b18a6-1bb4-4dbe-8844-3cd914ab2119\") " pod="opendatahub/odh-model-controller-7998c67dc4-wqlns" Jul 24 17:25:44.670712 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:25:44.670663 2570 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 24 17:25:44.670771 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:25:44.670719 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f09b18a6-1bb4-4dbe-8844-3cd914ab2119-cert podName:f09b18a6-1bb4-4dbe-8844-3cd914ab2119 nodeName:}" failed. No retries permitted until 2026-07-24 17:25:45.170702787 +0000 UTC m=+340.839113797 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/f09b18a6-1bb4-4dbe-8844-3cd914ab2119-cert") pod "odh-model-controller-7998c67dc4-wqlns" (UID: "f09b18a6-1bb4-4dbe-8844-3cd914ab2119") : secret "odh-model-controller-webhook-cert" not found Jul 24 17:25:44.683151 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:44.683121 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hfpwm\" (UniqueName: \"kubernetes.io/projected/f09b18a6-1bb4-4dbe-8844-3cd914ab2119-kube-api-access-hfpwm\") pod \"odh-model-controller-7998c67dc4-wqlns\" (UID: \"f09b18a6-1bb4-4dbe-8844-3cd914ab2119\") " pod="opendatahub/odh-model-controller-7998c67dc4-wqlns" Jul 24 17:25:44.780462 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:44.780438 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6bd989cf94-psc42"] Jul 24 17:25:44.782823 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:25:44.782798 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78a4bd00_791d_4dea_b8bb_18b39dca5133.slice/crio-91a5c166385dd2220296eef4cb42ef2837ae6f1fad2c25f74e775795a2907342 WatchSource:0}: Error finding container 91a5c166385dd2220296eef4cb42ef2837ae6f1fad2c25f74e775795a2907342: Status 404 returned error can't find the container with id 91a5c166385dd2220296eef4cb42ef2837ae6f1fad2c25f74e775795a2907342 Jul 24 17:25:45.175213 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:45.175186 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f09b18a6-1bb4-4dbe-8844-3cd914ab2119-cert\") pod \"odh-model-controller-7998c67dc4-wqlns\" (UID: \"f09b18a6-1bb4-4dbe-8844-3cd914ab2119\") " pod="opendatahub/odh-model-controller-7998c67dc4-wqlns" Jul 24 17:25:45.178034 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:45.178010 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f09b18a6-1bb4-4dbe-8844-3cd914ab2119-cert\") pod \"odh-model-controller-7998c67dc4-wqlns\" (UID: \"f09b18a6-1bb4-4dbe-8844-3cd914ab2119\") " pod="opendatahub/odh-model-controller-7998c67dc4-wqlns" Jul 24 17:25:45.417490 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:45.417449 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-pg8cg"] Jul 24 17:25:45.421054 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:45.421034 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-pg8cg" Jul 24 17:25:45.424669 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:45.424648 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-6mjpp\"" Jul 24 17:25:45.425001 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:45.424970 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 24 17:25:45.430601 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:45.430536 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-wqlns" Jul 24 17:25:45.436440 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:45.436416 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-pg8cg"] Jul 24 17:25:45.473659 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:45.473629 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6bd989cf94-psc42" event={"ID":"78a4bd00-791d-4dea-b8bb-18b39dca5133","Type":"ContainerStarted","Data":"91a5c166385dd2220296eef4cb42ef2837ae6f1fad2c25f74e775795a2907342"} Jul 24 17:25:45.478185 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:45.478153 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m8x47\" (UniqueName: \"kubernetes.io/projected/8673e062-6460-4949-a5ea-47edab7b658b-kube-api-access-m8x47\") pod \"model-serving-api-54d89bd5fc-pg8cg\" (UID: \"8673e062-6460-4949-a5ea-47edab7b658b\") " pod="opendatahub/model-serving-api-54d89bd5fc-pg8cg" Jul 24 17:25:45.478356 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:45.478224 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8673e062-6460-4949-a5ea-47edab7b658b-tls-certs\") pod \"model-serving-api-54d89bd5fc-pg8cg\" (UID: \"8673e062-6460-4949-a5ea-47edab7b658b\") " pod="opendatahub/model-serving-api-54d89bd5fc-pg8cg" Jul 24 17:25:45.578775 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:45.578744 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8673e062-6460-4949-a5ea-47edab7b658b-tls-certs\") pod \"model-serving-api-54d89bd5fc-pg8cg\" (UID: \"8673e062-6460-4949-a5ea-47edab7b658b\") " pod="opendatahub/model-serving-api-54d89bd5fc-pg8cg" Jul 24 17:25:45.578924 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:45.578842 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m8x47\" (UniqueName: \"kubernetes.io/projected/8673e062-6460-4949-a5ea-47edab7b658b-kube-api-access-m8x47\") pod \"model-serving-api-54d89bd5fc-pg8cg\" (UID: \"8673e062-6460-4949-a5ea-47edab7b658b\") " pod="opendatahub/model-serving-api-54d89bd5fc-pg8cg" Jul 24 17:25:45.579011 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:25:45.578920 2570 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 24 17:25:45.579011 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:25:45.578995 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8673e062-6460-4949-a5ea-47edab7b658b-tls-certs podName:8673e062-6460-4949-a5ea-47edab7b658b nodeName:}" failed. No retries permitted until 2026-07-24 17:25:46.078974784 +0000 UTC m=+341.747385788 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/8673e062-6460-4949-a5ea-47edab7b658b-tls-certs") pod "model-serving-api-54d89bd5fc-pg8cg" (UID: "8673e062-6460-4949-a5ea-47edab7b658b") : secret "model-serving-api-tls" not found Jul 24 17:25:45.593822 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:45.593795 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-wqlns"] Jul 24 17:25:45.598544 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:25:45.598520 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf09b18a6_1bb4_4dbe_8844_3cd914ab2119.slice/crio-02823d7d5a689204116fd34deea6c7495da90c70afafd0ffc0cd328ff3e275b5 WatchSource:0}: Error finding container 02823d7d5a689204116fd34deea6c7495da90c70afafd0ffc0cd328ff3e275b5: Status 404 returned error can't find the container with id 02823d7d5a689204116fd34deea6c7495da90c70afafd0ffc0cd328ff3e275b5 Jul 24 17:25:45.610783 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:45.610763 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m8x47\" (UniqueName: \"kubernetes.io/projected/8673e062-6460-4949-a5ea-47edab7b658b-kube-api-access-m8x47\") pod \"model-serving-api-54d89bd5fc-pg8cg\" (UID: \"8673e062-6460-4949-a5ea-47edab7b658b\") " pod="opendatahub/model-serving-api-54d89bd5fc-pg8cg" Jul 24 17:25:45.973705 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:45.973672 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8"] Jul 24 17:25:45.978555 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:45.978541 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8" Jul 24 17:25:45.981783 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:45.981753 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 24 17:25:45.981928 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:45.981912 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 24 17:25:45.982128 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:45.982111 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 24 17:25:45.982221 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:45.982120 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-jh6s7\"" Jul 24 17:25:45.982410 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:45.982398 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 24 17:25:45.997321 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:45.997296 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8"] Jul 24 17:25:46.083937 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:46.083906 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b7d45831-64b2-4047-b3a9-630f81403fb2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-zpmz8\" (UID: \"b7d45831-64b2-4047-b3a9-630f81403fb2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8" Jul 24 17:25:46.083937 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:46.083948 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b7d45831-64b2-4047-b3a9-630f81403fb2-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-zpmz8\" (UID: \"b7d45831-64b2-4047-b3a9-630f81403fb2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8" Jul 24 17:25:46.084174 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:46.083978 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7d45831-64b2-4047-b3a9-630f81403fb2-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-zpmz8\" (UID: \"b7d45831-64b2-4047-b3a9-630f81403fb2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8" Jul 24 17:25:46.084174 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:46.083998 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b7d45831-64b2-4047-b3a9-630f81403fb2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-zpmz8\" (UID: \"b7d45831-64b2-4047-b3a9-630f81403fb2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8" Jul 24 17:25:46.084174 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:46.084063 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b7d45831-64b2-4047-b3a9-630f81403fb2-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-zpmz8\" (UID: \"b7d45831-64b2-4047-b3a9-630f81403fb2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8" Jul 24 17:25:46.084284 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:46.084183 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8673e062-6460-4949-a5ea-47edab7b658b-tls-certs\") pod \"model-serving-api-54d89bd5fc-pg8cg\" (UID: \"8673e062-6460-4949-a5ea-47edab7b658b\") " pod="opendatahub/model-serving-api-54d89bd5fc-pg8cg" Jul 24 17:25:46.084284 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:46.084231 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7d45831-64b2-4047-b3a9-630f81403fb2-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-zpmz8\" (UID: \"b7d45831-64b2-4047-b3a9-630f81403fb2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8" Jul 24 17:25:46.084284 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:46.084266 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-smdlh\" (UniqueName: \"kubernetes.io/projected/b7d45831-64b2-4047-b3a9-630f81403fb2-kube-api-access-smdlh\") pod \"istiod-openshift-gateway-7b7995d5cd-zpmz8\" (UID: \"b7d45831-64b2-4047-b3a9-630f81403fb2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8" Jul 24 17:25:46.087289 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:46.087262 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8673e062-6460-4949-a5ea-47edab7b658b-tls-certs\") pod \"model-serving-api-54d89bd5fc-pg8cg\" (UID: \"8673e062-6460-4949-a5ea-47edab7b658b\") " pod="opendatahub/model-serving-api-54d89bd5fc-pg8cg" Jul 24 17:25:46.185288 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:46.185254 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b7d45831-64b2-4047-b3a9-630f81403fb2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-zpmz8\" (UID: \"b7d45831-64b2-4047-b3a9-630f81403fb2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8" Jul 24 17:25:46.185437 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:46.185296 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b7d45831-64b2-4047-b3a9-630f81403fb2-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-zpmz8\" (UID: \"b7d45831-64b2-4047-b3a9-630f81403fb2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8" Jul 24 17:25:46.185437 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:46.185325 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7d45831-64b2-4047-b3a9-630f81403fb2-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-zpmz8\" (UID: \"b7d45831-64b2-4047-b3a9-630f81403fb2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8" Jul 24 17:25:46.185437 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:46.185391 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b7d45831-64b2-4047-b3a9-630f81403fb2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-zpmz8\" (UID: \"b7d45831-64b2-4047-b3a9-630f81403fb2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8" Jul 24 17:25:46.185437 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:46.185425 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b7d45831-64b2-4047-b3a9-630f81403fb2-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-zpmz8\" (UID: \"b7d45831-64b2-4047-b3a9-630f81403fb2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8" Jul 24 17:25:46.185653 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:46.185504 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7d45831-64b2-4047-b3a9-630f81403fb2-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-zpmz8\" (UID: \"b7d45831-64b2-4047-b3a9-630f81403fb2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8" Jul 24 17:25:46.185653 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:46.185529 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-smdlh\" (UniqueName: \"kubernetes.io/projected/b7d45831-64b2-4047-b3a9-630f81403fb2-kube-api-access-smdlh\") pod \"istiod-openshift-gateway-7b7995d5cd-zpmz8\" (UID: \"b7d45831-64b2-4047-b3a9-630f81403fb2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8" Jul 24 17:25:46.186234 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:46.186211 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b7d45831-64b2-4047-b3a9-630f81403fb2-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-zpmz8\" (UID: \"b7d45831-64b2-4047-b3a9-630f81403fb2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8" Jul 24 17:25:46.188281 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:46.188255 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7d45831-64b2-4047-b3a9-630f81403fb2-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-zpmz8\" (UID: \"b7d45831-64b2-4047-b3a9-630f81403fb2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8" Jul 24 17:25:46.188973 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:46.188948 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b7d45831-64b2-4047-b3a9-630f81403fb2-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-zpmz8\" (UID: \"b7d45831-64b2-4047-b3a9-630f81403fb2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8" Jul 24 17:25:46.189073 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:46.189030 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b7d45831-64b2-4047-b3a9-630f81403fb2-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-zpmz8\" (UID: \"b7d45831-64b2-4047-b3a9-630f81403fb2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8" Jul 24 17:25:46.189073 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:46.189047 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b7d45831-64b2-4047-b3a9-630f81403fb2-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-zpmz8\" (UID: \"b7d45831-64b2-4047-b3a9-630f81403fb2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8" Jul 24 17:25:46.198134 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:46.198106 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-smdlh\" (UniqueName: \"kubernetes.io/projected/b7d45831-64b2-4047-b3a9-630f81403fb2-kube-api-access-smdlh\") pod \"istiod-openshift-gateway-7b7995d5cd-zpmz8\" (UID: \"b7d45831-64b2-4047-b3a9-630f81403fb2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8" Jul 24 17:25:46.198218 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:46.198148 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7d45831-64b2-4047-b3a9-630f81403fb2-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-zpmz8\" (UID: \"b7d45831-64b2-4047-b3a9-630f81403fb2\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8" Jul 24 17:25:46.288428 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:46.288364 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8" Jul 24 17:25:46.334362 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:46.334319 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-pg8cg" Jul 24 17:25:46.460443 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:46.458474 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8"] Jul 24 17:25:46.462378 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:25:46.462326 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7d45831_64b2_4047_b3a9_630f81403fb2.slice/crio-5a1a674ce277caf7130bef539e558bfd20abf8490786029a34c2949884410bed WatchSource:0}: Error finding container 5a1a674ce277caf7130bef539e558bfd20abf8490786029a34c2949884410bed: Status 404 returned error can't find the container with id 5a1a674ce277caf7130bef539e558bfd20abf8490786029a34c2949884410bed Jul 24 17:25:46.486726 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:46.486661 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-wqlns" event={"ID":"f09b18a6-1bb4-4dbe-8844-3cd914ab2119","Type":"ContainerStarted","Data":"02823d7d5a689204116fd34deea6c7495da90c70afafd0ffc0cd328ff3e275b5"} Jul 24 17:25:46.488495 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:46.488467 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8" event={"ID":"b7d45831-64b2-4047-b3a9-630f81403fb2","Type":"ContainerStarted","Data":"5a1a674ce277caf7130bef539e558bfd20abf8490786029a34c2949884410bed"} Jul 24 17:25:46.522277 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:46.521900 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-pg8cg"] Jul 24 17:25:46.525139 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:25:46.525109 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8673e062_6460_4949_a5ea_47edab7b658b.slice/crio-07976cca3c65129de9c920828db2ffc38fb5af63c2fda9cb6f1030de34f08521 WatchSource:0}: Error finding container 07976cca3c65129de9c920828db2ffc38fb5af63c2fda9cb6f1030de34f08521: Status 404 returned error can't find the container with id 07976cca3c65129de9c920828db2ffc38fb5af63c2fda9cb6f1030de34f08521 Jul 24 17:25:47.495843 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:47.495802 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-pg8cg" event={"ID":"8673e062-6460-4949-a5ea-47edab7b658b","Type":"ContainerStarted","Data":"07976cca3c65129de9c920828db2ffc38fb5af63c2fda9cb6f1030de34f08521"} Jul 24 17:25:50.513698 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:50.513660 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-pg8cg" event={"ID":"8673e062-6460-4949-a5ea-47edab7b658b","Type":"ContainerStarted","Data":"3e2da1ac6454fe17d9917f4403ce16c877c5dc700d166ed127692a2f3e2536a4"} Jul 24 17:25:50.514175 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:50.513777 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-pg8cg" Jul 24 17:25:50.515449 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:50.515412 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-wqlns" event={"ID":"f09b18a6-1bb4-4dbe-8844-3cd914ab2119","Type":"ContainerStarted","Data":"8e83ec1f7efffcd7286dd328ca4aa0977de3f9c03a8f9737badf19430ed96ca8"} Jul 24 17:25:50.515590 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:50.515492 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-wqlns" Jul 24 17:25:50.517022 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:50.516995 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6bd989cf94-psc42" event={"ID":"78a4bd00-791d-4dea-b8bb-18b39dca5133","Type":"ContainerStarted","Data":"e5d6c20c24c40e57a51d31704945313ae1cd8ba5345c1a9ed4fa92a88c3d58bd"} Jul 24 17:25:50.556140 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:50.556098 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-pg8cg" podStartSLOduration=2.606420665 podStartE2EDuration="5.556084234s" totalImagesPullingTime="2.949663569s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:25:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:25:50.547428701 +0000 UTC m=+346.215839725" watchObservedRunningTime="2026-07-24 17:25:50.556084234 +0000 UTC m=+346.224495259" Jul 24 17:25:50.579937 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:50.579884 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6bd989cf94-psc42" podStartSLOduration=1.9241071650000001 podStartE2EDuration="6.579869212s" totalImagesPullingTime="4.655762047s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:25:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:25:50.577600648 +0000 UTC m=+346.246011685" watchObservedRunningTime="2026-07-24 17:25:50.579869212 +0000 UTC m=+346.248280237" Jul 24 17:25:51.207659 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:51.207606 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 24 17:25:51.207744 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:51.207686 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 24 17:25:51.523248 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:51.523156 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8" event={"ID":"b7d45831-64b2-4047-b3a9-630f81403fb2","Type":"ContainerStarted","Data":"ce8ce84bb6aad071569e4f78f34e2eeeb33ed2242ed911df798b1bf89c15a8c4"} Jul 24 17:25:51.547060 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:51.547014 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8" podStartSLOduration=1.806250468 podStartE2EDuration="6.547000317s" totalImagesPullingTime="4.740749849s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:25:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:25:51.545782643 +0000 UTC m=+347.214193666" watchObservedRunningTime="2026-07-24 17:25:51.547000317 +0000 UTC m=+347.215411340" Jul 24 17:25:51.548196 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:51.548168 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-wqlns" podStartSLOduration=3.6647433769999997 podStartE2EDuration="7.548160837s" totalImagesPullingTime="3.88341746s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:25:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:25:50.630761165 +0000 UTC m=+346.299172189" watchObservedRunningTime="2026-07-24 17:25:51.548160837 +0000 UTC m=+347.216571860" Jul 24 17:25:52.501160 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.501118 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6"] Jul 24 17:25:52.504579 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.504559 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" Jul 24 17:25:52.508997 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.508978 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-lpv6m\"" Jul 24 17:25:52.528122 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.528093 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8" Jul 24 17:25:52.529495 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.529474 2570 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-zpmz8 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 24 17:25:52.529588 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.529519 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8" podUID="b7d45831-64b2-4047-b3a9-630f81403fb2" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 24 17:25:52.550874 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.550853 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6"] Jul 24 17:25:52.640114 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.640084 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d002f30-96fa-4e8c-b52b-563cd77e971e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6\" (UID: \"6d002f30-96fa-4e8c-b52b-563cd77e971e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" Jul 24 17:25:52.640288 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.640128 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d002f30-96fa-4e8c-b52b-563cd77e971e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6\" (UID: \"6d002f30-96fa-4e8c-b52b-563cd77e971e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" Jul 24 17:25:52.640388 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.640284 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d002f30-96fa-4e8c-b52b-563cd77e971e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6\" (UID: \"6d002f30-96fa-4e8c-b52b-563cd77e971e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" Jul 24 17:25:52.640388 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.640323 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d002f30-96fa-4e8c-b52b-563cd77e971e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6\" (UID: \"6d002f30-96fa-4e8c-b52b-563cd77e971e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" Jul 24 17:25:52.640505 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.640391 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d002f30-96fa-4e8c-b52b-563cd77e971e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6\" (UID: \"6d002f30-96fa-4e8c-b52b-563cd77e971e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" Jul 24 17:25:52.640505 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.640482 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d002f30-96fa-4e8c-b52b-563cd77e971e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6\" (UID: \"6d002f30-96fa-4e8c-b52b-563cd77e971e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" Jul 24 17:25:52.640623 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.640553 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d002f30-96fa-4e8c-b52b-563cd77e971e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6\" (UID: \"6d002f30-96fa-4e8c-b52b-563cd77e971e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" Jul 24 17:25:52.640623 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.640585 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn79q\" (UniqueName: \"kubernetes.io/projected/6d002f30-96fa-4e8c-b52b-563cd77e971e-kube-api-access-vn79q\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6\" (UID: \"6d002f30-96fa-4e8c-b52b-563cd77e971e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" Jul 24 17:25:52.640623 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.640608 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d002f30-96fa-4e8c-b52b-563cd77e971e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6\" (UID: \"6d002f30-96fa-4e8c-b52b-563cd77e971e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" Jul 24 17:25:52.741531 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.741489 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d002f30-96fa-4e8c-b52b-563cd77e971e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6\" (UID: \"6d002f30-96fa-4e8c-b52b-563cd77e971e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" Jul 24 17:25:52.741716 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.741541 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d002f30-96fa-4e8c-b52b-563cd77e971e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6\" (UID: \"6d002f30-96fa-4e8c-b52b-563cd77e971e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" Jul 24 17:25:52.741716 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.741574 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d002f30-96fa-4e8c-b52b-563cd77e971e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6\" (UID: \"6d002f30-96fa-4e8c-b52b-563cd77e971e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" Jul 24 17:25:52.741716 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.741615 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d002f30-96fa-4e8c-b52b-563cd77e971e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6\" (UID: \"6d002f30-96fa-4e8c-b52b-563cd77e971e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" Jul 24 17:25:52.741716 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.741655 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d002f30-96fa-4e8c-b52b-563cd77e971e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6\" (UID: \"6d002f30-96fa-4e8c-b52b-563cd77e971e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" Jul 24 17:25:52.741716 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.741691 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d002f30-96fa-4e8c-b52b-563cd77e971e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6\" (UID: \"6d002f30-96fa-4e8c-b52b-563cd77e971e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" Jul 24 17:25:52.741953 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.741737 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d002f30-96fa-4e8c-b52b-563cd77e971e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6\" (UID: \"6d002f30-96fa-4e8c-b52b-563cd77e971e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" Jul 24 17:25:52.741953 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.741773 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn79q\" (UniqueName: \"kubernetes.io/projected/6d002f30-96fa-4e8c-b52b-563cd77e971e-kube-api-access-vn79q\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6\" (UID: \"6d002f30-96fa-4e8c-b52b-563cd77e971e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" Jul 24 17:25:52.741953 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.741806 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d002f30-96fa-4e8c-b52b-563cd77e971e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6\" (UID: \"6d002f30-96fa-4e8c-b52b-563cd77e971e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" Jul 24 17:25:52.742238 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.742212 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d002f30-96fa-4e8c-b52b-563cd77e971e-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6\" (UID: \"6d002f30-96fa-4e8c-b52b-563cd77e971e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" Jul 24 17:25:52.742568 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.742542 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d002f30-96fa-4e8c-b52b-563cd77e971e-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6\" (UID: \"6d002f30-96fa-4e8c-b52b-563cd77e971e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" Jul 24 17:25:52.742793 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.742771 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d002f30-96fa-4e8c-b52b-563cd77e971e-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6\" (UID: \"6d002f30-96fa-4e8c-b52b-563cd77e971e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" Jul 24 17:25:52.743383 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.743357 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d002f30-96fa-4e8c-b52b-563cd77e971e-istio-data\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6\" (UID: \"6d002f30-96fa-4e8c-b52b-563cd77e971e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" Jul 24 17:25:52.744125 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.744066 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d002f30-96fa-4e8c-b52b-563cd77e971e-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6\" (UID: \"6d002f30-96fa-4e8c-b52b-563cd77e971e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" Jul 24 17:25:52.747200 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.747111 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d002f30-96fa-4e8c-b52b-563cd77e971e-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6\" (UID: \"6d002f30-96fa-4e8c-b52b-563cd77e971e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" Jul 24 17:25:52.748279 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.748245 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d002f30-96fa-4e8c-b52b-563cd77e971e-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6\" (UID: \"6d002f30-96fa-4e8c-b52b-563cd77e971e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" Jul 24 17:25:52.764799 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.764744 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn79q\" (UniqueName: \"kubernetes.io/projected/6d002f30-96fa-4e8c-b52b-563cd77e971e-kube-api-access-vn79q\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6\" (UID: \"6d002f30-96fa-4e8c-b52b-563cd77e971e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" Jul 24 17:25:52.771022 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.771002 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d002f30-96fa-4e8c-b52b-563cd77e971e-istio-token\") pod \"data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6\" (UID: \"6d002f30-96fa-4e8c-b52b-563cd77e971e\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" Jul 24 17:25:52.785923 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.785902 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd"] Jul 24 17:25:52.790500 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.790485 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd" Jul 24 17:25:52.813176 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.813153 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd"] Jul 24 17:25:52.814721 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.814703 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" Jul 24 17:25:52.842673 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.842646 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/423cdcad-b5fb-4eb1-b896-fe235a7bb0fe-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd\" (UID: \"423cdcad-b5fb-4eb1-b896-fe235a7bb0fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd" Jul 24 17:25:52.842797 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.842694 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/423cdcad-b5fb-4eb1-b896-fe235a7bb0fe-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd\" (UID: \"423cdcad-b5fb-4eb1-b896-fe235a7bb0fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd" Jul 24 17:25:52.842797 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.842721 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/423cdcad-b5fb-4eb1-b896-fe235a7bb0fe-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd\" (UID: \"423cdcad-b5fb-4eb1-b896-fe235a7bb0fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd" Jul 24 17:25:52.842882 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.842820 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcm87\" (UniqueName: \"kubernetes.io/projected/423cdcad-b5fb-4eb1-b896-fe235a7bb0fe-kube-api-access-dcm87\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd\" (UID: \"423cdcad-b5fb-4eb1-b896-fe235a7bb0fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd" Jul 24 17:25:52.842882 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.842864 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/423cdcad-b5fb-4eb1-b896-fe235a7bb0fe-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd\" (UID: \"423cdcad-b5fb-4eb1-b896-fe235a7bb0fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd" Jul 24 17:25:52.842956 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.842899 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/423cdcad-b5fb-4eb1-b896-fe235a7bb0fe-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd\" (UID: \"423cdcad-b5fb-4eb1-b896-fe235a7bb0fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd" Jul 24 17:25:52.842956 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.842922 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/423cdcad-b5fb-4eb1-b896-fe235a7bb0fe-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd\" (UID: \"423cdcad-b5fb-4eb1-b896-fe235a7bb0fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd" Jul 24 17:25:52.843055 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.843022 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/423cdcad-b5fb-4eb1-b896-fe235a7bb0fe-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd\" (UID: \"423cdcad-b5fb-4eb1-b896-fe235a7bb0fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd" Jul 24 17:25:52.843101 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.843060 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/423cdcad-b5fb-4eb1-b896-fe235a7bb0fe-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd\" (UID: \"423cdcad-b5fb-4eb1-b896-fe235a7bb0fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd" Jul 24 17:25:52.944278 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.944225 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/423cdcad-b5fb-4eb1-b896-fe235a7bb0fe-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd\" (UID: \"423cdcad-b5fb-4eb1-b896-fe235a7bb0fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd" Jul 24 17:25:52.944468 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.944291 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/423cdcad-b5fb-4eb1-b896-fe235a7bb0fe-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd\" (UID: \"423cdcad-b5fb-4eb1-b896-fe235a7bb0fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd" Jul 24 17:25:52.944468 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.944386 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcm87\" (UniqueName: \"kubernetes.io/projected/423cdcad-b5fb-4eb1-b896-fe235a7bb0fe-kube-api-access-dcm87\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd\" (UID: \"423cdcad-b5fb-4eb1-b896-fe235a7bb0fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd" Jul 24 17:25:52.944468 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.944416 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/423cdcad-b5fb-4eb1-b896-fe235a7bb0fe-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd\" (UID: \"423cdcad-b5fb-4eb1-b896-fe235a7bb0fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd" Jul 24 17:25:52.944468 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.944453 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/423cdcad-b5fb-4eb1-b896-fe235a7bb0fe-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd\" (UID: \"423cdcad-b5fb-4eb1-b896-fe235a7bb0fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd" Jul 24 17:25:52.944829 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.944479 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/423cdcad-b5fb-4eb1-b896-fe235a7bb0fe-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd\" (UID: \"423cdcad-b5fb-4eb1-b896-fe235a7bb0fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd" Jul 24 17:25:52.944829 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.944546 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/423cdcad-b5fb-4eb1-b896-fe235a7bb0fe-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd\" (UID: \"423cdcad-b5fb-4eb1-b896-fe235a7bb0fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd" Jul 24 17:25:52.944829 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.944804 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/423cdcad-b5fb-4eb1-b896-fe235a7bb0fe-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd\" (UID: \"423cdcad-b5fb-4eb1-b896-fe235a7bb0fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd" Jul 24 17:25:52.944980 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.944848 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/423cdcad-b5fb-4eb1-b896-fe235a7bb0fe-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd\" (UID: \"423cdcad-b5fb-4eb1-b896-fe235a7bb0fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd" Jul 24 17:25:52.945065 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.945041 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/423cdcad-b5fb-4eb1-b896-fe235a7bb0fe-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd\" (UID: \"423cdcad-b5fb-4eb1-b896-fe235a7bb0fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd" Jul 24 17:25:52.945130 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.945093 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/423cdcad-b5fb-4eb1-b896-fe235a7bb0fe-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd\" (UID: \"423cdcad-b5fb-4eb1-b896-fe235a7bb0fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd" Jul 24 17:25:52.945130 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.945102 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/423cdcad-b5fb-4eb1-b896-fe235a7bb0fe-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd\" (UID: \"423cdcad-b5fb-4eb1-b896-fe235a7bb0fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd" Jul 24 17:25:52.945232 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.945187 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/423cdcad-b5fb-4eb1-b896-fe235a7bb0fe-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd\" (UID: \"423cdcad-b5fb-4eb1-b896-fe235a7bb0fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd" Jul 24 17:25:52.945744 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.945707 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/423cdcad-b5fb-4eb1-b896-fe235a7bb0fe-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd\" (UID: \"423cdcad-b5fb-4eb1-b896-fe235a7bb0fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd" Jul 24 17:25:52.947770 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.947722 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/423cdcad-b5fb-4eb1-b896-fe235a7bb0fe-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd\" (UID: \"423cdcad-b5fb-4eb1-b896-fe235a7bb0fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd" Jul 24 17:25:52.948162 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.948140 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/423cdcad-b5fb-4eb1-b896-fe235a7bb0fe-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd\" (UID: \"423cdcad-b5fb-4eb1-b896-fe235a7bb0fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd" Jul 24 17:25:52.955411 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.955383 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcm87\" (UniqueName: \"kubernetes.io/projected/423cdcad-b5fb-4eb1-b896-fe235a7bb0fe-kube-api-access-dcm87\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd\" (UID: \"423cdcad-b5fb-4eb1-b896-fe235a7bb0fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd" Jul 24 17:25:52.956411 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.956393 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/423cdcad-b5fb-4eb1-b896-fe235a7bb0fe-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd\" (UID: \"423cdcad-b5fb-4eb1-b896-fe235a7bb0fe\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd" Jul 24 17:25:52.976596 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:52.976573 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6"] Jul 24 17:25:52.978302 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:25:52.978280 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d002f30_96fa_4e8c_b52b_563cd77e971e.slice/crio-659dfcc22598298484030d085aa095622fcb07fe61b1a23f4e1b50a9ccedd384 WatchSource:0}: Error finding container 659dfcc22598298484030d085aa095622fcb07fe61b1a23f4e1b50a9ccedd384: Status 404 returned error can't find the container with id 659dfcc22598298484030d085aa095622fcb07fe61b1a23f4e1b50a9ccedd384 Jul 24 17:25:53.101653 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:53.101590 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd" Jul 24 17:25:53.268493 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:53.268470 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd"] Jul 24 17:25:53.269694 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:25:53.269670 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod423cdcad_b5fb_4eb1_b896_fe235a7bb0fe.slice/crio-257749d2f65d7ab7224f44408fe61502db5b021ebca309ac138cc3645e71cb3c WatchSource:0}: Error finding container 257749d2f65d7ab7224f44408fe61502db5b021ebca309ac138cc3645e71cb3c: Status 404 returned error can't find the container with id 257749d2f65d7ab7224f44408fe61502db5b021ebca309ac138cc3645e71cb3c Jul 24 17:25:53.533248 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:53.533217 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" event={"ID":"6d002f30-96fa-4e8c-b52b-563cd77e971e","Type":"ContainerStarted","Data":"659dfcc22598298484030d085aa095622fcb07fe61b1a23f4e1b50a9ccedd384"} Jul 24 17:25:53.534444 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:53.534416 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd" event={"ID":"423cdcad-b5fb-4eb1-b896-fe235a7bb0fe","Type":"ContainerStarted","Data":"257749d2f65d7ab7224f44408fe61502db5b021ebca309ac138cc3645e71cb3c"} Jul 24 17:25:53.535131 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:53.535110 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8" Jul 24 17:25:55.146846 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:55.146774 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-f895w"] Jul 24 17:25:55.154083 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:55.154049 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-f895w" Jul 24 17:25:55.157860 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:55.157834 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 24 17:25:55.158115 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:55.158077 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-x7sd9\"" Jul 24 17:25:55.179505 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:55.179403 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-f895w"] Jul 24 17:25:55.184606 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:55.184583 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-g4v8b"] Jul 24 17:25:55.189158 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:55.189134 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g4v8b" Jul 24 17:25:55.193556 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:55.193536 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-jftbt\"" Jul 24 17:25:55.195414 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:55.195393 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 24 17:25:55.222800 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:55.222770 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-g4v8b"] Jul 24 17:25:55.267445 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:55.267417 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ad8d83e-9ca4-428c-a946-c488ae19b5bd-cert\") pod \"kserve-controller-manager-d6f4b65b8-f895w\" (UID: \"4ad8d83e-9ca4-428c-a946-c488ae19b5bd\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-f895w" Jul 24 17:25:55.267605 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:55.267483 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdmt8\" (UniqueName: \"kubernetes.io/projected/ee3e514a-4214-42d9-af3e-ea7a04ec833b-kube-api-access-qdmt8\") pod \"llmisvc-controller-manager-777c6bd7d5-g4v8b\" (UID: \"ee3e514a-4214-42d9-af3e-ea7a04ec833b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g4v8b" Jul 24 17:25:55.267605 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:55.267507 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf7gf\" (UniqueName: \"kubernetes.io/projected/4ad8d83e-9ca4-428c-a946-c488ae19b5bd-kube-api-access-hf7gf\") pod \"kserve-controller-manager-d6f4b65b8-f895w\" (UID: \"4ad8d83e-9ca4-428c-a946-c488ae19b5bd\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-f895w" Jul 24 17:25:55.267605 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:55.267571 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee3e514a-4214-42d9-af3e-ea7a04ec833b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-g4v8b\" (UID: \"ee3e514a-4214-42d9-af3e-ea7a04ec833b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g4v8b" Jul 24 17:25:55.368319 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:55.368286 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ad8d83e-9ca4-428c-a946-c488ae19b5bd-cert\") pod \"kserve-controller-manager-d6f4b65b8-f895w\" (UID: \"4ad8d83e-9ca4-428c-a946-c488ae19b5bd\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-f895w" Jul 24 17:25:55.368550 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:55.368408 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdmt8\" (UniqueName: \"kubernetes.io/projected/ee3e514a-4214-42d9-af3e-ea7a04ec833b-kube-api-access-qdmt8\") pod \"llmisvc-controller-manager-777c6bd7d5-g4v8b\" (UID: \"ee3e514a-4214-42d9-af3e-ea7a04ec833b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g4v8b" Jul 24 17:25:55.368550 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:55.368438 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf7gf\" (UniqueName: \"kubernetes.io/projected/4ad8d83e-9ca4-428c-a946-c488ae19b5bd-kube-api-access-hf7gf\") pod \"kserve-controller-manager-d6f4b65b8-f895w\" (UID: \"4ad8d83e-9ca4-428c-a946-c488ae19b5bd\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-f895w" Jul 24 17:25:55.368550 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:55.368483 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee3e514a-4214-42d9-af3e-ea7a04ec833b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-g4v8b\" (UID: \"ee3e514a-4214-42d9-af3e-ea7a04ec833b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g4v8b" Jul 24 17:25:55.368707 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:25:55.368636 2570 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 24 17:25:55.368761 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:25:55.368721 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee3e514a-4214-42d9-af3e-ea7a04ec833b-cert podName:ee3e514a-4214-42d9-af3e-ea7a04ec833b nodeName:}" failed. No retries permitted until 2026-07-24 17:25:55.868699926 +0000 UTC m=+351.537110931 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ee3e514a-4214-42d9-af3e-ea7a04ec833b-cert") pod "llmisvc-controller-manager-777c6bd7d5-g4v8b" (UID: "ee3e514a-4214-42d9-af3e-ea7a04ec833b") : secret "llmisvc-webhook-server-cert" not found Jul 24 17:25:55.371172 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:55.371143 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4ad8d83e-9ca4-428c-a946-c488ae19b5bd-cert\") pod \"kserve-controller-manager-d6f4b65b8-f895w\" (UID: \"4ad8d83e-9ca4-428c-a946-c488ae19b5bd\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-f895w" Jul 24 17:25:55.379521 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:55.379494 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf7gf\" (UniqueName: \"kubernetes.io/projected/4ad8d83e-9ca4-428c-a946-c488ae19b5bd-kube-api-access-hf7gf\") pod \"kserve-controller-manager-d6f4b65b8-f895w\" (UID: \"4ad8d83e-9ca4-428c-a946-c488ae19b5bd\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-f895w" Jul 24 17:25:55.382119 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:55.382101 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdmt8\" (UniqueName: \"kubernetes.io/projected/ee3e514a-4214-42d9-af3e-ea7a04ec833b-kube-api-access-qdmt8\") pod \"llmisvc-controller-manager-777c6bd7d5-g4v8b\" (UID: \"ee3e514a-4214-42d9-af3e-ea7a04ec833b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g4v8b" Jul 24 17:25:55.467676 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:55.467605 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-f895w" Jul 24 17:25:55.872203 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:55.872172 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee3e514a-4214-42d9-af3e-ea7a04ec833b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-g4v8b\" (UID: \"ee3e514a-4214-42d9-af3e-ea7a04ec833b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g4v8b" Jul 24 17:25:55.872436 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:25:55.872325 2570 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: secret "llmisvc-webhook-server-cert" not found Jul 24 17:25:55.872436 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:25:55.872414 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ee3e514a-4214-42d9-af3e-ea7a04ec833b-cert podName:ee3e514a-4214-42d9-af3e-ea7a04ec833b nodeName:}" failed. No retries permitted until 2026-07-24 17:25:56.872399183 +0000 UTC m=+352.540810185 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/ee3e514a-4214-42d9-af3e-ea7a04ec833b-cert") pod "llmisvc-controller-manager-777c6bd7d5-g4v8b" (UID: "ee3e514a-4214-42d9-af3e-ea7a04ec833b") : secret "llmisvc-webhook-server-cert" not found Jul 24 17:25:55.917015 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:55.916964 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 24 17:25:55.917168 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:55.917059 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 24 17:25:55.917168 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:55.917100 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 24 17:25:55.923600 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:55.923566 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 24 17:25:55.923684 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:55.923641 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 24 17:25:55.923738 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:55.923686 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 24 17:25:55.967609 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:55.967583 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-f895w"] Jul 24 17:25:55.970640 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:25:55.970618 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ad8d83e_9ca4_428c_a946_c488ae19b5bd.slice/crio-d1c9faade755d394bbca54856789856e0e4a79e9d5d5cfdb0361b1fe7997a6b4 WatchSource:0}: Error finding container d1c9faade755d394bbca54856789856e0e4a79e9d5d5cfdb0361b1fe7997a6b4: Status 404 returned error can't find the container with id d1c9faade755d394bbca54856789856e0e4a79e9d5d5cfdb0361b1fe7997a6b4 Jul 24 17:25:56.189459 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.189429 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8"] Jul 24 17:25:56.189959 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.189588 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8" podUID="b7d45831-64b2-4047-b3a9-630f81403fb2" containerName="discovery" containerID="cri-o://ce8ce84bb6aad071569e4f78f34e2eeeb33ed2242ed911df798b1bf89c15a8c4" gracePeriod=30 Jul 24 17:25:56.457420 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.457359 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8" Jul 24 17:25:56.549908 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.549877 2570 generic.go:356] "Generic (PLEG): container finished" podID="b7d45831-64b2-4047-b3a9-630f81403fb2" containerID="ce8ce84bb6aad071569e4f78f34e2eeeb33ed2242ed911df798b1bf89c15a8c4" exitCode=0 Jul 24 17:25:56.550120 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.549923 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8" Jul 24 17:25:56.550120 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.549961 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8" event={"ID":"b7d45831-64b2-4047-b3a9-630f81403fb2","Type":"ContainerDied","Data":"ce8ce84bb6aad071569e4f78f34e2eeeb33ed2242ed911df798b1bf89c15a8c4"} Jul 24 17:25:56.550120 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.550011 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8" event={"ID":"b7d45831-64b2-4047-b3a9-630f81403fb2","Type":"ContainerDied","Data":"5a1a674ce277caf7130bef539e558bfd20abf8490786029a34c2949884410bed"} Jul 24 17:25:56.550120 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.550040 2570 scope.go:117] "RemoveContainer" containerID="ce8ce84bb6aad071569e4f78f34e2eeeb33ed2242ed911df798b1bf89c15a8c4" Jul 24 17:25:56.551582 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.551556 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd" event={"ID":"423cdcad-b5fb-4eb1-b896-fe235a7bb0fe","Type":"ContainerStarted","Data":"5030244c6070c307733a50199b2d3e91561f9ba8c38f770d057f56f20aea8d63"} Jul 24 17:25:56.553088 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.553063 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" event={"ID":"6d002f30-96fa-4e8c-b52b-563cd77e971e","Type":"ContainerStarted","Data":"95c53e4f8493f765a3df8656db0cc6fc1472d3fa6cafe591abb80de8bdb71872"} Jul 24 17:25:56.554200 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.554177 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-f895w" event={"ID":"4ad8d83e-9ca4-428c-a946-c488ae19b5bd","Type":"ContainerStarted","Data":"d1c9faade755d394bbca54856789856e0e4a79e9d5d5cfdb0361b1fe7997a6b4"} Jul 24 17:25:56.560732 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.560714 2570 scope.go:117] "RemoveContainer" containerID="ce8ce84bb6aad071569e4f78f34e2eeeb33ed2242ed911df798b1bf89c15a8c4" Jul 24 17:25:56.561164 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:25:56.561140 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ce8ce84bb6aad071569e4f78f34e2eeeb33ed2242ed911df798b1bf89c15a8c4\": container with ID starting with ce8ce84bb6aad071569e4f78f34e2eeeb33ed2242ed911df798b1bf89c15a8c4 not found: ID does not exist" containerID="ce8ce84bb6aad071569e4f78f34e2eeeb33ed2242ed911df798b1bf89c15a8c4" Jul 24 17:25:56.561230 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.561175 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ce8ce84bb6aad071569e4f78f34e2eeeb33ed2242ed911df798b1bf89c15a8c4"} err="failed to get container status \"ce8ce84bb6aad071569e4f78f34e2eeeb33ed2242ed911df798b1bf89c15a8c4\": rpc error: code = NotFound desc = could not find container \"ce8ce84bb6aad071569e4f78f34e2eeeb33ed2242ed911df798b1bf89c15a8c4\": container with ID starting with ce8ce84bb6aad071569e4f78f34e2eeeb33ed2242ed911df798b1bf89c15a8c4 not found: ID does not exist" Jul 24 17:25:56.579503 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.579482 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7d45831-64b2-4047-b3a9-630f81403fb2-istio-token\") pod \"b7d45831-64b2-4047-b3a9-630f81403fb2\" (UID: \"b7d45831-64b2-4047-b3a9-630f81403fb2\") " Jul 24 17:25:56.579584 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.579516 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b7d45831-64b2-4047-b3a9-630f81403fb2-cacerts\") pod \"b7d45831-64b2-4047-b3a9-630f81403fb2\" (UID: \"b7d45831-64b2-4047-b3a9-630f81403fb2\") " Jul 24 17:25:56.579584 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.579582 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7d45831-64b2-4047-b3a9-630f81403fb2-local-certs\") pod \"b7d45831-64b2-4047-b3a9-630f81403fb2\" (UID: \"b7d45831-64b2-4047-b3a9-630f81403fb2\") " Jul 24 17:25:56.579662 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.579620 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b7d45831-64b2-4047-b3a9-630f81403fb2-istio-csr-dns-cert\") pod \"b7d45831-64b2-4047-b3a9-630f81403fb2\" (UID: \"b7d45831-64b2-4047-b3a9-630f81403fb2\") " Jul 24 17:25:56.579662 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.579640 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b7d45831-64b2-4047-b3a9-630f81403fb2-istio-csr-ca-configmap\") pod \"b7d45831-64b2-4047-b3a9-630f81403fb2\" (UID: \"b7d45831-64b2-4047-b3a9-630f81403fb2\") " Jul 24 17:25:56.579747 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.579663 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-smdlh\" (UniqueName: \"kubernetes.io/projected/b7d45831-64b2-4047-b3a9-630f81403fb2-kube-api-access-smdlh\") pod \"b7d45831-64b2-4047-b3a9-630f81403fb2\" (UID: \"b7d45831-64b2-4047-b3a9-630f81403fb2\") " Jul 24 17:25:56.579747 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.579689 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b7d45831-64b2-4047-b3a9-630f81403fb2-istio-kubeconfig\") pod \"b7d45831-64b2-4047-b3a9-630f81403fb2\" (UID: \"b7d45831-64b2-4047-b3a9-630f81403fb2\") " Jul 24 17:25:56.580113 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.580065 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7d45831-64b2-4047-b3a9-630f81403fb2-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "b7d45831-64b2-4047-b3a9-630f81403fb2" (UID: "b7d45831-64b2-4047-b3a9-630f81403fb2"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 17:25:56.582526 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.582501 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7d45831-64b2-4047-b3a9-630f81403fb2-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "b7d45831-64b2-4047-b3a9-630f81403fb2" (UID: "b7d45831-64b2-4047-b3a9-630f81403fb2"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 17:25:56.582717 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.582690 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7d45831-64b2-4047-b3a9-630f81403fb2-local-certs" (OuterVolumeSpecName: "local-certs") pod "b7d45831-64b2-4047-b3a9-630f81403fb2" (UID: "b7d45831-64b2-4047-b3a9-630f81403fb2"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 17:25:56.582932 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.582912 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7d45831-64b2-4047-b3a9-630f81403fb2-cacerts" (OuterVolumeSpecName: "cacerts") pod "b7d45831-64b2-4047-b3a9-630f81403fb2" (UID: "b7d45831-64b2-4047-b3a9-630f81403fb2"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 17:25:56.583021 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.582942 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7d45831-64b2-4047-b3a9-630f81403fb2-istio-token" (OuterVolumeSpecName: "istio-token") pod "b7d45831-64b2-4047-b3a9-630f81403fb2" (UID: "b7d45831-64b2-4047-b3a9-630f81403fb2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 17:25:56.583380 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.583364 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7d45831-64b2-4047-b3a9-630f81403fb2-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "b7d45831-64b2-4047-b3a9-630f81403fb2" (UID: "b7d45831-64b2-4047-b3a9-630f81403fb2"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 17:25:56.583804 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.583786 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7d45831-64b2-4047-b3a9-630f81403fb2-kube-api-access-smdlh" (OuterVolumeSpecName: "kube-api-access-smdlh") pod "b7d45831-64b2-4047-b3a9-630f81403fb2" (UID: "b7d45831-64b2-4047-b3a9-630f81403fb2"). InnerVolumeSpecName "kube-api-access-smdlh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 17:25:56.583900 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.583863 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" podStartSLOduration=1.647495067 podStartE2EDuration="4.583850893s" totalImagesPullingTime="2.936355826s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:25:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:25:56.580992295 +0000 UTC m=+352.249403333" watchObservedRunningTime="2026-07-24 17:25:56.583850893 +0000 UTC m=+352.252261981" Jul 24 17:25:56.608407 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.608366 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd" podStartSLOduration=1.956793974 podStartE2EDuration="4.608352977s" totalImagesPullingTime="2.651559003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:25:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:25:56.606634576 +0000 UTC m=+352.275045594" watchObservedRunningTime="2026-07-24 17:25:56.608352977 +0000 UTC m=+352.276763995" Jul 24 17:25:56.680993 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.680970 2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b7d45831-64b2-4047-b3a9-630f81403fb2-istio-token\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:25:56.681113 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.681013 2570 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/b7d45831-64b2-4047-b3a9-630f81403fb2-cacerts\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:25:56.681113 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.681026 2570 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/b7d45831-64b2-4047-b3a9-630f81403fb2-local-certs\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:25:56.681113 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.681038 2570 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/b7d45831-64b2-4047-b3a9-630f81403fb2-istio-csr-dns-cert\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:25:56.681113 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.681051 2570 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/b7d45831-64b2-4047-b3a9-630f81403fb2-istio-csr-ca-configmap\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:25:56.681113 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.681064 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-smdlh\" (UniqueName: \"kubernetes.io/projected/b7d45831-64b2-4047-b3a9-630f81403fb2-kube-api-access-smdlh\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:25:56.681113 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.681076 2570 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b7d45831-64b2-4047-b3a9-630f81403fb2-istio-kubeconfig\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:25:56.815730 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.815650 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" Jul 24 17:25:56.817473 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.817448 2570 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 24 17:25:56.817619 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.817501 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" podUID="6d002f30-96fa-4e8c-b52b-563cd77e971e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 24 17:25:56.882220 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.882191 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee3e514a-4214-42d9-af3e-ea7a04ec833b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-g4v8b\" (UID: \"ee3e514a-4214-42d9-af3e-ea7a04ec833b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g4v8b" Jul 24 17:25:56.885136 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.885086 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ee3e514a-4214-42d9-af3e-ea7a04ec833b-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-g4v8b\" (UID: \"ee3e514a-4214-42d9-af3e-ea7a04ec833b\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g4v8b" Jul 24 17:25:56.911557 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.906107 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8"] Jul 24 17:25:56.921474 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:56.921428 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-zpmz8"] Jul 24 17:25:57.002019 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:57.001990 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g4v8b" Jul 24 17:25:57.102652 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:57.102622 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd" Jul 24 17:25:57.108555 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:57.108298 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd" Jul 24 17:25:57.150155 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:57.150132 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-g4v8b"] Jul 24 17:25:57.152147 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:25:57.152115 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podee3e514a_4214_42d9_af3e_ea7a04ec833b.slice/crio-ec89b2d621b9706b3c0b4a9152b853866acd66fce516d3e7fb38c3879dd2f81b WatchSource:0}: Error finding container ec89b2d621b9706b3c0b4a9152b853866acd66fce516d3e7fb38c3879dd2f81b: Status 404 returned error can't find the container with id ec89b2d621b9706b3c0b4a9152b853866acd66fce516d3e7fb38c3879dd2f81b Jul 24 17:25:57.560888 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:57.560855 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g4v8b" event={"ID":"ee3e514a-4214-42d9-af3e-ea7a04ec833b","Type":"ContainerStarted","Data":"ec89b2d621b9706b3c0b4a9152b853866acd66fce516d3e7fb38c3879dd2f81b"} Jul 24 17:25:57.561290 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:57.561017 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd" Jul 24 17:25:57.562053 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:57.562036 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd" Jul 24 17:25:57.654039 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:57.654010 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6"] Jul 24 17:25:57.815618 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:57.815516 2570 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 24 17:25:57.815618 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:57.815606 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" podUID="6d002f30-96fa-4e8c-b52b-563cd77e971e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 24 17:25:58.815115 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:58.815084 2570 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" start-of-body= Jul 24 17:25:58.815534 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:58.815157 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" podUID="6d002f30-96fa-4e8c-b52b-563cd77e971e" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.31:15021/healthz/ready\": dial tcp 10.134.0.31:15021: connect: connection refused" Jul 24 17:25:58.914197 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:58.914121 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7d45831-64b2-4047-b3a9-630f81403fb2" path="/var/lib/kubelet/pods/b7d45831-64b2-4047-b3a9-630f81403fb2/volumes" Jul 24 17:25:59.572187 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:59.572147 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-f895w" event={"ID":"4ad8d83e-9ca4-428c-a946-c488ae19b5bd","Type":"ContainerStarted","Data":"967301c5dbc523cfef1e98e045cab45e4896d6b56c7aa70c5e41cd60d6c41f27"} Jul 24 17:25:59.572415 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:59.572303 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-f895w" Jul 24 17:25:59.572546 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:59.572515 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" podUID="6d002f30-96fa-4e8c-b52b-563cd77e971e" containerName="istio-proxy" containerID="cri-o://95c53e4f8493f765a3df8656db0cc6fc1472d3fa6cafe591abb80de8bdb71872" gracePeriod=30 Jul 24 17:25:59.594290 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:25:59.594231 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-f895w" podStartSLOduration=1.762155658 podStartE2EDuration="4.594216053s" totalImagesPullingTime="2.832060395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:25:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:25:59.593526986 +0000 UTC m=+355.261938014" watchObservedRunningTime="2026-07-24 17:25:59.594216053 +0000 UTC m=+355.262627086" Jul 24 17:26:01.525764 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:01.525736 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-wqlns" Jul 24 17:26:01.527803 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:01.527782 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-pg8cg" Jul 24 17:26:01.585832 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:01.585792 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g4v8b" event={"ID":"ee3e514a-4214-42d9-af3e-ea7a04ec833b","Type":"ContainerStarted","Data":"9f844b5f9a787180fbbdbc3cfc5b08cf012f53b771135f9207e203695487fbbd"} Jul 24 17:26:01.585990 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:01.585934 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g4v8b" Jul 24 17:26:01.603545 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:01.603496 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g4v8b" podStartSLOduration=3.198622989 podStartE2EDuration="6.603480745s" totalImagesPullingTime="3.404857756s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:25:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:26:01.602893489 +0000 UTC m=+357.271304509" watchObservedRunningTime="2026-07-24 17:26:01.603480745 +0000 UTC m=+357.271891769" Jul 24 17:26:04.829897 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:04.829832 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" Jul 24 17:26:04.955448 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:04.955414 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d002f30-96fa-4e8c-b52b-563cd77e971e-credential-socket\") pod \"6d002f30-96fa-4e8c-b52b-563cd77e971e\" (UID: \"6d002f30-96fa-4e8c-b52b-563cd77e971e\") " Jul 24 17:26:04.955596 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:04.955457 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d002f30-96fa-4e8c-b52b-563cd77e971e-workload-socket\") pod \"6d002f30-96fa-4e8c-b52b-563cd77e971e\" (UID: \"6d002f30-96fa-4e8c-b52b-563cd77e971e\") " Jul 24 17:26:04.955596 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:04.955515 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d002f30-96fa-4e8c-b52b-563cd77e971e-istio-token\") pod \"6d002f30-96fa-4e8c-b52b-563cd77e971e\" (UID: \"6d002f30-96fa-4e8c-b52b-563cd77e971e\") " Jul 24 17:26:04.955596 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:04.955550 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d002f30-96fa-4e8c-b52b-563cd77e971e-istio-data\") pod \"6d002f30-96fa-4e8c-b52b-563cd77e971e\" (UID: \"6d002f30-96fa-4e8c-b52b-563cd77e971e\") " Jul 24 17:26:04.955762 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:04.955696 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d002f30-96fa-4e8c-b52b-563cd77e971e-istio-envoy\") pod \"6d002f30-96fa-4e8c-b52b-563cd77e971e\" (UID: \"6d002f30-96fa-4e8c-b52b-563cd77e971e\") " Jul 24 17:26:04.955818 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:04.955768 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d002f30-96fa-4e8c-b52b-563cd77e971e-istiod-ca-cert\") pod \"6d002f30-96fa-4e8c-b52b-563cd77e971e\" (UID: \"6d002f30-96fa-4e8c-b52b-563cd77e971e\") " Jul 24 17:26:04.955818 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:04.955795 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vn79q\" (UniqueName: \"kubernetes.io/projected/6d002f30-96fa-4e8c-b52b-563cd77e971e-kube-api-access-vn79q\") pod \"6d002f30-96fa-4e8c-b52b-563cd77e971e\" (UID: \"6d002f30-96fa-4e8c-b52b-563cd77e971e\") " Jul 24 17:26:04.955920 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:04.955823 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d002f30-96fa-4e8c-b52b-563cd77e971e-workload-certs\") pod \"6d002f30-96fa-4e8c-b52b-563cd77e971e\" (UID: \"6d002f30-96fa-4e8c-b52b-563cd77e971e\") " Jul 24 17:26:04.955920 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:04.955696 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d002f30-96fa-4e8c-b52b-563cd77e971e-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6d002f30-96fa-4e8c-b52b-563cd77e971e" (UID: "6d002f30-96fa-4e8c-b52b-563cd77e971e"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 17:26:04.955920 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:04.955806 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d002f30-96fa-4e8c-b52b-563cd77e971e-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6d002f30-96fa-4e8c-b52b-563cd77e971e" (UID: "6d002f30-96fa-4e8c-b52b-563cd77e971e"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 17:26:04.956059 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:04.955817 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d002f30-96fa-4e8c-b52b-563cd77e971e-istio-data" (OuterVolumeSpecName: "istio-data") pod "6d002f30-96fa-4e8c-b52b-563cd77e971e" (UID: "6d002f30-96fa-4e8c-b52b-563cd77e971e"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 17:26:04.956059 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:04.955963 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d002f30-96fa-4e8c-b52b-563cd77e971e-istio-podinfo\") pod \"6d002f30-96fa-4e8c-b52b-563cd77e971e\" (UID: \"6d002f30-96fa-4e8c-b52b-563cd77e971e\") " Jul 24 17:26:04.956059 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:04.956028 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d002f30-96fa-4e8c-b52b-563cd77e971e-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6d002f30-96fa-4e8c-b52b-563cd77e971e" (UID: "6d002f30-96fa-4e8c-b52b-563cd77e971e"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 17:26:04.956191 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:04.956133 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6d002f30-96fa-4e8c-b52b-563cd77e971e-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6d002f30-96fa-4e8c-b52b-563cd77e971e" (UID: "6d002f30-96fa-4e8c-b52b-563cd77e971e"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 17:26:04.956276 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:04.956259 2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6d002f30-96fa-4e8c-b52b-563cd77e971e-istio-data\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:26:04.956350 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:04.956281 2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6d002f30-96fa-4e8c-b52b-563cd77e971e-istiod-ca-cert\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:26:04.956350 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:04.956296 2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6d002f30-96fa-4e8c-b52b-563cd77e971e-workload-certs\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:26:04.956350 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:04.956310 2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d002f30-96fa-4e8c-b52b-563cd77e971e-credential-socket\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:26:04.956513 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:04.956323 2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6d002f30-96fa-4e8c-b52b-563cd77e971e-workload-socket\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:26:04.957966 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:04.957942 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d002f30-96fa-4e8c-b52b-563cd77e971e-istio-token" (OuterVolumeSpecName: "istio-token") pod "6d002f30-96fa-4e8c-b52b-563cd77e971e" (UID: "6d002f30-96fa-4e8c-b52b-563cd77e971e"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 17:26:04.958146 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:04.958127 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6d002f30-96fa-4e8c-b52b-563cd77e971e-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6d002f30-96fa-4e8c-b52b-563cd77e971e" (UID: "6d002f30-96fa-4e8c-b52b-563cd77e971e"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 17:26:04.958244 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:04.958226 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d002f30-96fa-4e8c-b52b-563cd77e971e-kube-api-access-vn79q" (OuterVolumeSpecName: "kube-api-access-vn79q") pod "6d002f30-96fa-4e8c-b52b-563cd77e971e" (UID: "6d002f30-96fa-4e8c-b52b-563cd77e971e"). InnerVolumeSpecName "kube-api-access-vn79q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 17:26:04.958322 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:04.958306 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d002f30-96fa-4e8c-b52b-563cd77e971e-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6d002f30-96fa-4e8c-b52b-563cd77e971e" (UID: "6d002f30-96fa-4e8c-b52b-563cd77e971e"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 17:26:05.056835 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:05.056812 2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6d002f30-96fa-4e8c-b52b-563cd77e971e-istio-token\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:26:05.056956 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:05.056839 2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6d002f30-96fa-4e8c-b52b-563cd77e971e-istio-envoy\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:26:05.056956 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:05.056853 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vn79q\" (UniqueName: \"kubernetes.io/projected/6d002f30-96fa-4e8c-b52b-563cd77e971e-kube-api-access-vn79q\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:26:05.056956 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:05.056865 2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6d002f30-96fa-4e8c-b52b-563cd77e971e-istio-podinfo\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:26:05.604216 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:05.604183 2570 generic.go:356] "Generic (PLEG): container finished" podID="6d002f30-96fa-4e8c-b52b-563cd77e971e" containerID="95c53e4f8493f765a3df8656db0cc6fc1472d3fa6cafe591abb80de8bdb71872" exitCode=0 Jul 24 17:26:05.604394 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:05.604229 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" Jul 24 17:26:05.604394 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:05.604237 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" event={"ID":"6d002f30-96fa-4e8c-b52b-563cd77e971e","Type":"ContainerDied","Data":"95c53e4f8493f765a3df8656db0cc6fc1472d3fa6cafe591abb80de8bdb71872"} Jul 24 17:26:05.604394 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:05.604274 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6" event={"ID":"6d002f30-96fa-4e8c-b52b-563cd77e971e","Type":"ContainerDied","Data":"659dfcc22598298484030d085aa095622fcb07fe61b1a23f4e1b50a9ccedd384"} Jul 24 17:26:05.604394 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:05.604293 2570 scope.go:117] "RemoveContainer" containerID="95c53e4f8493f765a3df8656db0cc6fc1472d3fa6cafe591abb80de8bdb71872" Jul 24 17:26:05.613147 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:05.613131 2570 scope.go:117] "RemoveContainer" containerID="95c53e4f8493f765a3df8656db0cc6fc1472d3fa6cafe591abb80de8bdb71872" Jul 24 17:26:05.613413 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:26:05.613396 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"95c53e4f8493f765a3df8656db0cc6fc1472d3fa6cafe591abb80de8bdb71872\": container with ID starting with 95c53e4f8493f765a3df8656db0cc6fc1472d3fa6cafe591abb80de8bdb71872 not found: ID does not exist" containerID="95c53e4f8493f765a3df8656db0cc6fc1472d3fa6cafe591abb80de8bdb71872" Jul 24 17:26:05.613464 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:05.613422 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"95c53e4f8493f765a3df8656db0cc6fc1472d3fa6cafe591abb80de8bdb71872"} err="failed to get container status \"95c53e4f8493f765a3df8656db0cc6fc1472d3fa6cafe591abb80de8bdb71872\": rpc error: code = NotFound desc = could not find container \"95c53e4f8493f765a3df8656db0cc6fc1472d3fa6cafe591abb80de8bdb71872\": container with ID starting with 95c53e4f8493f765a3df8656db0cc6fc1472d3fa6cafe591abb80de8bdb71872 not found: ID does not exist" Jul 24 17:26:05.626441 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:05.626424 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6"] Jul 24 17:26:05.633046 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:05.633029 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-fddd6c88c-8gbv6"] Jul 24 17:26:06.912794 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:06.912768 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d002f30-96fa-4e8c-b52b-563cd77e971e" path="/var/lib/kubelet/pods/6d002f30-96fa-4e8c-b52b-563cd77e971e/volumes" Jul 24 17:26:30.583126 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:30.583093 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-f895w" Jul 24 17:26:32.592828 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:32.592800 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-g4v8b" Jul 24 17:26:45.223273 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:45.223240 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ghrsb"] Jul 24 17:26:45.223639 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:45.223574 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d002f30-96fa-4e8c-b52b-563cd77e971e" containerName="istio-proxy" Jul 24 17:26:45.223639 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:45.223585 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d002f30-96fa-4e8c-b52b-563cd77e971e" containerName="istio-proxy" Jul 24 17:26:45.223639 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:45.223602 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7d45831-64b2-4047-b3a9-630f81403fb2" containerName="discovery" Jul 24 17:26:45.223639 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:45.223608 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7d45831-64b2-4047-b3a9-630f81403fb2" containerName="discovery" Jul 24 17:26:45.223770 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:45.223673 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7d45831-64b2-4047-b3a9-630f81403fb2" containerName="discovery" Jul 24 17:26:45.223770 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:45.223683 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d002f30-96fa-4e8c-b52b-563cd77e971e" containerName="istio-proxy" Jul 24 17:26:45.230673 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:45.230643 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ghrsb" Jul 24 17:26:45.234401 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:45.234380 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 24 17:26:45.234539 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:45.234380 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 24 17:26:45.234539 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:45.234381 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-5jlbp\"" Jul 24 17:26:45.240283 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:45.240258 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ghrsb"] Jul 24 17:26:45.261392 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:45.261369 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9pnk\" (UniqueName: \"kubernetes.io/projected/0a1f523a-e8e5-4cb2-aa49-759a89c354fb-kube-api-access-j9pnk\") pod \"kuadrant-operator-catalog-ghrsb\" (UID: \"0a1f523a-e8e5-4cb2-aa49-759a89c354fb\") " pod="kuadrant-system/kuadrant-operator-catalog-ghrsb" Jul 24 17:26:45.367267 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:45.362285 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9pnk\" (UniqueName: \"kubernetes.io/projected/0a1f523a-e8e5-4cb2-aa49-759a89c354fb-kube-api-access-j9pnk\") pod \"kuadrant-operator-catalog-ghrsb\" (UID: \"0a1f523a-e8e5-4cb2-aa49-759a89c354fb\") " pod="kuadrant-system/kuadrant-operator-catalog-ghrsb" Jul 24 17:26:45.370817 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:45.370783 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9pnk\" (UniqueName: \"kubernetes.io/projected/0a1f523a-e8e5-4cb2-aa49-759a89c354fb-kube-api-access-j9pnk\") pod \"kuadrant-operator-catalog-ghrsb\" (UID: \"0a1f523a-e8e5-4cb2-aa49-759a89c354fb\") " pod="kuadrant-system/kuadrant-operator-catalog-ghrsb" Jul 24 17:26:45.541354 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:45.541260 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ghrsb" Jul 24 17:26:45.572715 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:45.572682 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ghrsb"] Jul 24 17:26:45.669188 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:45.669165 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ghrsb"] Jul 24 17:26:45.671747 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:26:45.671724 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a1f523a_e8e5_4cb2_aa49_759a89c354fb.slice/crio-7be8378b52349a39a9aa4cef67dbff5910dab86b070204019d02eaeed2b720d9 WatchSource:0}: Error finding container 7be8378b52349a39a9aa4cef67dbff5910dab86b070204019d02eaeed2b720d9: Status 404 returned error can't find the container with id 7be8378b52349a39a9aa4cef67dbff5910dab86b070204019d02eaeed2b720d9 Jul 24 17:26:45.776153 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:45.776123 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ghrsb" event={"ID":"0a1f523a-e8e5-4cb2-aa49-759a89c354fb","Type":"ContainerStarted","Data":"7be8378b52349a39a9aa4cef67dbff5910dab86b070204019d02eaeed2b720d9"} Jul 24 17:26:45.780865 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:45.780838 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hb7fp"] Jul 24 17:26:45.783485 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:45.783469 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hb7fp" Jul 24 17:26:45.792075 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:45.792022 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hb7fp"] Jul 24 17:26:45.867637 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:45.867617 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6rwgx\" (UniqueName: \"kubernetes.io/projected/e39c3c22-3d43-4317-9b60-575e85e03ffa-kube-api-access-6rwgx\") pod \"kuadrant-operator-catalog-hb7fp\" (UID: \"e39c3c22-3d43-4317-9b60-575e85e03ffa\") " pod="kuadrant-system/kuadrant-operator-catalog-hb7fp" Jul 24 17:26:45.968096 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:45.968069 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6rwgx\" (UniqueName: \"kubernetes.io/projected/e39c3c22-3d43-4317-9b60-575e85e03ffa-kube-api-access-6rwgx\") pod \"kuadrant-operator-catalog-hb7fp\" (UID: \"e39c3c22-3d43-4317-9b60-575e85e03ffa\") " pod="kuadrant-system/kuadrant-operator-catalog-hb7fp" Jul 24 17:26:45.977350 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:45.977313 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6rwgx\" (UniqueName: \"kubernetes.io/projected/e39c3c22-3d43-4317-9b60-575e85e03ffa-kube-api-access-6rwgx\") pod \"kuadrant-operator-catalog-hb7fp\" (UID: \"e39c3c22-3d43-4317-9b60-575e85e03ffa\") " pod="kuadrant-system/kuadrant-operator-catalog-hb7fp" Jul 24 17:26:46.094074 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:46.094001 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-hb7fp" Jul 24 17:26:46.240317 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:46.240293 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-hb7fp"] Jul 24 17:26:46.242167 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:26:46.242141 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode39c3c22_3d43_4317_9b60_575e85e03ffa.slice/crio-b525aee39b00de5c6dcd1490c3f0c3c984226326f4dabf2d96a1f9cc6bb26ffe WatchSource:0}: Error finding container b525aee39b00de5c6dcd1490c3f0c3c984226326f4dabf2d96a1f9cc6bb26ffe: Status 404 returned error can't find the container with id b525aee39b00de5c6dcd1490c3f0c3c984226326f4dabf2d96a1f9cc6bb26ffe Jul 24 17:26:46.783270 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:46.783226 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hb7fp" event={"ID":"e39c3c22-3d43-4317-9b60-575e85e03ffa","Type":"ContainerStarted","Data":"b525aee39b00de5c6dcd1490c3f0c3c984226326f4dabf2d96a1f9cc6bb26ffe"} Jul 24 17:26:48.794727 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:48.794690 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ghrsb" event={"ID":"0a1f523a-e8e5-4cb2-aa49-759a89c354fb","Type":"ContainerStarted","Data":"26a70ad9b10fecfabf1bf71473361f18271d75f4ce287c30857d9b1e3914b0e1"} Jul 24 17:26:48.795176 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:48.794745 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-ghrsb" podUID="0a1f523a-e8e5-4cb2-aa49-759a89c354fb" containerName="registry-server" containerID="cri-o://26a70ad9b10fecfabf1bf71473361f18271d75f4ce287c30857d9b1e3914b0e1" gracePeriod=2 Jul 24 17:26:48.796289 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:48.796265 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-hb7fp" event={"ID":"e39c3c22-3d43-4317-9b60-575e85e03ffa","Type":"ContainerStarted","Data":"98e262ecd71485659c0f91a936b15adf5852d8484b9b6551d6cd224fb85275b1"} Jul 24 17:26:48.812280 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:48.812242 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-ghrsb" podStartSLOduration=1.6582871799999999 podStartE2EDuration="3.812230396s" totalImagesPullingTime="2.153943216s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:26:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:26:48.81014562 +0000 UTC m=+404.478556646" watchObservedRunningTime="2026-07-24 17:26:48.812230396 +0000 UTC m=+404.480641420" Jul 24 17:26:48.825901 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:48.825861 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-hb7fp" podStartSLOduration=2.242197032 podStartE2EDuration="3.825849252s" totalImagesPullingTime="1.58365222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:26:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:26:48.824992304 +0000 UTC m=+404.493403329" watchObservedRunningTime="2026-07-24 17:26:48.825849252 +0000 UTC m=+404.494260275" Jul 24 17:26:49.040692 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:49.040670 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ghrsb" Jul 24 17:26:49.093677 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:49.093606 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j9pnk\" (UniqueName: \"kubernetes.io/projected/0a1f523a-e8e5-4cb2-aa49-759a89c354fb-kube-api-access-j9pnk\") pod \"0a1f523a-e8e5-4cb2-aa49-759a89c354fb\" (UID: \"0a1f523a-e8e5-4cb2-aa49-759a89c354fb\") " Jul 24 17:26:49.095762 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:49.095738 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a1f523a-e8e5-4cb2-aa49-759a89c354fb-kube-api-access-j9pnk" (OuterVolumeSpecName: "kube-api-access-j9pnk") pod "0a1f523a-e8e5-4cb2-aa49-759a89c354fb" (UID: "0a1f523a-e8e5-4cb2-aa49-759a89c354fb"). InnerVolumeSpecName "kube-api-access-j9pnk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 17:26:49.194599 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:49.194577 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j9pnk\" (UniqueName: \"kubernetes.io/projected/0a1f523a-e8e5-4cb2-aa49-759a89c354fb-kube-api-access-j9pnk\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:26:49.802125 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:49.802086 2570 generic.go:356] "Generic (PLEG): container finished" podID="0a1f523a-e8e5-4cb2-aa49-759a89c354fb" containerID="26a70ad9b10fecfabf1bf71473361f18271d75f4ce287c30857d9b1e3914b0e1" exitCode=0 Jul 24 17:26:49.803536 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:49.803513 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ghrsb" Jul 24 17:26:49.807640 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:49.807032 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ghrsb" event={"ID":"0a1f523a-e8e5-4cb2-aa49-759a89c354fb","Type":"ContainerDied","Data":"26a70ad9b10fecfabf1bf71473361f18271d75f4ce287c30857d9b1e3914b0e1"} Jul 24 17:26:49.807640 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:49.807138 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ghrsb" event={"ID":"0a1f523a-e8e5-4cb2-aa49-759a89c354fb","Type":"ContainerDied","Data":"7be8378b52349a39a9aa4cef67dbff5910dab86b070204019d02eaeed2b720d9"} Jul 24 17:26:49.807640 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:49.807178 2570 scope.go:117] "RemoveContainer" containerID="26a70ad9b10fecfabf1bf71473361f18271d75f4ce287c30857d9b1e3914b0e1" Jul 24 17:26:49.816799 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:49.816781 2570 scope.go:117] "RemoveContainer" containerID="26a70ad9b10fecfabf1bf71473361f18271d75f4ce287c30857d9b1e3914b0e1" Jul 24 17:26:49.817041 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:26:49.817024 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26a70ad9b10fecfabf1bf71473361f18271d75f4ce287c30857d9b1e3914b0e1\": container with ID starting with 26a70ad9b10fecfabf1bf71473361f18271d75f4ce287c30857d9b1e3914b0e1 not found: ID does not exist" containerID="26a70ad9b10fecfabf1bf71473361f18271d75f4ce287c30857d9b1e3914b0e1" Jul 24 17:26:49.817110 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:49.817046 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26a70ad9b10fecfabf1bf71473361f18271d75f4ce287c30857d9b1e3914b0e1"} err="failed to get container status \"26a70ad9b10fecfabf1bf71473361f18271d75f4ce287c30857d9b1e3914b0e1\": rpc error: code = NotFound desc = could not find container \"26a70ad9b10fecfabf1bf71473361f18271d75f4ce287c30857d9b1e3914b0e1\": container with ID starting with 26a70ad9b10fecfabf1bf71473361f18271d75f4ce287c30857d9b1e3914b0e1 not found: ID does not exist" Jul 24 17:26:49.827320 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:49.827300 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ghrsb"] Jul 24 17:26:49.830577 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:49.830560 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ghrsb"] Jul 24 17:26:50.912972 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:50.912939 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0a1f523a-e8e5-4cb2-aa49-759a89c354fb" path="/var/lib/kubelet/pods/0a1f523a-e8e5-4cb2-aa49-759a89c354fb/volumes" Jul 24 17:26:56.094529 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:56.094495 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-hb7fp" Jul 24 17:26:56.094994 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:56.094591 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-hb7fp" Jul 24 17:26:56.115721 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:56.115692 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-hb7fp" Jul 24 17:26:56.857858 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:56.857830 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-hb7fp" Jul 24 17:26:59.259903 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:59.259870 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-8467dcb8cc-jtg6w"] Jul 24 17:26:59.260262 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:59.260238 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a1f523a-e8e5-4cb2-aa49-759a89c354fb" containerName="registry-server" Jul 24 17:26:59.260262 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:59.260249 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a1f523a-e8e5-4cb2-aa49-759a89c354fb" containerName="registry-server" Jul 24 17:26:59.260356 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:59.260324 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a1f523a-e8e5-4cb2-aa49-759a89c354fb" containerName="registry-server" Jul 24 17:26:59.263399 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:59.263381 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8467dcb8cc-jtg6w" Jul 24 17:26:59.273976 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:59.273955 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8467dcb8cc-jtg6w"] Jul 24 17:26:59.376481 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:59.376449 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1b60958-6a16-4413-9571-a41f3d8247e1-console-oauth-config\") pod \"console-8467dcb8cc-jtg6w\" (UID: \"f1b60958-6a16-4413-9571-a41f3d8247e1\") " pod="openshift-console/console-8467dcb8cc-jtg6w" Jul 24 17:26:59.376599 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:59.376483 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1b60958-6a16-4413-9571-a41f3d8247e1-console-serving-cert\") pod \"console-8467dcb8cc-jtg6w\" (UID: \"f1b60958-6a16-4413-9571-a41f3d8247e1\") " pod="openshift-console/console-8467dcb8cc-jtg6w" Jul 24 17:26:59.376599 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:59.376513 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mh8kz\" (UniqueName: \"kubernetes.io/projected/f1b60958-6a16-4413-9571-a41f3d8247e1-kube-api-access-mh8kz\") pod \"console-8467dcb8cc-jtg6w\" (UID: \"f1b60958-6a16-4413-9571-a41f3d8247e1\") " pod="openshift-console/console-8467dcb8cc-jtg6w" Jul 24 17:26:59.376599 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:59.376567 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1b60958-6a16-4413-9571-a41f3d8247e1-oauth-serving-cert\") pod \"console-8467dcb8cc-jtg6w\" (UID: \"f1b60958-6a16-4413-9571-a41f3d8247e1\") " pod="openshift-console/console-8467dcb8cc-jtg6w" Jul 24 17:26:59.376712 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:59.376612 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1b60958-6a16-4413-9571-a41f3d8247e1-trusted-ca-bundle\") pod \"console-8467dcb8cc-jtg6w\" (UID: \"f1b60958-6a16-4413-9571-a41f3d8247e1\") " pod="openshift-console/console-8467dcb8cc-jtg6w" Jul 24 17:26:59.376712 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:59.376641 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1b60958-6a16-4413-9571-a41f3d8247e1-console-config\") pod \"console-8467dcb8cc-jtg6w\" (UID: \"f1b60958-6a16-4413-9571-a41f3d8247e1\") " pod="openshift-console/console-8467dcb8cc-jtg6w" Jul 24 17:26:59.376712 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:59.376659 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1b60958-6a16-4413-9571-a41f3d8247e1-service-ca\") pod \"console-8467dcb8cc-jtg6w\" (UID: \"f1b60958-6a16-4413-9571-a41f3d8247e1\") " pod="openshift-console/console-8467dcb8cc-jtg6w" Jul 24 17:26:59.477033 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:59.477012 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1b60958-6a16-4413-9571-a41f3d8247e1-console-oauth-config\") pod \"console-8467dcb8cc-jtg6w\" (UID: \"f1b60958-6a16-4413-9571-a41f3d8247e1\") " pod="openshift-console/console-8467dcb8cc-jtg6w" Jul 24 17:26:59.477137 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:59.477039 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1b60958-6a16-4413-9571-a41f3d8247e1-console-serving-cert\") pod \"console-8467dcb8cc-jtg6w\" (UID: \"f1b60958-6a16-4413-9571-a41f3d8247e1\") " pod="openshift-console/console-8467dcb8cc-jtg6w" Jul 24 17:26:59.477137 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:59.477053 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mh8kz\" (UniqueName: \"kubernetes.io/projected/f1b60958-6a16-4413-9571-a41f3d8247e1-kube-api-access-mh8kz\") pod \"console-8467dcb8cc-jtg6w\" (UID: \"f1b60958-6a16-4413-9571-a41f3d8247e1\") " pod="openshift-console/console-8467dcb8cc-jtg6w" Jul 24 17:26:59.477137 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:59.477074 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1b60958-6a16-4413-9571-a41f3d8247e1-oauth-serving-cert\") pod \"console-8467dcb8cc-jtg6w\" (UID: \"f1b60958-6a16-4413-9571-a41f3d8247e1\") " pod="openshift-console/console-8467dcb8cc-jtg6w" Jul 24 17:26:59.477137 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:59.477098 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1b60958-6a16-4413-9571-a41f3d8247e1-trusted-ca-bundle\") pod \"console-8467dcb8cc-jtg6w\" (UID: \"f1b60958-6a16-4413-9571-a41f3d8247e1\") " pod="openshift-console/console-8467dcb8cc-jtg6w" Jul 24 17:26:59.477311 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:59.477149 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1b60958-6a16-4413-9571-a41f3d8247e1-console-config\") pod \"console-8467dcb8cc-jtg6w\" (UID: \"f1b60958-6a16-4413-9571-a41f3d8247e1\") " pod="openshift-console/console-8467dcb8cc-jtg6w" Jul 24 17:26:59.477311 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:59.477173 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1b60958-6a16-4413-9571-a41f3d8247e1-service-ca\") pod \"console-8467dcb8cc-jtg6w\" (UID: \"f1b60958-6a16-4413-9571-a41f3d8247e1\") " pod="openshift-console/console-8467dcb8cc-jtg6w" Jul 24 17:26:59.477931 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:59.477886 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f1b60958-6a16-4413-9571-a41f3d8247e1-oauth-serving-cert\") pod \"console-8467dcb8cc-jtg6w\" (UID: \"f1b60958-6a16-4413-9571-a41f3d8247e1\") " pod="openshift-console/console-8467dcb8cc-jtg6w" Jul 24 17:26:59.478032 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:59.477957 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f1b60958-6a16-4413-9571-a41f3d8247e1-service-ca\") pod \"console-8467dcb8cc-jtg6w\" (UID: \"f1b60958-6a16-4413-9571-a41f3d8247e1\") " pod="openshift-console/console-8467dcb8cc-jtg6w" Jul 24 17:26:59.478032 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:59.477966 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f1b60958-6a16-4413-9571-a41f3d8247e1-console-config\") pod \"console-8467dcb8cc-jtg6w\" (UID: \"f1b60958-6a16-4413-9571-a41f3d8247e1\") " pod="openshift-console/console-8467dcb8cc-jtg6w" Jul 24 17:26:59.478108 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:59.478077 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f1b60958-6a16-4413-9571-a41f3d8247e1-trusted-ca-bundle\") pod \"console-8467dcb8cc-jtg6w\" (UID: \"f1b60958-6a16-4413-9571-a41f3d8247e1\") " pod="openshift-console/console-8467dcb8cc-jtg6w" Jul 24 17:26:59.479589 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:59.479565 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f1b60958-6a16-4413-9571-a41f3d8247e1-console-oauth-config\") pod \"console-8467dcb8cc-jtg6w\" (UID: \"f1b60958-6a16-4413-9571-a41f3d8247e1\") " pod="openshift-console/console-8467dcb8cc-jtg6w" Jul 24 17:26:59.479676 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:59.479657 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f1b60958-6a16-4413-9571-a41f3d8247e1-console-serving-cert\") pod \"console-8467dcb8cc-jtg6w\" (UID: \"f1b60958-6a16-4413-9571-a41f3d8247e1\") " pod="openshift-console/console-8467dcb8cc-jtg6w" Jul 24 17:26:59.485829 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:59.485809 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mh8kz\" (UniqueName: \"kubernetes.io/projected/f1b60958-6a16-4413-9571-a41f3d8247e1-kube-api-access-mh8kz\") pod \"console-8467dcb8cc-jtg6w\" (UID: \"f1b60958-6a16-4413-9571-a41f3d8247e1\") " pod="openshift-console/console-8467dcb8cc-jtg6w" Jul 24 17:26:59.572887 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:59.572818 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-8467dcb8cc-jtg6w" Jul 24 17:26:59.706691 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:59.706666 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-8467dcb8cc-jtg6w"] Jul 24 17:26:59.708828 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:26:59.708797 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1b60958_6a16_4413_9571_a41f3d8247e1.slice/crio-911c62c348d924121ea3d523cd1f29a743652050ddccc06746cafe0774477f00 WatchSource:0}: Error finding container 911c62c348d924121ea3d523cd1f29a743652050ddccc06746cafe0774477f00: Status 404 returned error can't find the container with id 911c62c348d924121ea3d523cd1f29a743652050ddccc06746cafe0774477f00 Jul 24 17:26:59.850688 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:59.850603 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8467dcb8cc-jtg6w" event={"ID":"f1b60958-6a16-4413-9571-a41f3d8247e1","Type":"ContainerStarted","Data":"c128c3fced1d3cc05c5191988588c6a38803a4261e333b04c537a9b433e4f58b"} Jul 24 17:26:59.850688 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:59.850658 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-8467dcb8cc-jtg6w" event={"ID":"f1b60958-6a16-4413-9571-a41f3d8247e1","Type":"ContainerStarted","Data":"911c62c348d924121ea3d523cd1f29a743652050ddccc06746cafe0774477f00"} Jul 24 17:26:59.869955 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:26:59.869914 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-8467dcb8cc-jtg6w" podStartSLOduration=0.869899013 podStartE2EDuration="869.899013ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:26:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:26:59.86868678 +0000 UTC m=+415.537097814" watchObservedRunningTime="2026-07-24 17:26:59.869899013 +0000 UTC m=+415.538310037" Jul 24 17:27:00.619068 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:00.619039 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qchvs"] Jul 24 17:27:00.622731 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:00.622714 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qchvs" Jul 24 17:27:00.625869 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:00.625843 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-b2jbn\"" Jul 24 17:27:00.632864 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:00.632841 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qchvs"] Jul 24 17:27:00.689538 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:00.689505 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7b5f426-51f9-419e-87bf-adbeb31f99e0-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qchvs\" (UID: \"a7b5f426-51f9-419e-87bf-adbeb31f99e0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qchvs" Jul 24 17:27:00.689653 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:00.689548 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7b5f426-51f9-419e-87bf-adbeb31f99e0-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qchvs\" (UID: \"a7b5f426-51f9-419e-87bf-adbeb31f99e0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qchvs" Jul 24 17:27:00.689653 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:00.689580 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vq884\" (UniqueName: \"kubernetes.io/projected/a7b5f426-51f9-419e-87bf-adbeb31f99e0-kube-api-access-vq884\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qchvs\" (UID: \"a7b5f426-51f9-419e-87bf-adbeb31f99e0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qchvs" Jul 24 17:27:00.790324 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:00.790296 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7b5f426-51f9-419e-87bf-adbeb31f99e0-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qchvs\" (UID: \"a7b5f426-51f9-419e-87bf-adbeb31f99e0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qchvs" Jul 24 17:27:00.790478 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:00.790327 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7b5f426-51f9-419e-87bf-adbeb31f99e0-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qchvs\" (UID: \"a7b5f426-51f9-419e-87bf-adbeb31f99e0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qchvs" Jul 24 17:27:00.790478 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:00.790379 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vq884\" (UniqueName: \"kubernetes.io/projected/a7b5f426-51f9-419e-87bf-adbeb31f99e0-kube-api-access-vq884\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qchvs\" (UID: \"a7b5f426-51f9-419e-87bf-adbeb31f99e0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qchvs" Jul 24 17:27:00.790741 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:00.790719 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7b5f426-51f9-419e-87bf-adbeb31f99e0-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qchvs\" (UID: \"a7b5f426-51f9-419e-87bf-adbeb31f99e0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qchvs" Jul 24 17:27:00.790797 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:00.790730 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7b5f426-51f9-419e-87bf-adbeb31f99e0-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qchvs\" (UID: \"a7b5f426-51f9-419e-87bf-adbeb31f99e0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qchvs" Jul 24 17:27:00.799610 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:00.799583 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vq884\" (UniqueName: \"kubernetes.io/projected/a7b5f426-51f9-419e-87bf-adbeb31f99e0-kube-api-access-vq884\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qchvs\" (UID: \"a7b5f426-51f9-419e-87bf-adbeb31f99e0\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qchvs" Jul 24 17:27:00.932361 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:00.932291 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qchvs" Jul 24 17:27:01.064624 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:01.064598 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qchvs"] Jul 24 17:27:01.066141 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:27:01.066117 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7b5f426_51f9_419e_87bf_adbeb31f99e0.slice/crio-156d6199a9a0fd943364fa281f7b02ec8cef6ace2102782d95c79d84405c7ea1 WatchSource:0}: Error finding container 156d6199a9a0fd943364fa281f7b02ec8cef6ace2102782d95c79d84405c7ea1: Status 404 returned error can't find the container with id 156d6199a9a0fd943364fa281f7b02ec8cef6ace2102782d95c79d84405c7ea1 Jul 24 17:27:01.223710 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:01.223638 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ss2tc"] Jul 24 17:27:01.227067 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:01.227052 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ss2tc" Jul 24 17:27:01.235406 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:01.235384 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ss2tc"] Jul 24 17:27:01.296558 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:01.296529 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21e16a0d-c14b-4db4-b1ac-77774ab24b32-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ss2tc\" (UID: \"21e16a0d-c14b-4db4-b1ac-77774ab24b32\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ss2tc" Jul 24 17:27:01.296683 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:01.296574 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21e16a0d-c14b-4db4-b1ac-77774ab24b32-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ss2tc\" (UID: \"21e16a0d-c14b-4db4-b1ac-77774ab24b32\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ss2tc" Jul 24 17:27:01.296683 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:01.296611 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vn6b7\" (UniqueName: \"kubernetes.io/projected/21e16a0d-c14b-4db4-b1ac-77774ab24b32-kube-api-access-vn6b7\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ss2tc\" (UID: \"21e16a0d-c14b-4db4-b1ac-77774ab24b32\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ss2tc" Jul 24 17:27:01.397777 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:01.397749 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21e16a0d-c14b-4db4-b1ac-77774ab24b32-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ss2tc\" (UID: \"21e16a0d-c14b-4db4-b1ac-77774ab24b32\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ss2tc" Jul 24 17:27:01.397971 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:01.397833 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21e16a0d-c14b-4db4-b1ac-77774ab24b32-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ss2tc\" (UID: \"21e16a0d-c14b-4db4-b1ac-77774ab24b32\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ss2tc" Jul 24 17:27:01.397971 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:01.397877 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vn6b7\" (UniqueName: \"kubernetes.io/projected/21e16a0d-c14b-4db4-b1ac-77774ab24b32-kube-api-access-vn6b7\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ss2tc\" (UID: \"21e16a0d-c14b-4db4-b1ac-77774ab24b32\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ss2tc" Jul 24 17:27:01.398202 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:01.397970 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21e16a0d-c14b-4db4-b1ac-77774ab24b32-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ss2tc\" (UID: \"21e16a0d-c14b-4db4-b1ac-77774ab24b32\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ss2tc" Jul 24 17:27:01.398202 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:01.398084 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21e16a0d-c14b-4db4-b1ac-77774ab24b32-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ss2tc\" (UID: \"21e16a0d-c14b-4db4-b1ac-77774ab24b32\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ss2tc" Jul 24 17:27:01.407140 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:01.407115 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vn6b7\" (UniqueName: \"kubernetes.io/projected/21e16a0d-c14b-4db4-b1ac-77774ab24b32-kube-api-access-vn6b7\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ss2tc\" (UID: \"21e16a0d-c14b-4db4-b1ac-77774ab24b32\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ss2tc" Jul 24 17:27:01.536684 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:01.536623 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ss2tc" Jul 24 17:27:01.666147 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:01.666120 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ss2tc"] Jul 24 17:27:01.668442 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:27:01.668418 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21e16a0d_c14b_4db4_b1ac_77774ab24b32.slice/crio-6fc485066c9b0c80e76dfe78ba2aea8fab1d5b79714379eb6bc4ce2a0a60d05b WatchSource:0}: Error finding container 6fc485066c9b0c80e76dfe78ba2aea8fab1d5b79714379eb6bc4ce2a0a60d05b: Status 404 returned error can't find the container with id 6fc485066c9b0c80e76dfe78ba2aea8fab1d5b79714379eb6bc4ce2a0a60d05b Jul 24 17:27:01.824484 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:01.824430 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rpkht"] Jul 24 17:27:01.827923 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:01.827909 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rpkht" Jul 24 17:27:01.836816 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:01.836791 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rpkht"] Jul 24 17:27:01.860809 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:01.860783 2570 generic.go:356] "Generic (PLEG): container finished" podID="a7b5f426-51f9-419e-87bf-adbeb31f99e0" containerID="7f146f9c5da1d570d72c23cff2ca156559eea6e1d71ade502c8b850a8aaba329" exitCode=0 Jul 24 17:27:01.860928 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:01.860879 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qchvs" event={"ID":"a7b5f426-51f9-419e-87bf-adbeb31f99e0","Type":"ContainerDied","Data":"7f146f9c5da1d570d72c23cff2ca156559eea6e1d71ade502c8b850a8aaba329"} Jul 24 17:27:01.860996 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:01.860930 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qchvs" event={"ID":"a7b5f426-51f9-419e-87bf-adbeb31f99e0","Type":"ContainerStarted","Data":"156d6199a9a0fd943364fa281f7b02ec8cef6ace2102782d95c79d84405c7ea1"} Jul 24 17:27:01.862448 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:01.862424 2570 generic.go:356] "Generic (PLEG): container finished" podID="21e16a0d-c14b-4db4-b1ac-77774ab24b32" containerID="51c8bd878e32f8a0399f9d7b9e02c22645bbc38da1076f3a253d6d6a1f300d9e" exitCode=0 Jul 24 17:27:01.862537 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:01.862504 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ss2tc" event={"ID":"21e16a0d-c14b-4db4-b1ac-77774ab24b32","Type":"ContainerDied","Data":"51c8bd878e32f8a0399f9d7b9e02c22645bbc38da1076f3a253d6d6a1f300d9e"} Jul 24 17:27:01.862604 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:01.862546 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ss2tc" event={"ID":"21e16a0d-c14b-4db4-b1ac-77774ab24b32","Type":"ContainerStarted","Data":"6fc485066c9b0c80e76dfe78ba2aea8fab1d5b79714379eb6bc4ce2a0a60d05b"} Jul 24 17:27:01.902740 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:01.902721 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63c97bbf-d9b4-423a-990a-b1c1737e58d8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rpkht\" (UID: \"63c97bbf-d9b4-423a-990a-b1c1737e58d8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rpkht" Jul 24 17:27:01.902823 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:01.902746 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wgnxp\" (UniqueName: \"kubernetes.io/projected/63c97bbf-d9b4-423a-990a-b1c1737e58d8-kube-api-access-wgnxp\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rpkht\" (UID: \"63c97bbf-d9b4-423a-990a-b1c1737e58d8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rpkht" Jul 24 17:27:01.902872 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:01.902854 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63c97bbf-d9b4-423a-990a-b1c1737e58d8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rpkht\" (UID: \"63c97bbf-d9b4-423a-990a-b1c1737e58d8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rpkht" Jul 24 17:27:02.004237 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:02.004206 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63c97bbf-d9b4-423a-990a-b1c1737e58d8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rpkht\" (UID: \"63c97bbf-d9b4-423a-990a-b1c1737e58d8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rpkht" Jul 24 17:27:02.004452 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:02.004432 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63c97bbf-d9b4-423a-990a-b1c1737e58d8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rpkht\" (UID: \"63c97bbf-d9b4-423a-990a-b1c1737e58d8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rpkht" Jul 24 17:27:02.004527 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:02.004467 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wgnxp\" (UniqueName: \"kubernetes.io/projected/63c97bbf-d9b4-423a-990a-b1c1737e58d8-kube-api-access-wgnxp\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rpkht\" (UID: \"63c97bbf-d9b4-423a-990a-b1c1737e58d8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rpkht" Jul 24 17:27:02.004611 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:02.004589 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63c97bbf-d9b4-423a-990a-b1c1737e58d8-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rpkht\" (UID: \"63c97bbf-d9b4-423a-990a-b1c1737e58d8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rpkht" Jul 24 17:27:02.004779 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:02.004759 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63c97bbf-d9b4-423a-990a-b1c1737e58d8-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rpkht\" (UID: \"63c97bbf-d9b4-423a-990a-b1c1737e58d8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rpkht" Jul 24 17:27:02.013503 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:02.013480 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wgnxp\" (UniqueName: \"kubernetes.io/projected/63c97bbf-d9b4-423a-990a-b1c1737e58d8-kube-api-access-wgnxp\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rpkht\" (UID: \"63c97bbf-d9b4-423a-990a-b1c1737e58d8\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rpkht" Jul 24 17:27:02.145613 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:02.145591 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rpkht" Jul 24 17:27:02.234246 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:02.234218 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dct6g"] Jul 24 17:27:02.241173 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:02.241150 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dct6g" Jul 24 17:27:02.253784 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:02.253762 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dct6g"] Jul 24 17:27:02.278206 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:02.278188 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rpkht"] Jul 24 17:27:02.280244 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:27:02.280224 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63c97bbf_d9b4_423a_990a_b1c1737e58d8.slice/crio-a37840af7a64c4a28f5f1ffa3062a8813cd908e83442f24e276a36e6ae53916a WatchSource:0}: Error finding container a37840af7a64c4a28f5f1ffa3062a8813cd908e83442f24e276a36e6ae53916a: Status 404 returned error can't find the container with id a37840af7a64c4a28f5f1ffa3062a8813cd908e83442f24e276a36e6ae53916a Jul 24 17:27:02.307117 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:02.307092 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0f39cbb-82fc-4d2d-9ab9-1cb173525bed-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dct6g\" (UID: \"e0f39cbb-82fc-4d2d-9ab9-1cb173525bed\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dct6g" Jul 24 17:27:02.307209 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:02.307132 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s974c\" (UniqueName: \"kubernetes.io/projected/e0f39cbb-82fc-4d2d-9ab9-1cb173525bed-kube-api-access-s974c\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dct6g\" (UID: \"e0f39cbb-82fc-4d2d-9ab9-1cb173525bed\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dct6g" Jul 24 17:27:02.307269 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:02.307226 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0f39cbb-82fc-4d2d-9ab9-1cb173525bed-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dct6g\" (UID: \"e0f39cbb-82fc-4d2d-9ab9-1cb173525bed\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dct6g" Jul 24 17:27:02.407958 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:02.407899 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0f39cbb-82fc-4d2d-9ab9-1cb173525bed-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dct6g\" (UID: \"e0f39cbb-82fc-4d2d-9ab9-1cb173525bed\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dct6g" Jul 24 17:27:02.407958 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:02.407935 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s974c\" (UniqueName: \"kubernetes.io/projected/e0f39cbb-82fc-4d2d-9ab9-1cb173525bed-kube-api-access-s974c\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dct6g\" (UID: \"e0f39cbb-82fc-4d2d-9ab9-1cb173525bed\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dct6g" Jul 24 17:27:02.408118 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:02.407986 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0f39cbb-82fc-4d2d-9ab9-1cb173525bed-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dct6g\" (UID: \"e0f39cbb-82fc-4d2d-9ab9-1cb173525bed\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dct6g" Jul 24 17:27:02.408322 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:02.408301 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0f39cbb-82fc-4d2d-9ab9-1cb173525bed-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dct6g\" (UID: \"e0f39cbb-82fc-4d2d-9ab9-1cb173525bed\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dct6g" Jul 24 17:27:02.408379 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:02.408317 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0f39cbb-82fc-4d2d-9ab9-1cb173525bed-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dct6g\" (UID: \"e0f39cbb-82fc-4d2d-9ab9-1cb173525bed\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dct6g" Jul 24 17:27:02.417884 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:02.417854 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s974c\" (UniqueName: \"kubernetes.io/projected/e0f39cbb-82fc-4d2d-9ab9-1cb173525bed-kube-api-access-s974c\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dct6g\" (UID: \"e0f39cbb-82fc-4d2d-9ab9-1cb173525bed\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dct6g" Jul 24 17:27:02.551626 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:02.551605 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dct6g" Jul 24 17:27:02.692035 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:02.692008 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dct6g"] Jul 24 17:27:02.707132 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:27:02.707104 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0f39cbb_82fc_4d2d_9ab9_1cb173525bed.slice/crio-18030bafdf66c45e1086370979209e04a0144c47a5de80ae8dfe9bf776dd5aee WatchSource:0}: Error finding container 18030bafdf66c45e1086370979209e04a0144c47a5de80ae8dfe9bf776dd5aee: Status 404 returned error can't find the container with id 18030bafdf66c45e1086370979209e04a0144c47a5de80ae8dfe9bf776dd5aee Jul 24 17:27:02.869562 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:02.869535 2570 generic.go:356] "Generic (PLEG): container finished" podID="63c97bbf-d9b4-423a-990a-b1c1737e58d8" containerID="adf3f461e465f5329ffe234f432389ab43d63f66ba44151b7009836245bef72d" exitCode=0 Jul 24 17:27:02.869677 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:02.869617 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rpkht" event={"ID":"63c97bbf-d9b4-423a-990a-b1c1737e58d8","Type":"ContainerDied","Data":"adf3f461e465f5329ffe234f432389ab43d63f66ba44151b7009836245bef72d"} Jul 24 17:27:02.869677 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:02.869670 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rpkht" event={"ID":"63c97bbf-d9b4-423a-990a-b1c1737e58d8","Type":"ContainerStarted","Data":"a37840af7a64c4a28f5f1ffa3062a8813cd908e83442f24e276a36e6ae53916a"} Jul 24 17:27:02.871715 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:02.871690 2570 generic.go:356] "Generic (PLEG): container finished" podID="a7b5f426-51f9-419e-87bf-adbeb31f99e0" containerID="91ff8094b96960dcea2103883e54ce912011f368dc0e407c2af39fc584531474" exitCode=0 Jul 24 17:27:02.871827 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:02.871772 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qchvs" event={"ID":"a7b5f426-51f9-419e-87bf-adbeb31f99e0","Type":"ContainerDied","Data":"91ff8094b96960dcea2103883e54ce912011f368dc0e407c2af39fc584531474"} Jul 24 17:27:02.873408 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:02.873387 2570 generic.go:356] "Generic (PLEG): container finished" podID="e0f39cbb-82fc-4d2d-9ab9-1cb173525bed" containerID="88df58192cc2be09d54b3149d5a43c920e070ff6f0d64bd1adfc8d5d92dc5728" exitCode=0 Jul 24 17:27:02.873472 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:02.873447 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dct6g" event={"ID":"e0f39cbb-82fc-4d2d-9ab9-1cb173525bed","Type":"ContainerDied","Data":"88df58192cc2be09d54b3149d5a43c920e070ff6f0d64bd1adfc8d5d92dc5728"} Jul 24 17:27:02.873549 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:02.873484 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dct6g" event={"ID":"e0f39cbb-82fc-4d2d-9ab9-1cb173525bed","Type":"ContainerStarted","Data":"18030bafdf66c45e1086370979209e04a0144c47a5de80ae8dfe9bf776dd5aee"} Jul 24 17:27:03.879962 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:03.879936 2570 generic.go:356] "Generic (PLEG): container finished" podID="63c97bbf-d9b4-423a-990a-b1c1737e58d8" containerID="ed36f459623d76f79673ee159a67bc2106cd51dde55e88c25bb46e686550ce92" exitCode=0 Jul 24 17:27:03.880271 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:03.880032 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rpkht" event={"ID":"63c97bbf-d9b4-423a-990a-b1c1737e58d8","Type":"ContainerDied","Data":"ed36f459623d76f79673ee159a67bc2106cd51dde55e88c25bb46e686550ce92"} Jul 24 17:27:03.882222 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:03.882200 2570 generic.go:356] "Generic (PLEG): container finished" podID="a7b5f426-51f9-419e-87bf-adbeb31f99e0" containerID="9e8f6f25bdad215b606faab36da9110a82c83d6fabe356e54a98bd83bbc14f5c" exitCode=0 Jul 24 17:27:03.882318 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:03.882285 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qchvs" event={"ID":"a7b5f426-51f9-419e-87bf-adbeb31f99e0","Type":"ContainerDied","Data":"9e8f6f25bdad215b606faab36da9110a82c83d6fabe356e54a98bd83bbc14f5c"} Jul 24 17:27:03.883895 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:03.883875 2570 generic.go:356] "Generic (PLEG): container finished" podID="21e16a0d-c14b-4db4-b1ac-77774ab24b32" containerID="cca3e9d105a257a1831d9da0e70ded73dc602d9f8ee22804c88302be3ba18e29" exitCode=0 Jul 24 17:27:03.883979 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:03.883955 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ss2tc" event={"ID":"21e16a0d-c14b-4db4-b1ac-77774ab24b32","Type":"ContainerDied","Data":"cca3e9d105a257a1831d9da0e70ded73dc602d9f8ee22804c88302be3ba18e29"} Jul 24 17:27:03.885971 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:03.885949 2570 generic.go:356] "Generic (PLEG): container finished" podID="e0f39cbb-82fc-4d2d-9ab9-1cb173525bed" containerID="b9d73d9b367b64d4711293e2dad932a8ac9836a15d59303ea6deec2afd50ccf6" exitCode=0 Jul 24 17:27:03.886057 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:03.885976 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dct6g" event={"ID":"e0f39cbb-82fc-4d2d-9ab9-1cb173525bed","Type":"ContainerDied","Data":"b9d73d9b367b64d4711293e2dad932a8ac9836a15d59303ea6deec2afd50ccf6"} Jul 24 17:27:04.892563 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:04.892528 2570 generic.go:356] "Generic (PLEG): container finished" podID="63c97bbf-d9b4-423a-990a-b1c1737e58d8" containerID="e1864cf79a474c226b05fcc5e3db920e47c0a837f5ddbc8de7368095a6d398ac" exitCode=0 Jul 24 17:27:04.892990 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:04.892563 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rpkht" event={"ID":"63c97bbf-d9b4-423a-990a-b1c1737e58d8","Type":"ContainerDied","Data":"e1864cf79a474c226b05fcc5e3db920e47c0a837f5ddbc8de7368095a6d398ac"} Jul 24 17:27:04.894598 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:04.894575 2570 generic.go:356] "Generic (PLEG): container finished" podID="21e16a0d-c14b-4db4-b1ac-77774ab24b32" containerID="d5f38c4933cea2a3e9edfac8e8855643be85224ad6813d9a58dc6e35ea5cf485" exitCode=0 Jul 24 17:27:04.894709 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:04.894652 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ss2tc" event={"ID":"21e16a0d-c14b-4db4-b1ac-77774ab24b32","Type":"ContainerDied","Data":"d5f38c4933cea2a3e9edfac8e8855643be85224ad6813d9a58dc6e35ea5cf485"} Jul 24 17:27:04.896680 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:04.896658 2570 generic.go:356] "Generic (PLEG): container finished" podID="e0f39cbb-82fc-4d2d-9ab9-1cb173525bed" containerID="476bd0e04a539578675ed567dfbe9e4dea000bc3526d77ceea10406312e45536" exitCode=0 Jul 24 17:27:04.896775 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:04.896734 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dct6g" event={"ID":"e0f39cbb-82fc-4d2d-9ab9-1cb173525bed","Type":"ContainerDied","Data":"476bd0e04a539578675ed567dfbe9e4dea000bc3526d77ceea10406312e45536"} Jul 24 17:27:05.031782 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:05.031755 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qchvs" Jul 24 17:27:05.131535 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:05.131507 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vq884\" (UniqueName: \"kubernetes.io/projected/a7b5f426-51f9-419e-87bf-adbeb31f99e0-kube-api-access-vq884\") pod \"a7b5f426-51f9-419e-87bf-adbeb31f99e0\" (UID: \"a7b5f426-51f9-419e-87bf-adbeb31f99e0\") " Jul 24 17:27:05.131535 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:05.131540 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7b5f426-51f9-419e-87bf-adbeb31f99e0-bundle\") pod \"a7b5f426-51f9-419e-87bf-adbeb31f99e0\" (UID: \"a7b5f426-51f9-419e-87bf-adbeb31f99e0\") " Jul 24 17:27:05.131721 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:05.131562 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7b5f426-51f9-419e-87bf-adbeb31f99e0-util\") pod \"a7b5f426-51f9-419e-87bf-adbeb31f99e0\" (UID: \"a7b5f426-51f9-419e-87bf-adbeb31f99e0\") " Jul 24 17:27:05.132036 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:05.132010 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7b5f426-51f9-419e-87bf-adbeb31f99e0-bundle" (OuterVolumeSpecName: "bundle") pod "a7b5f426-51f9-419e-87bf-adbeb31f99e0" (UID: "a7b5f426-51f9-419e-87bf-adbeb31f99e0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 17:27:05.133722 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:05.133700 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a7b5f426-51f9-419e-87bf-adbeb31f99e0-kube-api-access-vq884" (OuterVolumeSpecName: "kube-api-access-vq884") pod "a7b5f426-51f9-419e-87bf-adbeb31f99e0" (UID: "a7b5f426-51f9-419e-87bf-adbeb31f99e0"). InnerVolumeSpecName "kube-api-access-vq884". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 17:27:05.138699 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:05.138661 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a7b5f426-51f9-419e-87bf-adbeb31f99e0-util" (OuterVolumeSpecName: "util") pod "a7b5f426-51f9-419e-87bf-adbeb31f99e0" (UID: "a7b5f426-51f9-419e-87bf-adbeb31f99e0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 17:27:05.233217 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:05.233188 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vq884\" (UniqueName: \"kubernetes.io/projected/a7b5f426-51f9-419e-87bf-adbeb31f99e0-kube-api-access-vq884\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:27:05.233217 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:05.233210 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a7b5f426-51f9-419e-87bf-adbeb31f99e0-bundle\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:27:05.233217 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:05.233220 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a7b5f426-51f9-419e-87bf-adbeb31f99e0-util\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:27:05.903730 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:05.903696 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qchvs" Jul 24 17:27:05.903730 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:05.903714 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qchvs" event={"ID":"a7b5f426-51f9-419e-87bf-adbeb31f99e0","Type":"ContainerDied","Data":"156d6199a9a0fd943364fa281f7b02ec8cef6ace2102782d95c79d84405c7ea1"} Jul 24 17:27:05.904169 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:05.903788 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="156d6199a9a0fd943364fa281f7b02ec8cef6ace2102782d95c79d84405c7ea1" Jul 24 17:27:06.045096 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:06.045071 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rpkht" Jul 24 17:27:06.093836 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:06.093816 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dct6g" Jul 24 17:27:06.096909 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:06.096887 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ss2tc" Jul 24 17:27:06.142550 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:06.142525 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63c97bbf-d9b4-423a-990a-b1c1737e58d8-bundle\") pod \"63c97bbf-d9b4-423a-990a-b1c1737e58d8\" (UID: \"63c97bbf-d9b4-423a-990a-b1c1737e58d8\") " Jul 24 17:27:06.142698 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:06.142566 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wgnxp\" (UniqueName: \"kubernetes.io/projected/63c97bbf-d9b4-423a-990a-b1c1737e58d8-kube-api-access-wgnxp\") pod \"63c97bbf-d9b4-423a-990a-b1c1737e58d8\" (UID: \"63c97bbf-d9b4-423a-990a-b1c1737e58d8\") " Jul 24 17:27:06.142698 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:06.142621 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63c97bbf-d9b4-423a-990a-b1c1737e58d8-util\") pod \"63c97bbf-d9b4-423a-990a-b1c1737e58d8\" (UID: \"63c97bbf-d9b4-423a-990a-b1c1737e58d8\") " Jul 24 17:27:06.143047 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:06.143022 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63c97bbf-d9b4-423a-990a-b1c1737e58d8-bundle" (OuterVolumeSpecName: "bundle") pod "63c97bbf-d9b4-423a-990a-b1c1737e58d8" (UID: "63c97bbf-d9b4-423a-990a-b1c1737e58d8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 17:27:06.144742 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:06.144718 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/63c97bbf-d9b4-423a-990a-b1c1737e58d8-kube-api-access-wgnxp" (OuterVolumeSpecName: "kube-api-access-wgnxp") pod "63c97bbf-d9b4-423a-990a-b1c1737e58d8" (UID: "63c97bbf-d9b4-423a-990a-b1c1737e58d8"). InnerVolumeSpecName "kube-api-access-wgnxp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 17:27:06.148700 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:06.148668 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/63c97bbf-d9b4-423a-990a-b1c1737e58d8-util" (OuterVolumeSpecName: "util") pod "63c97bbf-d9b4-423a-990a-b1c1737e58d8" (UID: "63c97bbf-d9b4-423a-990a-b1c1737e58d8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 17:27:06.244017 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:06.243957 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21e16a0d-c14b-4db4-b1ac-77774ab24b32-bundle\") pod \"21e16a0d-c14b-4db4-b1ac-77774ab24b32\" (UID: \"21e16a0d-c14b-4db4-b1ac-77774ab24b32\") " Jul 24 17:27:06.244017 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:06.244005 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0f39cbb-82fc-4d2d-9ab9-1cb173525bed-bundle\") pod \"e0f39cbb-82fc-4d2d-9ab9-1cb173525bed\" (UID: \"e0f39cbb-82fc-4d2d-9ab9-1cb173525bed\") " Jul 24 17:27:06.244131 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:06.244066 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vn6b7\" (UniqueName: \"kubernetes.io/projected/21e16a0d-c14b-4db4-b1ac-77774ab24b32-kube-api-access-vn6b7\") pod \"21e16a0d-c14b-4db4-b1ac-77774ab24b32\" (UID: \"21e16a0d-c14b-4db4-b1ac-77774ab24b32\") " Jul 24 17:27:06.244131 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:06.244081 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s974c\" (UniqueName: \"kubernetes.io/projected/e0f39cbb-82fc-4d2d-9ab9-1cb173525bed-kube-api-access-s974c\") pod \"e0f39cbb-82fc-4d2d-9ab9-1cb173525bed\" (UID: \"e0f39cbb-82fc-4d2d-9ab9-1cb173525bed\") " Jul 24 17:27:06.244131 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:06.244109 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0f39cbb-82fc-4d2d-9ab9-1cb173525bed-util\") pod \"e0f39cbb-82fc-4d2d-9ab9-1cb173525bed\" (UID: \"e0f39cbb-82fc-4d2d-9ab9-1cb173525bed\") " Jul 24 17:27:06.244131 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:06.244130 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21e16a0d-c14b-4db4-b1ac-77774ab24b32-util\") pod \"21e16a0d-c14b-4db4-b1ac-77774ab24b32\" (UID: \"21e16a0d-c14b-4db4-b1ac-77774ab24b32\") " Jul 24 17:27:06.244322 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:06.244308 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/63c97bbf-d9b4-423a-990a-b1c1737e58d8-bundle\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:27:06.244400 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:06.244326 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wgnxp\" (UniqueName: \"kubernetes.io/projected/63c97bbf-d9b4-423a-990a-b1c1737e58d8-kube-api-access-wgnxp\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:27:06.244400 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:06.244364 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/63c97bbf-d9b4-423a-990a-b1c1737e58d8-util\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:27:06.244696 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:06.244671 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0f39cbb-82fc-4d2d-9ab9-1cb173525bed-bundle" (OuterVolumeSpecName: "bundle") pod "e0f39cbb-82fc-4d2d-9ab9-1cb173525bed" (UID: "e0f39cbb-82fc-4d2d-9ab9-1cb173525bed"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 17:27:06.244926 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:06.244809 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21e16a0d-c14b-4db4-b1ac-77774ab24b32-bundle" (OuterVolumeSpecName: "bundle") pod "21e16a0d-c14b-4db4-b1ac-77774ab24b32" (UID: "21e16a0d-c14b-4db4-b1ac-77774ab24b32"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 17:27:06.246301 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:06.246281 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/21e16a0d-c14b-4db4-b1ac-77774ab24b32-kube-api-access-vn6b7" (OuterVolumeSpecName: "kube-api-access-vn6b7") pod "21e16a0d-c14b-4db4-b1ac-77774ab24b32" (UID: "21e16a0d-c14b-4db4-b1ac-77774ab24b32"). InnerVolumeSpecName "kube-api-access-vn6b7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 17:27:06.246395 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:06.246317 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0f39cbb-82fc-4d2d-9ab9-1cb173525bed-kube-api-access-s974c" (OuterVolumeSpecName: "kube-api-access-s974c") pod "e0f39cbb-82fc-4d2d-9ab9-1cb173525bed" (UID: "e0f39cbb-82fc-4d2d-9ab9-1cb173525bed"). InnerVolumeSpecName "kube-api-access-s974c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 17:27:06.249665 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:06.249634 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/21e16a0d-c14b-4db4-b1ac-77774ab24b32-util" (OuterVolumeSpecName: "util") pod "21e16a0d-c14b-4db4-b1ac-77774ab24b32" (UID: "21e16a0d-c14b-4db4-b1ac-77774ab24b32"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 17:27:06.249906 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:06.249887 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0f39cbb-82fc-4d2d-9ab9-1cb173525bed-util" (OuterVolumeSpecName: "util") pod "e0f39cbb-82fc-4d2d-9ab9-1cb173525bed" (UID: "e0f39cbb-82fc-4d2d-9ab9-1cb173525bed"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 17:27:06.345526 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:06.345499 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vn6b7\" (UniqueName: \"kubernetes.io/projected/21e16a0d-c14b-4db4-b1ac-77774ab24b32-kube-api-access-vn6b7\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:27:06.345526 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:06.345522 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s974c\" (UniqueName: \"kubernetes.io/projected/e0f39cbb-82fc-4d2d-9ab9-1cb173525bed-kube-api-access-s974c\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:27:06.345653 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:06.345531 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0f39cbb-82fc-4d2d-9ab9-1cb173525bed-util\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:27:06.345653 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:06.345540 2570 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/21e16a0d-c14b-4db4-b1ac-77774ab24b32-util\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:27:06.345653 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:06.345548 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/21e16a0d-c14b-4db4-b1ac-77774ab24b32-bundle\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:27:06.345653 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:06.345555 2570 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0f39cbb-82fc-4d2d-9ab9-1cb173525bed-bundle\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:27:06.910529 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:06.910500 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dct6g" Jul 24 17:27:06.912372 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:06.912351 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rpkht" Jul 24 17:27:06.914363 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:06.914344 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ss2tc" Jul 24 17:27:06.915680 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:06.915639 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dct6g" event={"ID":"e0f39cbb-82fc-4d2d-9ab9-1cb173525bed","Type":"ContainerDied","Data":"18030bafdf66c45e1086370979209e04a0144c47a5de80ae8dfe9bf776dd5aee"} Jul 24 17:27:06.915774 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:06.915697 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="18030bafdf66c45e1086370979209e04a0144c47a5de80ae8dfe9bf776dd5aee" Jul 24 17:27:06.915774 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:06.915753 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rpkht" event={"ID":"63c97bbf-d9b4-423a-990a-b1c1737e58d8","Type":"ContainerDied","Data":"a37840af7a64c4a28f5f1ffa3062a8813cd908e83442f24e276a36e6ae53916a"} Jul 24 17:27:06.915774 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:06.915771 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a37840af7a64c4a28f5f1ffa3062a8813cd908e83442f24e276a36e6ae53916a" Jul 24 17:27:06.915936 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:06.915781 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ss2tc" event={"ID":"21e16a0d-c14b-4db4-b1ac-77774ab24b32","Type":"ContainerDied","Data":"6fc485066c9b0c80e76dfe78ba2aea8fab1d5b79714379eb6bc4ce2a0a60d05b"} Jul 24 17:27:06.915936 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:06.915797 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6fc485066c9b0c80e76dfe78ba2aea8fab1d5b79714379eb6bc4ce2a0a60d05b" Jul 24 17:27:09.573115 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:09.573085 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-8467dcb8cc-jtg6w" Jul 24 17:27:09.573557 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:09.573164 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-8467dcb8cc-jtg6w" Jul 24 17:27:09.578041 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:09.578021 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-8467dcb8cc-jtg6w" Jul 24 17:27:09.932390 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:09.932363 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-8467dcb8cc-jtg6w" Jul 24 17:27:10.047643 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:10.047617 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-786b854969-wv4p4"] Jul 24 17:27:12.061031 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:12.060948 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ztqgj"] Jul 24 17:27:12.061571 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:12.061283 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7b5f426-51f9-419e-87bf-adbeb31f99e0" containerName="extract" Jul 24 17:27:12.061571 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:12.061293 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7b5f426-51f9-419e-87bf-adbeb31f99e0" containerName="extract" Jul 24 17:27:12.061571 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:12.061302 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7b5f426-51f9-419e-87bf-adbeb31f99e0" containerName="pull" Jul 24 17:27:12.061571 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:12.061308 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7b5f426-51f9-419e-87bf-adbeb31f99e0" containerName="pull" Jul 24 17:27:12.061571 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:12.061314 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21e16a0d-c14b-4db4-b1ac-77774ab24b32" containerName="extract" Jul 24 17:27:12.061571 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:12.061318 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="21e16a0d-c14b-4db4-b1ac-77774ab24b32" containerName="extract" Jul 24 17:27:12.061571 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:12.061327 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21e16a0d-c14b-4db4-b1ac-77774ab24b32" containerName="util" Jul 24 17:27:12.061571 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:12.061349 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="21e16a0d-c14b-4db4-b1ac-77774ab24b32" containerName="util" Jul 24 17:27:12.061571 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:12.061355 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63c97bbf-d9b4-423a-990a-b1c1737e58d8" containerName="pull" Jul 24 17:27:12.061571 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:12.061360 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="63c97bbf-d9b4-423a-990a-b1c1737e58d8" containerName="pull" Jul 24 17:27:12.061571 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:12.061366 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0f39cbb-82fc-4d2d-9ab9-1cb173525bed" containerName="pull" Jul 24 17:27:12.061571 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:12.061371 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0f39cbb-82fc-4d2d-9ab9-1cb173525bed" containerName="pull" Jul 24 17:27:12.061571 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:12.061379 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a7b5f426-51f9-419e-87bf-adbeb31f99e0" containerName="util" Jul 24 17:27:12.061571 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:12.061384 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a7b5f426-51f9-419e-87bf-adbeb31f99e0" containerName="util" Jul 24 17:27:12.061571 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:12.061394 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63c97bbf-d9b4-423a-990a-b1c1737e58d8" containerName="util" Jul 24 17:27:12.061571 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:12.061399 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="63c97bbf-d9b4-423a-990a-b1c1737e58d8" containerName="util" Jul 24 17:27:12.061571 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:12.061407 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="21e16a0d-c14b-4db4-b1ac-77774ab24b32" containerName="pull" Jul 24 17:27:12.061571 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:12.061412 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="21e16a0d-c14b-4db4-b1ac-77774ab24b32" containerName="pull" Jul 24 17:27:12.061571 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:12.061417 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0f39cbb-82fc-4d2d-9ab9-1cb173525bed" containerName="extract" Jul 24 17:27:12.061571 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:12.061423 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0f39cbb-82fc-4d2d-9ab9-1cb173525bed" containerName="extract" Jul 24 17:27:12.061571 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:12.061430 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="63c97bbf-d9b4-423a-990a-b1c1737e58d8" containerName="extract" Jul 24 17:27:12.061571 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:12.061434 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="63c97bbf-d9b4-423a-990a-b1c1737e58d8" containerName="extract" Jul 24 17:27:12.061571 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:12.061442 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0f39cbb-82fc-4d2d-9ab9-1cb173525bed" containerName="util" Jul 24 17:27:12.061571 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:12.061447 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0f39cbb-82fc-4d2d-9ab9-1cb173525bed" containerName="util" Jul 24 17:27:12.061571 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:12.061497 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="21e16a0d-c14b-4db4-b1ac-77774ab24b32" containerName="extract" Jul 24 17:27:12.061571 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:12.061504 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="63c97bbf-d9b4-423a-990a-b1c1737e58d8" containerName="extract" Jul 24 17:27:12.061571 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:12.061510 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0f39cbb-82fc-4d2d-9ab9-1cb173525bed" containerName="extract" Jul 24 17:27:12.061571 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:12.061516 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a7b5f426-51f9-419e-87bf-adbeb31f99e0" containerName="extract" Jul 24 17:27:12.065983 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:12.065958 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ztqgj" Jul 24 17:27:12.071029 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:12.071007 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-6wm9f\"" Jul 24 17:27:12.085549 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:12.085529 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ztqgj"] Jul 24 17:27:12.196133 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:12.196102 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvjgr\" (UniqueName: \"kubernetes.io/projected/66c2753a-ca06-456e-b3b7-726c7ec94a05-kube-api-access-vvjgr\") pod \"authorino-operator-75cc8d5cb7-ztqgj\" (UID: \"66c2753a-ca06-456e-b3b7-726c7ec94a05\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ztqgj" Jul 24 17:27:12.296912 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:12.296889 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvjgr\" (UniqueName: \"kubernetes.io/projected/66c2753a-ca06-456e-b3b7-726c7ec94a05-kube-api-access-vvjgr\") pod \"authorino-operator-75cc8d5cb7-ztqgj\" (UID: \"66c2753a-ca06-456e-b3b7-726c7ec94a05\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ztqgj" Jul 24 17:27:12.310075 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:12.310050 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvjgr\" (UniqueName: \"kubernetes.io/projected/66c2753a-ca06-456e-b3b7-726c7ec94a05-kube-api-access-vvjgr\") pod \"authorino-operator-75cc8d5cb7-ztqgj\" (UID: \"66c2753a-ca06-456e-b3b7-726c7ec94a05\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-ztqgj" Jul 24 17:27:12.378249 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:12.378225 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ztqgj" Jul 24 17:27:12.521369 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:12.521323 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-ztqgj"] Jul 24 17:27:12.523122 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:27:12.523101 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod66c2753a_ca06_456e_b3b7_726c7ec94a05.slice/crio-0f495f19a8c3ee1e8791da72d5671e522a3ece3eb1ce1ebb7b34d97a19583be5 WatchSource:0}: Error finding container 0f495f19a8c3ee1e8791da72d5671e522a3ece3eb1ce1ebb7b34d97a19583be5: Status 404 returned error can't find the container with id 0f495f19a8c3ee1e8791da72d5671e522a3ece3eb1ce1ebb7b34d97a19583be5 Jul 24 17:27:12.943852 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:12.943822 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ztqgj" event={"ID":"66c2753a-ca06-456e-b3b7-726c7ec94a05","Type":"ContainerStarted","Data":"0f495f19a8c3ee1e8791da72d5671e522a3ece3eb1ce1ebb7b34d97a19583be5"} Jul 24 17:27:14.955490 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:14.955464 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ztqgj" event={"ID":"66c2753a-ca06-456e-b3b7-726c7ec94a05","Type":"ContainerStarted","Data":"3a0f85e9cf101da2cde396aba45f4877d82e606e6ba3217c9719e98111032542"} Jul 24 17:27:14.955796 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:14.955618 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ztqgj" Jul 24 17:27:14.977171 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:14.977126 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ztqgj" podStartSLOduration=0.610355377 podStartE2EDuration="2.977111701s" totalImagesPullingTime="2.366756324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:27:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:27:14.974821614 +0000 UTC m=+430.643232641" watchObservedRunningTime="2026-07-24 17:27:14.977111701 +0000 UTC m=+430.645522725" Jul 24 17:27:15.020956 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:15.020931 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvclj"] Jul 24 17:27:15.024483 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:15.024464 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvclj" Jul 24 17:27:15.027071 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:15.027052 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-dblt7\"" Jul 24 17:27:15.036927 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:15.036907 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvclj"] Jul 24 17:27:15.120233 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:15.120205 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dw74j\" (UniqueName: \"kubernetes.io/projected/d3e74765-8ebd-4e49-9be4-05dca5df915f-kube-api-access-dw74j\") pod \"limitador-operator-controller-manager-859d7b78bd-qvclj\" (UID: \"d3e74765-8ebd-4e49-9be4-05dca5df915f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvclj" Jul 24 17:27:15.220917 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:15.220838 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dw74j\" (UniqueName: \"kubernetes.io/projected/d3e74765-8ebd-4e49-9be4-05dca5df915f-kube-api-access-dw74j\") pod \"limitador-operator-controller-manager-859d7b78bd-qvclj\" (UID: \"d3e74765-8ebd-4e49-9be4-05dca5df915f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvclj" Jul 24 17:27:15.234009 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:15.233984 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dw74j\" (UniqueName: \"kubernetes.io/projected/d3e74765-8ebd-4e49-9be4-05dca5df915f-kube-api-access-dw74j\") pod \"limitador-operator-controller-manager-859d7b78bd-qvclj\" (UID: \"d3e74765-8ebd-4e49-9be4-05dca5df915f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvclj" Jul 24 17:27:15.334668 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:15.334643 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvclj" Jul 24 17:27:15.472369 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:15.472147 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvclj"] Jul 24 17:27:15.475040 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:27:15.475017 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3e74765_8ebd_4e49_9be4_05dca5df915f.slice/crio-7735a34c0bbd8eabaf0ea10b1768802e56e33643d9ce487b98cc129296fd92d7 WatchSource:0}: Error finding container 7735a34c0bbd8eabaf0ea10b1768802e56e33643d9ce487b98cc129296fd92d7: Status 404 returned error can't find the container with id 7735a34c0bbd8eabaf0ea10b1768802e56e33643d9ce487b98cc129296fd92d7 Jul 24 17:27:15.961723 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:15.961686 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvclj" event={"ID":"d3e74765-8ebd-4e49-9be4-05dca5df915f","Type":"ContainerStarted","Data":"7735a34c0bbd8eabaf0ea10b1768802e56e33643d9ce487b98cc129296fd92d7"} Jul 24 17:27:17.974345 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:17.974295 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvclj" event={"ID":"d3e74765-8ebd-4e49-9be4-05dca5df915f","Type":"ContainerStarted","Data":"c9a1af382e70211be86e79f22bd0efe448a302b3bc05ec3c95e107e080a7b320"} Jul 24 17:27:17.974772 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:17.974382 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvclj" Jul 24 17:27:17.993559 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:17.993514 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvclj" podStartSLOduration=2.368824128 podStartE2EDuration="3.993501637s" totalImagesPullingTime="1.624677509s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:27:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:27:17.991515357 +0000 UTC m=+433.659926381" watchObservedRunningTime="2026-07-24 17:27:17.993501637 +0000 UTC m=+433.661912661" Jul 24 17:27:18.929743 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:18.929713 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrx5j"] Jul 24 17:27:18.933179 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:18.933162 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrx5j" Jul 24 17:27:18.936751 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:18.936730 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-24mcz\"" Jul 24 17:27:18.953141 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:18.953122 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrx5j"] Jul 24 17:27:19.062664 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:19.062637 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bf0caaa-6dd3-4d2d-bb81-019b52636489-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hrx5j\" (UID: \"3bf0caaa-6dd3-4d2d-bb81-019b52636489\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrx5j" Jul 24 17:27:19.063047 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:19.062684 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c9hlb\" (UniqueName: \"kubernetes.io/projected/3bf0caaa-6dd3-4d2d-bb81-019b52636489-kube-api-access-c9hlb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hrx5j\" (UID: \"3bf0caaa-6dd3-4d2d-bb81-019b52636489\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrx5j" Jul 24 17:27:19.163057 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:19.163027 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bf0caaa-6dd3-4d2d-bb81-019b52636489-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hrx5j\" (UID: \"3bf0caaa-6dd3-4d2d-bb81-019b52636489\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrx5j" Jul 24 17:27:19.163057 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:19.163055 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c9hlb\" (UniqueName: \"kubernetes.io/projected/3bf0caaa-6dd3-4d2d-bb81-019b52636489-kube-api-access-c9hlb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hrx5j\" (UID: \"3bf0caaa-6dd3-4d2d-bb81-019b52636489\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrx5j" Jul 24 17:27:19.163461 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:19.163441 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bf0caaa-6dd3-4d2d-bb81-019b52636489-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hrx5j\" (UID: \"3bf0caaa-6dd3-4d2d-bb81-019b52636489\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrx5j" Jul 24 17:27:19.172457 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:19.172432 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c9hlb\" (UniqueName: \"kubernetes.io/projected/3bf0caaa-6dd3-4d2d-bb81-019b52636489-kube-api-access-c9hlb\") pod \"kuadrant-operator-controller-manager-8684c9ff49-hrx5j\" (UID: \"3bf0caaa-6dd3-4d2d-bb81-019b52636489\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrx5j" Jul 24 17:27:19.243515 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:19.243437 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrx5j" Jul 24 17:27:19.393208 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:27:19.393174 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bf0caaa_6dd3_4d2d_bb81_019b52636489.slice/crio-33dfb6779062c9b3b6af7fd950013f74b50063eb0140b968349ab8d57217b8af WatchSource:0}: Error finding container 33dfb6779062c9b3b6af7fd950013f74b50063eb0140b968349ab8d57217b8af: Status 404 returned error can't find the container with id 33dfb6779062c9b3b6af7fd950013f74b50063eb0140b968349ab8d57217b8af Jul 24 17:27:19.393475 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:19.393454 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrx5j"] Jul 24 17:27:19.986807 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:19.986771 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrx5j" event={"ID":"3bf0caaa-6dd3-4d2d-bb81-019b52636489","Type":"ContainerStarted","Data":"33dfb6779062c9b3b6af7fd950013f74b50063eb0140b968349ab8d57217b8af"} Jul 24 17:27:20.999811 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:20.999781 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-95vrj"] Jul 24 17:27:21.003373 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:21.003352 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-95vrj" Jul 24 17:27:21.006786 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:21.006767 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-ptxd9\"" Jul 24 17:27:21.007239 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:21.007223 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 24 17:27:21.017438 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:21.017419 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-95vrj"] Jul 24 17:27:21.180498 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:21.180455 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtgkq\" (UniqueName: \"kubernetes.io/projected/ee47cea9-c3dd-4d4d-9e4a-0ac86875ae7f-kube-api-access-qtgkq\") pod \"dns-operator-controller-manager-864dd78c4c-95vrj\" (UID: \"ee47cea9-c3dd-4d4d-9e4a-0ac86875ae7f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-95vrj" Jul 24 17:27:21.281737 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:21.281651 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtgkq\" (UniqueName: \"kubernetes.io/projected/ee47cea9-c3dd-4d4d-9e4a-0ac86875ae7f-kube-api-access-qtgkq\") pod \"dns-operator-controller-manager-864dd78c4c-95vrj\" (UID: \"ee47cea9-c3dd-4d4d-9e4a-0ac86875ae7f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-95vrj" Jul 24 17:27:21.304588 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:21.304559 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtgkq\" (UniqueName: \"kubernetes.io/projected/ee47cea9-c3dd-4d4d-9e4a-0ac86875ae7f-kube-api-access-qtgkq\") pod \"dns-operator-controller-manager-864dd78c4c-95vrj\" (UID: \"ee47cea9-c3dd-4d4d-9e4a-0ac86875ae7f\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-95vrj" Jul 24 17:27:21.315891 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:21.315873 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-95vrj" Jul 24 17:27:21.489654 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:21.489624 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-95vrj"] Jul 24 17:27:21.491841 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:27:21.491803 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee47cea9_c3dd_4d4d_9e4a_0ac86875ae7f.slice/crio-a8b65703160d15ac4f4c59725418d09cd5e366e4fa5147cc7a7a165b0e563edc WatchSource:0}: Error finding container a8b65703160d15ac4f4c59725418d09cd5e366e4fa5147cc7a7a165b0e563edc: Status 404 returned error can't find the container with id a8b65703160d15ac4f4c59725418d09cd5e366e4fa5147cc7a7a165b0e563edc Jul 24 17:27:21.998550 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:21.998517 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-95vrj" event={"ID":"ee47cea9-c3dd-4d4d-9e4a-0ac86875ae7f","Type":"ContainerStarted","Data":"a8b65703160d15ac4f4c59725418d09cd5e366e4fa5147cc7a7a165b0e563edc"} Jul 24 17:27:25.018714 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:25.018618 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrx5j" event={"ID":"3bf0caaa-6dd3-4d2d-bb81-019b52636489","Type":"ContainerStarted","Data":"7e7741944edadf38e2dfbc6fee739008bedcdc6ccb357aa6d42b3f068d2dad23"} Jul 24 17:27:25.018714 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:25.018705 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrx5j" Jul 24 17:27:25.020192 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:25.020169 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-95vrj" event={"ID":"ee47cea9-c3dd-4d4d-9e4a-0ac86875ae7f","Type":"ContainerStarted","Data":"72130057a774e014c08846c45c77b4a178d04d7d113e18b0a5e3fa5b7b360787"} Jul 24 17:27:25.020316 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:25.020217 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-95vrj" Jul 24 17:27:25.042688 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:25.042645 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrx5j" podStartSLOduration=1.914709492 podStartE2EDuration="7.042630907s" totalImagesPullingTime="5.127921415s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:27:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:27:25.040564055 +0000 UTC m=+440.708975078" watchObservedRunningTime="2026-07-24 17:27:25.042630907 +0000 UTC m=+440.711041929" Jul 24 17:27:25.060208 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:25.060162 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-95vrj" podStartSLOduration=2.036575305 podStartE2EDuration="5.060148776s" totalImagesPullingTime="3.023573471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:27:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:27:25.058123485 +0000 UTC m=+440.726534509" watchObservedRunningTime="2026-07-24 17:27:25.060148776 +0000 UTC m=+440.728559800" Jul 24 17:27:25.963943 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:25.963915 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-ztqgj" Jul 24 17:27:27.258505 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:27.258469 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-nvszp"] Jul 24 17:27:27.260963 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:27.260948 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nvszp" Jul 24 17:27:27.263617 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:27.263594 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-b2jbn\"" Jul 24 17:27:27.264121 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:27.264106 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 24 17:27:27.264551 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:27.264537 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 24 17:27:27.270774 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:27.270755 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-nvszp"] Jul 24 17:27:27.342263 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:27.342239 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/28cd9d64-e35f-488d-a15b-33c00bfccf6d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-nvszp\" (UID: \"28cd9d64-e35f-488d-a15b-33c00bfccf6d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nvszp" Jul 24 17:27:27.342399 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:27.342281 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4cjfb\" (UniqueName: \"kubernetes.io/projected/28cd9d64-e35f-488d-a15b-33c00bfccf6d-kube-api-access-4cjfb\") pod \"kuadrant-console-plugin-66b5774985-nvszp\" (UID: \"28cd9d64-e35f-488d-a15b-33c00bfccf6d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nvszp" Jul 24 17:27:27.342399 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:27.342384 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/28cd9d64-e35f-488d-a15b-33c00bfccf6d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-nvszp\" (UID: \"28cd9d64-e35f-488d-a15b-33c00bfccf6d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nvszp" Jul 24 17:27:27.443560 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:27.443532 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/28cd9d64-e35f-488d-a15b-33c00bfccf6d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-nvszp\" (UID: \"28cd9d64-e35f-488d-a15b-33c00bfccf6d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nvszp" Jul 24 17:27:27.443693 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:27.443579 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4cjfb\" (UniqueName: \"kubernetes.io/projected/28cd9d64-e35f-488d-a15b-33c00bfccf6d-kube-api-access-4cjfb\") pod \"kuadrant-console-plugin-66b5774985-nvszp\" (UID: \"28cd9d64-e35f-488d-a15b-33c00bfccf6d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nvszp" Jul 24 17:27:27.443693 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:27.443631 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/28cd9d64-e35f-488d-a15b-33c00bfccf6d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-nvszp\" (UID: \"28cd9d64-e35f-488d-a15b-33c00bfccf6d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nvszp" Jul 24 17:27:27.443772 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:27:27.443760 2570 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 24 17:27:27.443825 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:27:27.443816 2570 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28cd9d64-e35f-488d-a15b-33c00bfccf6d-plugin-serving-cert podName:28cd9d64-e35f-488d-a15b-33c00bfccf6d nodeName:}" failed. No retries permitted until 2026-07-24 17:27:27.943802119 +0000 UTC m=+443.612213121 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/28cd9d64-e35f-488d-a15b-33c00bfccf6d-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-nvszp" (UID: "28cd9d64-e35f-488d-a15b-33c00bfccf6d") : secret "plugin-serving-cert" not found Jul 24 17:27:27.444152 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:27.444133 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/28cd9d64-e35f-488d-a15b-33c00bfccf6d-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-nvszp\" (UID: \"28cd9d64-e35f-488d-a15b-33c00bfccf6d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nvszp" Jul 24 17:27:27.453106 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:27.453081 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4cjfb\" (UniqueName: \"kubernetes.io/projected/28cd9d64-e35f-488d-a15b-33c00bfccf6d-kube-api-access-4cjfb\") pod \"kuadrant-console-plugin-66b5774985-nvszp\" (UID: \"28cd9d64-e35f-488d-a15b-33c00bfccf6d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nvszp" Jul 24 17:27:27.950111 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:27.950075 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/28cd9d64-e35f-488d-a15b-33c00bfccf6d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-nvszp\" (UID: \"28cd9d64-e35f-488d-a15b-33c00bfccf6d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nvszp" Jul 24 17:27:27.952653 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:27.952634 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/28cd9d64-e35f-488d-a15b-33c00bfccf6d-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-nvszp\" (UID: \"28cd9d64-e35f-488d-a15b-33c00bfccf6d\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nvszp" Jul 24 17:27:28.170510 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:28.170469 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nvszp" Jul 24 17:27:28.306031 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:28.306008 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-nvszp"] Jul 24 17:27:28.307949 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:27:28.307921 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod28cd9d64_e35f_488d_a15b_33c00bfccf6d.slice/crio-d453eb0e442fcd1fb395db130c5076aeff0fa78a727235b67fb469f2d1672f8c WatchSource:0}: Error finding container d453eb0e442fcd1fb395db130c5076aeff0fa78a727235b67fb469f2d1672f8c: Status 404 returned error can't find the container with id d453eb0e442fcd1fb395db130c5076aeff0fa78a727235b67fb469f2d1672f8c Jul 24 17:27:28.982786 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:28.982760 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvclj" Jul 24 17:27:29.042796 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:29.042760 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nvszp" event={"ID":"28cd9d64-e35f-488d-a15b-33c00bfccf6d","Type":"ContainerStarted","Data":"d453eb0e442fcd1fb395db130c5076aeff0fa78a727235b67fb469f2d1672f8c"} Jul 24 17:27:35.066617 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:35.066576 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-786b854969-wv4p4" podUID="a8bcd125-2d3a-4176-aead-97a2d3aae766" containerName="console" containerID="cri-o://4544968925eef9844c81f531052f5e2336899e041a2a0dd9c6c20a4ce98938ad" gracePeriod=15 Jul 24 17:27:35.354589 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:35.354557 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-786b854969-wv4p4" Jul 24 17:27:35.432066 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:35.432036 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8bcd125-2d3a-4176-aead-97a2d3aae766-console-serving-cert\") pod \"a8bcd125-2d3a-4176-aead-97a2d3aae766\" (UID: \"a8bcd125-2d3a-4176-aead-97a2d3aae766\") " Jul 24 17:27:35.432222 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:35.432087 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8bcd125-2d3a-4176-aead-97a2d3aae766-service-ca\") pod \"a8bcd125-2d3a-4176-aead-97a2d3aae766\" (UID: \"a8bcd125-2d3a-4176-aead-97a2d3aae766\") " Jul 24 17:27:35.432222 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:35.432128 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8bcd125-2d3a-4176-aead-97a2d3aae766-console-config\") pod \"a8bcd125-2d3a-4176-aead-97a2d3aae766\" (UID: \"a8bcd125-2d3a-4176-aead-97a2d3aae766\") " Jul 24 17:27:35.432222 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:35.432154 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8bcd125-2d3a-4176-aead-97a2d3aae766-oauth-serving-cert\") pod \"a8bcd125-2d3a-4176-aead-97a2d3aae766\" (UID: \"a8bcd125-2d3a-4176-aead-97a2d3aae766\") " Jul 24 17:27:35.432222 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:35.432178 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8bcd125-2d3a-4176-aead-97a2d3aae766-trusted-ca-bundle\") pod \"a8bcd125-2d3a-4176-aead-97a2d3aae766\" (UID: \"a8bcd125-2d3a-4176-aead-97a2d3aae766\") " Jul 24 17:27:35.432467 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:35.432251 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8bcd125-2d3a-4176-aead-97a2d3aae766-console-oauth-config\") pod \"a8bcd125-2d3a-4176-aead-97a2d3aae766\" (UID: \"a8bcd125-2d3a-4176-aead-97a2d3aae766\") " Jul 24 17:27:35.432467 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:35.432281 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9qtpc\" (UniqueName: \"kubernetes.io/projected/a8bcd125-2d3a-4176-aead-97a2d3aae766-kube-api-access-9qtpc\") pod \"a8bcd125-2d3a-4176-aead-97a2d3aae766\" (UID: \"a8bcd125-2d3a-4176-aead-97a2d3aae766\") " Jul 24 17:27:35.432609 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:35.432578 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8bcd125-2d3a-4176-aead-97a2d3aae766-service-ca" (OuterVolumeSpecName: "service-ca") pod "a8bcd125-2d3a-4176-aead-97a2d3aae766" (UID: "a8bcd125-2d3a-4176-aead-97a2d3aae766"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 17:27:35.432609 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:35.432588 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8bcd125-2d3a-4176-aead-97a2d3aae766-console-config" (OuterVolumeSpecName: "console-config") pod "a8bcd125-2d3a-4176-aead-97a2d3aae766" (UID: "a8bcd125-2d3a-4176-aead-97a2d3aae766"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 17:27:35.432725 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:35.432614 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8bcd125-2d3a-4176-aead-97a2d3aae766-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "a8bcd125-2d3a-4176-aead-97a2d3aae766" (UID: "a8bcd125-2d3a-4176-aead-97a2d3aae766"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 17:27:35.432822 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:35.432801 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/a8bcd125-2d3a-4176-aead-97a2d3aae766-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "a8bcd125-2d3a-4176-aead-97a2d3aae766" (UID: "a8bcd125-2d3a-4176-aead-97a2d3aae766"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 17:27:35.434283 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:35.434265 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8bcd125-2d3a-4176-aead-97a2d3aae766-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "a8bcd125-2d3a-4176-aead-97a2d3aae766" (UID: "a8bcd125-2d3a-4176-aead-97a2d3aae766"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 17:27:35.434476 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:35.434452 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/a8bcd125-2d3a-4176-aead-97a2d3aae766-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "a8bcd125-2d3a-4176-aead-97a2d3aae766" (UID: "a8bcd125-2d3a-4176-aead-97a2d3aae766"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 17:27:35.434722 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:35.434702 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a8bcd125-2d3a-4176-aead-97a2d3aae766-kube-api-access-9qtpc" (OuterVolumeSpecName: "kube-api-access-9qtpc") pod "a8bcd125-2d3a-4176-aead-97a2d3aae766" (UID: "a8bcd125-2d3a-4176-aead-97a2d3aae766"). InnerVolumeSpecName "kube-api-access-9qtpc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 17:27:35.533455 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:35.533418 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9qtpc\" (UniqueName: \"kubernetes.io/projected/a8bcd125-2d3a-4176-aead-97a2d3aae766-kube-api-access-9qtpc\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:27:35.533455 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:35.533451 2570 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/a8bcd125-2d3a-4176-aead-97a2d3aae766-console-serving-cert\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:27:35.533455 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:35.533461 2570 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/a8bcd125-2d3a-4176-aead-97a2d3aae766-service-ca\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:27:35.533720 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:35.533469 2570 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/a8bcd125-2d3a-4176-aead-97a2d3aae766-console-config\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:27:35.533720 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:35.533477 2570 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/a8bcd125-2d3a-4176-aead-97a2d3aae766-oauth-serving-cert\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:27:35.533720 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:35.533485 2570 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/a8bcd125-2d3a-4176-aead-97a2d3aae766-trusted-ca-bundle\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:27:35.533720 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:35.533493 2570 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/a8bcd125-2d3a-4176-aead-97a2d3aae766-console-oauth-config\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:27:36.028071 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:36.028039 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-95vrj" Jul 24 17:27:36.028233 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:36.028202 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrx5j" Jul 24 17:27:36.092923 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:36.092888 2570 generic.go:356] "Generic (PLEG): container finished" podID="a8bcd125-2d3a-4176-aead-97a2d3aae766" containerID="4544968925eef9844c81f531052f5e2336899e041a2a0dd9c6c20a4ce98938ad" exitCode=0 Jul 24 17:27:36.093434 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:36.092943 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-786b854969-wv4p4" Jul 24 17:27:36.093434 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:36.092964 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-786b854969-wv4p4" event={"ID":"a8bcd125-2d3a-4176-aead-97a2d3aae766","Type":"ContainerDied","Data":"4544968925eef9844c81f531052f5e2336899e041a2a0dd9c6c20a4ce98938ad"} Jul 24 17:27:36.093434 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:36.093036 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-786b854969-wv4p4" event={"ID":"a8bcd125-2d3a-4176-aead-97a2d3aae766","Type":"ContainerDied","Data":"700602ced233fbf955514e72d814ec114632eb3ad820b7e0bf3b5d9fed0bf4f4"} Jul 24 17:27:36.093434 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:36.093070 2570 scope.go:117] "RemoveContainer" containerID="4544968925eef9844c81f531052f5e2336899e041a2a0dd9c6c20a4ce98938ad" Jul 24 17:27:36.107649 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:36.107614 2570 scope.go:117] "RemoveContainer" containerID="4544968925eef9844c81f531052f5e2336899e041a2a0dd9c6c20a4ce98938ad" Jul 24 17:27:36.108098 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:27:36.108029 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4544968925eef9844c81f531052f5e2336899e041a2a0dd9c6c20a4ce98938ad\": container with ID starting with 4544968925eef9844c81f531052f5e2336899e041a2a0dd9c6c20a4ce98938ad not found: ID does not exist" containerID="4544968925eef9844c81f531052f5e2336899e041a2a0dd9c6c20a4ce98938ad" Jul 24 17:27:36.108098 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:36.108069 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4544968925eef9844c81f531052f5e2336899e041a2a0dd9c6c20a4ce98938ad"} err="failed to get container status \"4544968925eef9844c81f531052f5e2336899e041a2a0dd9c6c20a4ce98938ad\": rpc error: code = NotFound desc = could not find container \"4544968925eef9844c81f531052f5e2336899e041a2a0dd9c6c20a4ce98938ad\": container with ID starting with 4544968925eef9844c81f531052f5e2336899e041a2a0dd9c6c20a4ce98938ad not found: ID does not exist" Jul 24 17:27:36.123374 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:36.123281 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-786b854969-wv4p4"] Jul 24 17:27:36.127763 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:36.127740 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-786b854969-wv4p4"] Jul 24 17:27:36.915202 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:36.915175 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a8bcd125-2d3a-4176-aead-97a2d3aae766" path="/var/lib/kubelet/pods/a8bcd125-2d3a-4176-aead-97a2d3aae766/volumes" Jul 24 17:27:37.859905 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:37.859875 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrx5j"] Jul 24 17:27:37.860406 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:37.860093 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrx5j" podUID="3bf0caaa-6dd3-4d2d-bb81-019b52636489" containerName="manager" containerID="cri-o://7e7741944edadf38e2dfbc6fee739008bedcdc6ccb357aa6d42b3f068d2dad23" gracePeriod=2 Jul 24 17:27:37.870048 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:37.870009 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrx5j"] Jul 24 17:27:37.879370 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:27:37.879318 2570 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3bf0caaa-6dd3-4d2d-bb81-019b52636489\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-hrx5j\": pods \"kuadrant-operator-controller-manager-8684c9ff49-hrx5j\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrx5j" Jul 24 17:27:37.889133 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:37.889109 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvclj"] Jul 24 17:27:37.889605 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:37.889361 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvclj" podUID="d3e74765-8ebd-4e49-9be4-05dca5df915f" containerName="manager" containerID="cri-o://c9a1af382e70211be86e79f22bd0efe448a302b3bc05ec3c95e107e080a7b320" gracePeriod=2 Jul 24 17:27:37.895208 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:27:37.894492 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-hrx5j\" is forbidden: User \"system:node:ip-10-0-141-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-115.ec2.internal' and this object" podUID="3bf0caaa-6dd3-4d2d-bb81-019b52636489" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrx5j" Jul 24 17:27:37.896057 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:37.895896 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mzcm"] Jul 24 17:27:37.897620 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:37.896812 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3bf0caaa-6dd3-4d2d-bb81-019b52636489" containerName="manager" Jul 24 17:27:37.897620 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:37.896835 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="3bf0caaa-6dd3-4d2d-bb81-019b52636489" containerName="manager" Jul 24 17:27:37.897620 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:37.896854 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a8bcd125-2d3a-4176-aead-97a2d3aae766" containerName="console" Jul 24 17:27:37.897620 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:37.896862 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a8bcd125-2d3a-4176-aead-97a2d3aae766" containerName="console" Jul 24 17:27:37.897620 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:37.896973 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a8bcd125-2d3a-4176-aead-97a2d3aae766" containerName="console" Jul 24 17:27:37.897620 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:37.896986 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="3bf0caaa-6dd3-4d2d-bb81-019b52636489" containerName="manager" Jul 24 17:27:37.897975 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:27:37.897621 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qvclj\" is forbidden: User \"system:node:ip-10-0-141-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-115.ec2.internal' and this object" podUID="d3e74765-8ebd-4e49-9be4-05dca5df915f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvclj" Jul 24 17:27:37.900677 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:37.900623 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvclj"] Jul 24 17:27:37.900830 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:37.900767 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mzcm" Jul 24 17:27:37.903917 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:27:37.903892 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-hrx5j\" is forbidden: User \"system:node:ip-10-0-141-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-115.ec2.internal' and this object" podUID="3bf0caaa-6dd3-4d2d-bb81-019b52636489" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrx5j" Jul 24 17:27:37.905895 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:27:37.905869 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qvclj\" is forbidden: User \"system:node:ip-10-0-141-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-115.ec2.internal' and this object" podUID="d3e74765-8ebd-4e49-9be4-05dca5df915f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvclj" Jul 24 17:27:37.921507 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:37.921438 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mzcm"] Jul 24 17:27:37.922931 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:37.922908 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kglgk"] Jul 24 17:27:37.923591 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:37.923567 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3e74765-8ebd-4e49-9be4-05dca5df915f" containerName="manager" Jul 24 17:27:37.923591 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:37.923593 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3e74765-8ebd-4e49-9be4-05dca5df915f" containerName="manager" Jul 24 17:27:37.923747 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:37.923686 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3e74765-8ebd-4e49-9be4-05dca5df915f" containerName="manager" Jul 24 17:27:37.931492 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:37.930803 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kglgk" Jul 24 17:27:37.942950 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:27:37.942900 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qvclj\" is forbidden: User \"system:node:ip-10-0-141-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-115.ec2.internal' and this object" podUID="d3e74765-8ebd-4e49-9be4-05dca5df915f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvclj" Jul 24 17:27:37.946387 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:37.946363 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kglgk"] Jul 24 17:27:37.969546 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:27:37.969516 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-hrx5j\" is forbidden: User \"system:node:ip-10-0-141-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-115.ec2.internal' and this object" podUID="3bf0caaa-6dd3-4d2d-bb81-019b52636489" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrx5j" Jul 24 17:27:38.055567 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:38.055489 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxbs8\" (UniqueName: \"kubernetes.io/projected/5c1d7bbf-7847-4f3e-bac5-cd46a4535021-kube-api-access-vxbs8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7mzcm\" (UID: \"5c1d7bbf-7847-4f3e-bac5-cd46a4535021\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mzcm" Jul 24 17:27:38.055567 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:38.055563 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2wvf\" (UniqueName: \"kubernetes.io/projected/3174426f-1bf6-43ce-90f8-0abc78e55c2c-kube-api-access-c2wvf\") pod \"limitador-operator-controller-manager-859d7b78bd-kglgk\" (UID: \"3174426f-1bf6-43ce-90f8-0abc78e55c2c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kglgk" Jul 24 17:27:38.055756 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:38.055593 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c1d7bbf-7847-4f3e-bac5-cd46a4535021-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7mzcm\" (UID: \"5c1d7bbf-7847-4f3e-bac5-cd46a4535021\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mzcm" Jul 24 17:27:38.156293 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:38.156213 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vxbs8\" (UniqueName: \"kubernetes.io/projected/5c1d7bbf-7847-4f3e-bac5-cd46a4535021-kube-api-access-vxbs8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7mzcm\" (UID: \"5c1d7bbf-7847-4f3e-bac5-cd46a4535021\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mzcm" Jul 24 17:27:38.156293 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:38.156274 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2wvf\" (UniqueName: \"kubernetes.io/projected/3174426f-1bf6-43ce-90f8-0abc78e55c2c-kube-api-access-c2wvf\") pod \"limitador-operator-controller-manager-859d7b78bd-kglgk\" (UID: \"3174426f-1bf6-43ce-90f8-0abc78e55c2c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kglgk" Jul 24 17:27:38.156533 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:38.156303 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c1d7bbf-7847-4f3e-bac5-cd46a4535021-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7mzcm\" (UID: \"5c1d7bbf-7847-4f3e-bac5-cd46a4535021\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mzcm" Jul 24 17:27:38.156712 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:38.156686 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c1d7bbf-7847-4f3e-bac5-cd46a4535021-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7mzcm\" (UID: \"5c1d7bbf-7847-4f3e-bac5-cd46a4535021\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mzcm" Jul 24 17:27:38.171437 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:38.171414 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vxbs8\" (UniqueName: \"kubernetes.io/projected/5c1d7bbf-7847-4f3e-bac5-cd46a4535021-kube-api-access-vxbs8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7mzcm\" (UID: \"5c1d7bbf-7847-4f3e-bac5-cd46a4535021\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mzcm" Jul 24 17:27:38.185043 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:38.185018 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2wvf\" (UniqueName: \"kubernetes.io/projected/3174426f-1bf6-43ce-90f8-0abc78e55c2c-kube-api-access-c2wvf\") pod \"limitador-operator-controller-manager-859d7b78bd-kglgk\" (UID: \"3174426f-1bf6-43ce-90f8-0abc78e55c2c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kglgk" Jul 24 17:27:38.302803 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:38.302769 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mzcm" Jul 24 17:27:38.310218 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:38.310198 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kglgk" Jul 24 17:27:50.705225 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:50.704802 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kglgk"] Jul 24 17:27:50.707817 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:27:50.707789 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3174426f_1bf6_43ce_90f8_0abc78e55c2c.slice/crio-e986798eacddee77bc1f9a0a51b4e7f5344b752cebf7baf35ee5c72982e290f4 WatchSource:0}: Error finding container e986798eacddee77bc1f9a0a51b4e7f5344b752cebf7baf35ee5c72982e290f4: Status 404 returned error can't find the container with id e986798eacddee77bc1f9a0a51b4e7f5344b752cebf7baf35ee5c72982e290f4 Jul 24 17:27:50.708324 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:50.708305 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrx5j" Jul 24 17:27:50.709623 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:50.709569 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvclj" Jul 24 17:27:50.710995 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:27:50.710969 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-hrx5j\" is forbidden: User \"system:node:ip-10-0-141-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-115.ec2.internal' and this object" podUID="3bf0caaa-6dd3-4d2d-bb81-019b52636489" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrx5j" Jul 24 17:27:50.713066 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:27:50.713033 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-hrx5j\" is forbidden: User \"system:node:ip-10-0-141-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-115.ec2.internal' and this object" podUID="3bf0caaa-6dd3-4d2d-bb81-019b52636489" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrx5j" Jul 24 17:27:50.714943 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:27:50.714915 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qvclj\" is forbidden: User \"system:node:ip-10-0-141-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-115.ec2.internal' and this object" podUID="d3e74765-8ebd-4e49-9be4-05dca5df915f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvclj" Jul 24 17:27:50.752430 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:50.752399 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mzcm"] Jul 24 17:27:50.753161 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:27:50.753140 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c1d7bbf_7847_4f3e_bac5_cd46a4535021.slice/crio-fc89be478f2a43e4d8dfafab31fbebbea6793fe1f33485a97f450c7894de7173 WatchSource:0}: Error finding container fc89be478f2a43e4d8dfafab31fbebbea6793fe1f33485a97f450c7894de7173: Status 404 returned error can't find the container with id fc89be478f2a43e4d8dfafab31fbebbea6793fe1f33485a97f450c7894de7173 Jul 24 17:27:50.874877 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:50.874853 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c9hlb\" (UniqueName: \"kubernetes.io/projected/3bf0caaa-6dd3-4d2d-bb81-019b52636489-kube-api-access-c9hlb\") pod \"3bf0caaa-6dd3-4d2d-bb81-019b52636489\" (UID: \"3bf0caaa-6dd3-4d2d-bb81-019b52636489\") " Jul 24 17:27:50.875022 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:50.874924 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dw74j\" (UniqueName: \"kubernetes.io/projected/d3e74765-8ebd-4e49-9be4-05dca5df915f-kube-api-access-dw74j\") pod \"d3e74765-8ebd-4e49-9be4-05dca5df915f\" (UID: \"d3e74765-8ebd-4e49-9be4-05dca5df915f\") " Jul 24 17:27:50.875022 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:50.874945 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bf0caaa-6dd3-4d2d-bb81-019b52636489-extensions-socket-volume\") pod \"3bf0caaa-6dd3-4d2d-bb81-019b52636489\" (UID: \"3bf0caaa-6dd3-4d2d-bb81-019b52636489\") " Jul 24 17:27:50.875465 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:50.875438 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3bf0caaa-6dd3-4d2d-bb81-019b52636489-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3bf0caaa-6dd3-4d2d-bb81-019b52636489" (UID: "3bf0caaa-6dd3-4d2d-bb81-019b52636489"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 17:27:50.876872 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:50.876852 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3bf0caaa-6dd3-4d2d-bb81-019b52636489-kube-api-access-c9hlb" (OuterVolumeSpecName: "kube-api-access-c9hlb") pod "3bf0caaa-6dd3-4d2d-bb81-019b52636489" (UID: "3bf0caaa-6dd3-4d2d-bb81-019b52636489"). InnerVolumeSpecName "kube-api-access-c9hlb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 17:27:50.876959 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:50.876941 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3e74765-8ebd-4e49-9be4-05dca5df915f-kube-api-access-dw74j" (OuterVolumeSpecName: "kube-api-access-dw74j") pod "d3e74765-8ebd-4e49-9be4-05dca5df915f" (UID: "d3e74765-8ebd-4e49-9be4-05dca5df915f"). InnerVolumeSpecName "kube-api-access-dw74j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 17:27:50.914293 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:50.914262 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3bf0caaa-6dd3-4d2d-bb81-019b52636489" path="/var/lib/kubelet/pods/3bf0caaa-6dd3-4d2d-bb81-019b52636489/volumes" Jul 24 17:27:50.914605 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:50.914592 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3e74765-8ebd-4e49-9be4-05dca5df915f" path="/var/lib/kubelet/pods/d3e74765-8ebd-4e49-9be4-05dca5df915f/volumes" Jul 24 17:27:50.975661 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:50.975627 2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3bf0caaa-6dd3-4d2d-bb81-019b52636489-extensions-socket-volume\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:27:50.975661 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:50.975653 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c9hlb\" (UniqueName: \"kubernetes.io/projected/3bf0caaa-6dd3-4d2d-bb81-019b52636489-kube-api-access-c9hlb\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:27:50.975797 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:50.975669 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dw74j\" (UniqueName: \"kubernetes.io/projected/d3e74765-8ebd-4e49-9be4-05dca5df915f-kube-api-access-dw74j\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:27:51.191133 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:51.191105 2570 generic.go:356] "Generic (PLEG): container finished" podID="d3e74765-8ebd-4e49-9be4-05dca5df915f" containerID="c9a1af382e70211be86e79f22bd0efe448a302b3bc05ec3c95e107e080a7b320" exitCode=0 Jul 24 17:27:51.191307 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:51.191152 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvclj" Jul 24 17:27:51.191856 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:51.191198 2570 scope.go:117] "RemoveContainer" containerID="c9a1af382e70211be86e79f22bd0efe448a302b3bc05ec3c95e107e080a7b320" Jul 24 17:27:51.192687 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:51.192665 2570 generic.go:356] "Generic (PLEG): container finished" podID="3bf0caaa-6dd3-4d2d-bb81-019b52636489" containerID="7e7741944edadf38e2dfbc6fee739008bedcdc6ccb357aa6d42b3f068d2dad23" exitCode=0 Jul 24 17:27:51.192808 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:51.192716 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrx5j" Jul 24 17:27:51.193712 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:27:51.193681 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qvclj\" is forbidden: User \"system:node:ip-10-0-141-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-115.ec2.internal' and this object" podUID="d3e74765-8ebd-4e49-9be4-05dca5df915f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvclj" Jul 24 17:27:51.194557 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:51.194532 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nvszp" event={"ID":"28cd9d64-e35f-488d-a15b-33c00bfccf6d","Type":"ContainerStarted","Data":"691e773cdac3c4e39bc308a57cbb826c46ebda816a41ac434a0c7990f0369a5c"} Jul 24 17:27:51.195818 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:27:51.195789 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-hrx5j\" is forbidden: User \"system:node:ip-10-0-141-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-115.ec2.internal' and this object" podUID="3bf0caaa-6dd3-4d2d-bb81-019b52636489" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrx5j" Jul 24 17:27:51.196374 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:51.196354 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mzcm" event={"ID":"5c1d7bbf-7847-4f3e-bac5-cd46a4535021","Type":"ContainerStarted","Data":"d97b4fcca110607c983258933f928d3a7a1411590ea0ceafcca4a99e089a1db8"} Jul 24 17:27:51.196458 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:51.196396 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mzcm" event={"ID":"5c1d7bbf-7847-4f3e-bac5-cd46a4535021","Type":"ContainerStarted","Data":"fc89be478f2a43e4d8dfafab31fbebbea6793fe1f33485a97f450c7894de7173"} Jul 24 17:27:51.196458 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:51.196423 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mzcm" Jul 24 17:27:51.197784 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:27:51.197757 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qvclj\" is forbidden: User \"system:node:ip-10-0-141-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-115.ec2.internal' and this object" podUID="d3e74765-8ebd-4e49-9be4-05dca5df915f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvclj" Jul 24 17:27:51.197880 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:51.197846 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kglgk" event={"ID":"3174426f-1bf6-43ce-90f8-0abc78e55c2c","Type":"ContainerStarted","Data":"c7078d9e2d72e504035d2b7bcca2b663cffb29988c27f349ece210b6646d7a45"} Jul 24 17:27:51.197929 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:51.197888 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kglgk" event={"ID":"3174426f-1bf6-43ce-90f8-0abc78e55c2c","Type":"ContainerStarted","Data":"e986798eacddee77bc1f9a0a51b4e7f5344b752cebf7baf35ee5c72982e290f4"} Jul 24 17:27:51.197992 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:51.197977 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kglgk" Jul 24 17:27:51.199732 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:27:51.199711 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qvclj\" is forbidden: User \"system:node:ip-10-0-141-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-115.ec2.internal' and this object" podUID="d3e74765-8ebd-4e49-9be4-05dca5df915f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvclj" Jul 24 17:27:51.201656 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:51.201640 2570 scope.go:117] "RemoveContainer" containerID="c9a1af382e70211be86e79f22bd0efe448a302b3bc05ec3c95e107e080a7b320" Jul 24 17:27:51.201889 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:27:51.201873 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c9a1af382e70211be86e79f22bd0efe448a302b3bc05ec3c95e107e080a7b320\": container with ID starting with c9a1af382e70211be86e79f22bd0efe448a302b3bc05ec3c95e107e080a7b320 not found: ID does not exist" containerID="c9a1af382e70211be86e79f22bd0efe448a302b3bc05ec3c95e107e080a7b320" Jul 24 17:27:51.201931 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:51.201896 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c9a1af382e70211be86e79f22bd0efe448a302b3bc05ec3c95e107e080a7b320"} err="failed to get container status \"c9a1af382e70211be86e79f22bd0efe448a302b3bc05ec3c95e107e080a7b320\": rpc error: code = NotFound desc = could not find container \"c9a1af382e70211be86e79f22bd0efe448a302b3bc05ec3c95e107e080a7b320\": container with ID starting with c9a1af382e70211be86e79f22bd0efe448a302b3bc05ec3c95e107e080a7b320 not found: ID does not exist" Jul 24 17:27:51.201931 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:51.201912 2570 scope.go:117] "RemoveContainer" containerID="7e7741944edadf38e2dfbc6fee739008bedcdc6ccb357aa6d42b3f068d2dad23" Jul 24 17:27:51.209561 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:51.209546 2570 scope.go:117] "RemoveContainer" containerID="7e7741944edadf38e2dfbc6fee739008bedcdc6ccb357aa6d42b3f068d2dad23" Jul 24 17:27:51.209817 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:27:51.209800 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e7741944edadf38e2dfbc6fee739008bedcdc6ccb357aa6d42b3f068d2dad23\": container with ID starting with 7e7741944edadf38e2dfbc6fee739008bedcdc6ccb357aa6d42b3f068d2dad23 not found: ID does not exist" containerID="7e7741944edadf38e2dfbc6fee739008bedcdc6ccb357aa6d42b3f068d2dad23" Jul 24 17:27:51.209864 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:51.209824 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e7741944edadf38e2dfbc6fee739008bedcdc6ccb357aa6d42b3f068d2dad23"} err="failed to get container status \"7e7741944edadf38e2dfbc6fee739008bedcdc6ccb357aa6d42b3f068d2dad23\": rpc error: code = NotFound desc = could not find container \"7e7741944edadf38e2dfbc6fee739008bedcdc6ccb357aa6d42b3f068d2dad23\": container with ID starting with 7e7741944edadf38e2dfbc6fee739008bedcdc6ccb357aa6d42b3f068d2dad23 not found: ID does not exist" Jul 24 17:27:51.219239 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:51.219198 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-nvszp" podStartSLOduration=1.938300847 podStartE2EDuration="24.219186616s" totalImagesPullingTime="22.280885769s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:27:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:27:51.216107083 +0000 UTC m=+466.884518110" watchObservedRunningTime="2026-07-24 17:27:51.219186616 +0000 UTC m=+466.887597689" Jul 24 17:27:51.241030 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:51.240989 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mzcm" podStartSLOduration=14.240974834 podStartE2EDuration="14.240974834s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:27:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:27:51.239890703 +0000 UTC m=+466.908301726" watchObservedRunningTime="2026-07-24 17:27:51.240974834 +0000 UTC m=+466.909385857" Jul 24 17:27:51.242091 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:27:51.242061 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-hrx5j\" is forbidden: User \"system:node:ip-10-0-141-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-115.ec2.internal' and this object" podUID="3bf0caaa-6dd3-4d2d-bb81-019b52636489" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrx5j" Jul 24 17:27:51.245202 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:27:51.245178 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-qvclj\" is forbidden: User \"system:node:ip-10-0-141-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-115.ec2.internal' and this object" podUID="d3e74765-8ebd-4e49-9be4-05dca5df915f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-qvclj" Jul 24 17:27:51.266434 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:51.266327 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kglgk" podStartSLOduration=14.266315132999999 podStartE2EDuration="14.266315133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:27:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:27:51.264836744 +0000 UTC m=+466.933247769" watchObservedRunningTime="2026-07-24 17:27:51.266315133 +0000 UTC m=+466.934726157" Jul 24 17:27:51.266751 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:27:51.266728 2570 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-hrx5j\" is forbidden: User \"system:node:ip-10-0-141-115.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-115.ec2.internal' and this object" podUID="3bf0caaa-6dd3-4d2d-bb81-019b52636489" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-hrx5j" Jul 24 17:27:53.632633 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:53.632599 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mzcm"] Jul 24 17:27:53.633163 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:53.632828 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mzcm" podUID="5c1d7bbf-7847-4f3e-bac5-cd46a4535021" containerName="manager" containerID="cri-o://d97b4fcca110607c983258933f928d3a7a1411590ea0ceafcca4a99e089a1db8" gracePeriod=10 Jul 24 17:27:53.877538 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:53.877504 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdlb8"] Jul 24 17:27:53.880421 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:53.880403 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdlb8" Jul 24 17:27:53.884094 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:53.884047 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mzcm" Jul 24 17:27:53.893258 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:53.893237 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdlb8"] Jul 24 17:27:54.003230 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:54.003196 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vxbs8\" (UniqueName: \"kubernetes.io/projected/5c1d7bbf-7847-4f3e-bac5-cd46a4535021-kube-api-access-vxbs8\") pod \"5c1d7bbf-7847-4f3e-bac5-cd46a4535021\" (UID: \"5c1d7bbf-7847-4f3e-bac5-cd46a4535021\") " Jul 24 17:27:54.003451 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:54.003277 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c1d7bbf-7847-4f3e-bac5-cd46a4535021-extensions-socket-volume\") pod \"5c1d7bbf-7847-4f3e-bac5-cd46a4535021\" (UID: \"5c1d7bbf-7847-4f3e-bac5-cd46a4535021\") " Jul 24 17:27:54.003451 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:54.003426 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2e00c82-3d10-495e-8613-5f6294dd8b23-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qdlb8\" (UID: \"b2e00c82-3d10-495e-8613-5f6294dd8b23\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdlb8" Jul 24 17:27:54.003579 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:54.003472 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwwm4\" (UniqueName: \"kubernetes.io/projected/b2e00c82-3d10-495e-8613-5f6294dd8b23-kube-api-access-kwwm4\") pod \"kuadrant-operator-controller-manager-86878c769f-qdlb8\" (UID: \"b2e00c82-3d10-495e-8613-5f6294dd8b23\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdlb8" Jul 24 17:27:54.003678 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:54.003654 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5c1d7bbf-7847-4f3e-bac5-cd46a4535021-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "5c1d7bbf-7847-4f3e-bac5-cd46a4535021" (UID: "5c1d7bbf-7847-4f3e-bac5-cd46a4535021"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 17:27:54.005486 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:54.005462 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5c1d7bbf-7847-4f3e-bac5-cd46a4535021-kube-api-access-vxbs8" (OuterVolumeSpecName: "kube-api-access-vxbs8") pod "5c1d7bbf-7847-4f3e-bac5-cd46a4535021" (UID: "5c1d7bbf-7847-4f3e-bac5-cd46a4535021"). InnerVolumeSpecName "kube-api-access-vxbs8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 17:27:54.104452 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:54.104417 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2e00c82-3d10-495e-8613-5f6294dd8b23-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qdlb8\" (UID: \"b2e00c82-3d10-495e-8613-5f6294dd8b23\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdlb8" Jul 24 17:27:54.104580 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:54.104474 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwwm4\" (UniqueName: \"kubernetes.io/projected/b2e00c82-3d10-495e-8613-5f6294dd8b23-kube-api-access-kwwm4\") pod \"kuadrant-operator-controller-manager-86878c769f-qdlb8\" (UID: \"b2e00c82-3d10-495e-8613-5f6294dd8b23\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdlb8" Jul 24 17:27:54.104580 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:54.104541 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxbs8\" (UniqueName: \"kubernetes.io/projected/5c1d7bbf-7847-4f3e-bac5-cd46a4535021-kube-api-access-vxbs8\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:27:54.104580 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:54.104552 2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c1d7bbf-7847-4f3e-bac5-cd46a4535021-extensions-socket-volume\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:27:54.104780 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:54.104760 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2e00c82-3d10-495e-8613-5f6294dd8b23-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-qdlb8\" (UID: \"b2e00c82-3d10-495e-8613-5f6294dd8b23\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdlb8" Jul 24 17:27:54.113855 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:54.113833 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwwm4\" (UniqueName: \"kubernetes.io/projected/b2e00c82-3d10-495e-8613-5f6294dd8b23-kube-api-access-kwwm4\") pod \"kuadrant-operator-controller-manager-86878c769f-qdlb8\" (UID: \"b2e00c82-3d10-495e-8613-5f6294dd8b23\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdlb8" Jul 24 17:27:54.191561 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:54.191505 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdlb8" Jul 24 17:27:54.216783 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:54.216757 2570 generic.go:356] "Generic (PLEG): container finished" podID="5c1d7bbf-7847-4f3e-bac5-cd46a4535021" containerID="d97b4fcca110607c983258933f928d3a7a1411590ea0ceafcca4a99e089a1db8" exitCode=0 Jul 24 17:27:54.216855 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:54.216805 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mzcm" Jul 24 17:27:54.216855 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:54.216820 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mzcm" event={"ID":"5c1d7bbf-7847-4f3e-bac5-cd46a4535021","Type":"ContainerDied","Data":"d97b4fcca110607c983258933f928d3a7a1411590ea0ceafcca4a99e089a1db8"} Jul 24 17:27:54.216931 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:54.216873 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mzcm" event={"ID":"5c1d7bbf-7847-4f3e-bac5-cd46a4535021","Type":"ContainerDied","Data":"fc89be478f2a43e4d8dfafab31fbebbea6793fe1f33485a97f450c7894de7173"} Jul 24 17:27:54.216931 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:54.216903 2570 scope.go:117] "RemoveContainer" containerID="d97b4fcca110607c983258933f928d3a7a1411590ea0ceafcca4a99e089a1db8" Jul 24 17:27:54.226017 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:54.225997 2570 scope.go:117] "RemoveContainer" containerID="d97b4fcca110607c983258933f928d3a7a1411590ea0ceafcca4a99e089a1db8" Jul 24 17:27:54.226263 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:27:54.226244 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d97b4fcca110607c983258933f928d3a7a1411590ea0ceafcca4a99e089a1db8\": container with ID starting with d97b4fcca110607c983258933f928d3a7a1411590ea0ceafcca4a99e089a1db8 not found: ID does not exist" containerID="d97b4fcca110607c983258933f928d3a7a1411590ea0ceafcca4a99e089a1db8" Jul 24 17:27:54.226365 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:54.226284 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d97b4fcca110607c983258933f928d3a7a1411590ea0ceafcca4a99e089a1db8"} err="failed to get container status \"d97b4fcca110607c983258933f928d3a7a1411590ea0ceafcca4a99e089a1db8\": rpc error: code = NotFound desc = could not find container \"d97b4fcca110607c983258933f928d3a7a1411590ea0ceafcca4a99e089a1db8\": container with ID starting with d97b4fcca110607c983258933f928d3a7a1411590ea0ceafcca4a99e089a1db8 not found: ID does not exist" Jul 24 17:27:54.257130 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:54.257106 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mzcm"] Jul 24 17:27:54.270890 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:54.270865 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7mzcm"] Jul 24 17:27:54.373965 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:54.373941 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdlb8"] Jul 24 17:27:54.375715 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:27:54.375690 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2e00c82_3d10_495e_8613_5f6294dd8b23.slice/crio-7b08393eef8ca9d67bb54cfae79c7cef24c44adb7b3aa80daf83016b82c7e89e WatchSource:0}: Error finding container 7b08393eef8ca9d67bb54cfae79c7cef24c44adb7b3aa80daf83016b82c7e89e: Status 404 returned error can't find the container with id 7b08393eef8ca9d67bb54cfae79c7cef24c44adb7b3aa80daf83016b82c7e89e Jul 24 17:27:54.912919 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:54.912881 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5c1d7bbf-7847-4f3e-bac5-cd46a4535021" path="/var/lib/kubelet/pods/5c1d7bbf-7847-4f3e-bac5-cd46a4535021/volumes" Jul 24 17:27:55.224419 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:55.224315 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdlb8" event={"ID":"b2e00c82-3d10-495e-8613-5f6294dd8b23","Type":"ContainerStarted","Data":"350bcde8eaca35257a5d4b733059a12f507b076252a76c4910db03cb5693a671"} Jul 24 17:27:55.224419 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:55.224392 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdlb8" event={"ID":"b2e00c82-3d10-495e-8613-5f6294dd8b23","Type":"ContainerStarted","Data":"7b08393eef8ca9d67bb54cfae79c7cef24c44adb7b3aa80daf83016b82c7e89e"} Jul 24 17:27:55.224586 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:55.224491 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdlb8" Jul 24 17:27:55.247937 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:27:55.247887 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdlb8" podStartSLOduration=2.247871403 podStartE2EDuration="2.247871403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:27:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:27:55.247361046 +0000 UTC m=+470.915772069" watchObservedRunningTime="2026-07-24 17:27:55.247871403 +0000 UTC m=+470.916282426" Jul 24 17:28:02.208203 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:02.208171 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kglgk" Jul 24 17:28:06.232183 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:06.232150 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdlb8" Jul 24 17:28:10.001628 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:10.001596 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb"] Jul 24 17:28:10.002221 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:10.002161 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5c1d7bbf-7847-4f3e-bac5-cd46a4535021" containerName="manager" Jul 24 17:28:10.002221 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:10.002183 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="5c1d7bbf-7847-4f3e-bac5-cd46a4535021" containerName="manager" Jul 24 17:28:10.002414 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:10.002284 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="5c1d7bbf-7847-4f3e-bac5-cd46a4535021" containerName="manager" Jul 24 17:28:10.014750 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:10.014727 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" Jul 24 17:28:10.021795 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:10.021774 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-86jxj\"" Jul 24 17:28:10.028906 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:10.028885 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb"] Jul 24 17:28:10.129355 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:10.129309 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20e6590f-5bb5-4797-9234-900b1ad54681-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-njznb\" (UID: \"20e6590f-5bb5-4797-9234-900b1ad54681\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" Jul 24 17:28:10.129477 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:10.129367 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20e6590f-5bb5-4797-9234-900b1ad54681-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-njznb\" (UID: \"20e6590f-5bb5-4797-9234-900b1ad54681\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" Jul 24 17:28:10.129477 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:10.129392 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20e6590f-5bb5-4797-9234-900b1ad54681-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-njznb\" (UID: \"20e6590f-5bb5-4797-9234-900b1ad54681\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" Jul 24 17:28:10.129477 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:10.129433 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20e6590f-5bb5-4797-9234-900b1ad54681-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-njznb\" (UID: \"20e6590f-5bb5-4797-9234-900b1ad54681\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" Jul 24 17:28:10.129477 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:10.129451 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20e6590f-5bb5-4797-9234-900b1ad54681-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-njznb\" (UID: \"20e6590f-5bb5-4797-9234-900b1ad54681\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" Jul 24 17:28:10.129712 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:10.129536 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7slnt\" (UniqueName: \"kubernetes.io/projected/20e6590f-5bb5-4797-9234-900b1ad54681-kube-api-access-7slnt\") pod \"maas-default-gateway-openshift-default-5ccb968c66-njznb\" (UID: \"20e6590f-5bb5-4797-9234-900b1ad54681\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" Jul 24 17:28:10.129712 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:10.129584 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20e6590f-5bb5-4797-9234-900b1ad54681-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-njznb\" (UID: \"20e6590f-5bb5-4797-9234-900b1ad54681\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" Jul 24 17:28:10.129712 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:10.129659 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20e6590f-5bb5-4797-9234-900b1ad54681-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-njznb\" (UID: \"20e6590f-5bb5-4797-9234-900b1ad54681\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" Jul 24 17:28:10.129712 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:10.129694 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20e6590f-5bb5-4797-9234-900b1ad54681-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-njznb\" (UID: \"20e6590f-5bb5-4797-9234-900b1ad54681\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" Jul 24 17:28:10.230468 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:10.230441 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20e6590f-5bb5-4797-9234-900b1ad54681-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-njznb\" (UID: \"20e6590f-5bb5-4797-9234-900b1ad54681\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" Jul 24 17:28:10.230599 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:10.230476 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20e6590f-5bb5-4797-9234-900b1ad54681-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-njznb\" (UID: \"20e6590f-5bb5-4797-9234-900b1ad54681\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" Jul 24 17:28:10.230599 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:10.230501 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20e6590f-5bb5-4797-9234-900b1ad54681-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-njznb\" (UID: \"20e6590f-5bb5-4797-9234-900b1ad54681\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" Jul 24 17:28:10.230599 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:10.230526 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20e6590f-5bb5-4797-9234-900b1ad54681-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-njznb\" (UID: \"20e6590f-5bb5-4797-9234-900b1ad54681\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" Jul 24 17:28:10.230599 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:10.230550 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20e6590f-5bb5-4797-9234-900b1ad54681-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-njznb\" (UID: \"20e6590f-5bb5-4797-9234-900b1ad54681\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" Jul 24 17:28:10.230599 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:10.230590 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20e6590f-5bb5-4797-9234-900b1ad54681-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-njznb\" (UID: \"20e6590f-5bb5-4797-9234-900b1ad54681\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" Jul 24 17:28:10.230818 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:10.230613 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20e6590f-5bb5-4797-9234-900b1ad54681-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-njznb\" (UID: \"20e6590f-5bb5-4797-9234-900b1ad54681\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" Jul 24 17:28:10.230818 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:10.230639 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7slnt\" (UniqueName: \"kubernetes.io/projected/20e6590f-5bb5-4797-9234-900b1ad54681-kube-api-access-7slnt\") pod \"maas-default-gateway-openshift-default-5ccb968c66-njznb\" (UID: \"20e6590f-5bb5-4797-9234-900b1ad54681\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" Jul 24 17:28:10.230818 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:10.230674 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20e6590f-5bb5-4797-9234-900b1ad54681-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-njznb\" (UID: \"20e6590f-5bb5-4797-9234-900b1ad54681\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" Jul 24 17:28:10.230968 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:10.230892 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/20e6590f-5bb5-4797-9234-900b1ad54681-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-njznb\" (UID: \"20e6590f-5bb5-4797-9234-900b1ad54681\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" Jul 24 17:28:10.230968 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:10.230913 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/20e6590f-5bb5-4797-9234-900b1ad54681-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-njznb\" (UID: \"20e6590f-5bb5-4797-9234-900b1ad54681\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" Jul 24 17:28:10.231078 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:10.231034 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/20e6590f-5bb5-4797-9234-900b1ad54681-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-njznb\" (UID: \"20e6590f-5bb5-4797-9234-900b1ad54681\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" Jul 24 17:28:10.231134 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:10.231105 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/20e6590f-5bb5-4797-9234-900b1ad54681-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-njznb\" (UID: \"20e6590f-5bb5-4797-9234-900b1ad54681\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" Jul 24 17:28:10.231467 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:10.231447 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/20e6590f-5bb5-4797-9234-900b1ad54681-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-njznb\" (UID: \"20e6590f-5bb5-4797-9234-900b1ad54681\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" Jul 24 17:28:10.232956 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:10.232932 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/20e6590f-5bb5-4797-9234-900b1ad54681-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-njznb\" (UID: \"20e6590f-5bb5-4797-9234-900b1ad54681\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" Jul 24 17:28:10.233159 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:10.233141 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/20e6590f-5bb5-4797-9234-900b1ad54681-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-njznb\" (UID: \"20e6590f-5bb5-4797-9234-900b1ad54681\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" Jul 24 17:28:10.239254 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:10.239230 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/20e6590f-5bb5-4797-9234-900b1ad54681-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-njznb\" (UID: \"20e6590f-5bb5-4797-9234-900b1ad54681\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" Jul 24 17:28:10.239438 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:10.239422 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7slnt\" (UniqueName: \"kubernetes.io/projected/20e6590f-5bb5-4797-9234-900b1ad54681-kube-api-access-7slnt\") pod \"maas-default-gateway-openshift-default-5ccb968c66-njznb\" (UID: \"20e6590f-5bb5-4797-9234-900b1ad54681\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" Jul 24 17:28:10.324579 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:10.324515 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" Jul 24 17:28:10.462971 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:10.462947 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb"] Jul 24 17:28:10.464678 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:28:10.464653 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20e6590f_5bb5_4797_9234_900b1ad54681.slice/crio-db4987dd45dd818fc90c0f06715a4230d4f331b6ebf7ffbfba89535ee3497585 WatchSource:0}: Error finding container db4987dd45dd818fc90c0f06715a4230d4f331b6ebf7ffbfba89535ee3497585: Status 404 returned error can't find the container with id db4987dd45dd818fc90c0f06715a4230d4f331b6ebf7ffbfba89535ee3497585 Jul 24 17:28:10.466851 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:10.466818 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 24 17:28:10.466929 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:10.466881 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 24 17:28:10.466929 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:10.466912 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 24 17:28:11.316808 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:11.316775 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" event={"ID":"20e6590f-5bb5-4797-9234-900b1ad54681","Type":"ContainerStarted","Data":"1a61336f92e8de3c0476e20204e87172f92104171f602d131649bc5ad7397d38"} Jul 24 17:28:11.317164 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:11.316833 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" event={"ID":"20e6590f-5bb5-4797-9234-900b1ad54681","Type":"ContainerStarted","Data":"db4987dd45dd818fc90c0f06715a4230d4f331b6ebf7ffbfba89535ee3497585"} Jul 24 17:28:11.324844 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:11.324819 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" Jul 24 17:28:11.329246 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:11.329224 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" Jul 24 17:28:11.345347 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:11.345295 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" podStartSLOduration=2.345281698 podStartE2EDuration="2.345281698s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:28:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:28:11.340118615 +0000 UTC m=+487.008529638" watchObservedRunningTime="2026-07-24 17:28:11.345281698 +0000 UTC m=+487.013692799" Jul 24 17:28:12.321782 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:12.321743 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" Jul 24 17:28:12.322735 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:12.322717 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" Jul 24 17:28:28.426178 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:28.426138 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-n2tsl"] Jul 24 17:28:28.430457 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:28.430432 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n2tsl" Jul 24 17:28:28.434810 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:28.434778 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-zzl29\"" Jul 24 17:28:28.440817 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:28.440795 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n2tsl"] Jul 24 17:28:28.480086 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:28.480059 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hcw7\" (UniqueName: \"kubernetes.io/projected/a191c326-188d-43c3-989f-a1c7c9393685-kube-api-access-7hcw7\") pod \"authorino-75d556bd77-n2tsl\" (UID: \"a191c326-188d-43c3-989f-a1c7c9393685\") " pod="kuadrant-system/authorino-75d556bd77-n2tsl" Jul 24 17:28:28.581091 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:28.581064 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hcw7\" (UniqueName: \"kubernetes.io/projected/a191c326-188d-43c3-989f-a1c7c9393685-kube-api-access-7hcw7\") pod \"authorino-75d556bd77-n2tsl\" (UID: \"a191c326-188d-43c3-989f-a1c7c9393685\") " pod="kuadrant-system/authorino-75d556bd77-n2tsl" Jul 24 17:28:28.598028 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:28.597998 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hcw7\" (UniqueName: \"kubernetes.io/projected/a191c326-188d-43c3-989f-a1c7c9393685-kube-api-access-7hcw7\") pod \"authorino-75d556bd77-n2tsl\" (UID: \"a191c326-188d-43c3-989f-a1c7c9393685\") " pod="kuadrant-system/authorino-75d556bd77-n2tsl" Jul 24 17:28:28.741796 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:28.741731 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n2tsl" Jul 24 17:28:28.875591 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:28.875565 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n2tsl"] Jul 24 17:28:28.877545 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:28:28.877520 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda191c326_188d_43c3_989f_a1c7c9393685.slice/crio-70cb92285ecb18bfa6a203f4034f9379b99bc66023ca71f5aebad2f4f090125d WatchSource:0}: Error finding container 70cb92285ecb18bfa6a203f4034f9379b99bc66023ca71f5aebad2f4f090125d: Status 404 returned error can't find the container with id 70cb92285ecb18bfa6a203f4034f9379b99bc66023ca71f5aebad2f4f090125d Jul 24 17:28:29.413403 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:29.413365 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n2tsl" event={"ID":"a191c326-188d-43c3-989f-a1c7c9393685","Type":"ContainerStarted","Data":"70cb92285ecb18bfa6a203f4034f9379b99bc66023ca71f5aebad2f4f090125d"} Jul 24 17:28:32.433320 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:32.433282 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n2tsl" event={"ID":"a191c326-188d-43c3-989f-a1c7c9393685","Type":"ContainerStarted","Data":"186c7bbd5aebeada159d33897ea9c3155a7414f465e2ed842327b59f7ac03699"} Jul 24 17:28:32.449764 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:28:32.449697 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-n2tsl" podStartSLOduration=1.487535957 podStartE2EDuration="4.449667673s" totalImagesPullingTime="2.962131716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:28:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:28:32.449363864 +0000 UTC m=+508.117774885" watchObservedRunningTime="2026-07-24 17:28:32.449667673 +0000 UTC m=+508.118078699" Jul 24 17:29:03.186222 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:03.186144 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-84df4547cf-zprzj"] Jul 24 17:29:03.188580 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:03.188561 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84df4547cf-zprzj" Jul 24 17:29:03.192229 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:03.192209 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 24 17:29:03.199711 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:03.199685 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84df4547cf-zprzj"] Jul 24 17:29:03.255488 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:03.255462 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1c526419-bf2d-44b9-896c-212ec83df13a-tls-cert\") pod \"authorino-84df4547cf-zprzj\" (UID: \"1c526419-bf2d-44b9-896c-212ec83df13a\") " pod="kuadrant-system/authorino-84df4547cf-zprzj" Jul 24 17:29:03.255611 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:03.255555 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vn7k\" (UniqueName: \"kubernetes.io/projected/1c526419-bf2d-44b9-896c-212ec83df13a-kube-api-access-4vn7k\") pod \"authorino-84df4547cf-zprzj\" (UID: \"1c526419-bf2d-44b9-896c-212ec83df13a\") " pod="kuadrant-system/authorino-84df4547cf-zprzj" Jul 24 17:29:03.355869 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:03.355837 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vn7k\" (UniqueName: \"kubernetes.io/projected/1c526419-bf2d-44b9-896c-212ec83df13a-kube-api-access-4vn7k\") pod \"authorino-84df4547cf-zprzj\" (UID: \"1c526419-bf2d-44b9-896c-212ec83df13a\") " pod="kuadrant-system/authorino-84df4547cf-zprzj" Jul 24 17:29:03.356067 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:03.355887 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1c526419-bf2d-44b9-896c-212ec83df13a-tls-cert\") pod \"authorino-84df4547cf-zprzj\" (UID: \"1c526419-bf2d-44b9-896c-212ec83df13a\") " pod="kuadrant-system/authorino-84df4547cf-zprzj" Jul 24 17:29:03.358521 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:03.358500 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1c526419-bf2d-44b9-896c-212ec83df13a-tls-cert\") pod \"authorino-84df4547cf-zprzj\" (UID: \"1c526419-bf2d-44b9-896c-212ec83df13a\") " pod="kuadrant-system/authorino-84df4547cf-zprzj" Jul 24 17:29:03.365347 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:03.365313 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vn7k\" (UniqueName: \"kubernetes.io/projected/1c526419-bf2d-44b9-896c-212ec83df13a-kube-api-access-4vn7k\") pod \"authorino-84df4547cf-zprzj\" (UID: \"1c526419-bf2d-44b9-896c-212ec83df13a\") " pod="kuadrant-system/authorino-84df4547cf-zprzj" Jul 24 17:29:03.499658 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:03.499603 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84df4547cf-zprzj" Jul 24 17:29:03.665103 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:03.665081 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-84df4547cf-zprzj"] Jul 24 17:29:03.667322 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:29:03.667295 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1c526419_bf2d_44b9_896c_212ec83df13a.slice/crio-38abd66048c4acf4cce34ca72ef4e937292881bd767876597da45a56d81926f5 WatchSource:0}: Error finding container 38abd66048c4acf4cce34ca72ef4e937292881bd767876597da45a56d81926f5: Status 404 returned error can't find the container with id 38abd66048c4acf4cce34ca72ef4e937292881bd767876597da45a56d81926f5 Jul 24 17:29:04.619401 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:04.619363 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84df4547cf-zprzj" event={"ID":"1c526419-bf2d-44b9-896c-212ec83df13a","Type":"ContainerStarted","Data":"2384efae197445b515cddacf8bd91f705c4dbf23afe9791a6721083640ccd802"} Jul 24 17:29:04.619401 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:04.619410 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84df4547cf-zprzj" event={"ID":"1c526419-bf2d-44b9-896c-212ec83df13a","Type":"ContainerStarted","Data":"38abd66048c4acf4cce34ca72ef4e937292881bd767876597da45a56d81926f5"} Jul 24 17:29:04.638106 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:04.638046 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-84df4547cf-zprzj" podStartSLOduration=1.15577006 podStartE2EDuration="1.638034239s" totalImagesPullingTime="482.264179ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:29:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:29:04.636492853 +0000 UTC m=+540.304903877" watchObservedRunningTime="2026-07-24 17:29:04.638034239 +0000 UTC m=+540.306445263" Jul 24 17:29:04.667599 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:04.667570 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n2tsl"] Jul 24 17:29:04.667799 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:04.667752 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-n2tsl" podUID="a191c326-188d-43c3-989f-a1c7c9393685" containerName="authorino" containerID="cri-o://186c7bbd5aebeada159d33897ea9c3155a7414f465e2ed842327b59f7ac03699" gracePeriod=30 Jul 24 17:29:04.957031 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:04.957003 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n2tsl" Jul 24 17:29:04.968963 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:04.968944 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hcw7\" (UniqueName: \"kubernetes.io/projected/a191c326-188d-43c3-989f-a1c7c9393685-kube-api-access-7hcw7\") pod \"a191c326-188d-43c3-989f-a1c7c9393685\" (UID: \"a191c326-188d-43c3-989f-a1c7c9393685\") " Jul 24 17:29:04.971029 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:04.970983 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a191c326-188d-43c3-989f-a1c7c9393685-kube-api-access-7hcw7" (OuterVolumeSpecName: "kube-api-access-7hcw7") pod "a191c326-188d-43c3-989f-a1c7c9393685" (UID: "a191c326-188d-43c3-989f-a1c7c9393685"). InnerVolumeSpecName "kube-api-access-7hcw7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 17:29:05.070315 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:05.070287 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hcw7\" (UniqueName: \"kubernetes.io/projected/a191c326-188d-43c3-989f-a1c7c9393685-kube-api-access-7hcw7\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:29:05.626771 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:05.626735 2570 generic.go:356] "Generic (PLEG): container finished" podID="a191c326-188d-43c3-989f-a1c7c9393685" containerID="186c7bbd5aebeada159d33897ea9c3155a7414f465e2ed842327b59f7ac03699" exitCode=0 Jul 24 17:29:05.627223 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:05.626782 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-n2tsl" Jul 24 17:29:05.627223 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:05.626803 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n2tsl" event={"ID":"a191c326-188d-43c3-989f-a1c7c9393685","Type":"ContainerDied","Data":"186c7bbd5aebeada159d33897ea9c3155a7414f465e2ed842327b59f7ac03699"} Jul 24 17:29:05.627223 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:05.626852 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-n2tsl" event={"ID":"a191c326-188d-43c3-989f-a1c7c9393685","Type":"ContainerDied","Data":"70cb92285ecb18bfa6a203f4034f9379b99bc66023ca71f5aebad2f4f090125d"} Jul 24 17:29:05.627223 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:05.626880 2570 scope.go:117] "RemoveContainer" containerID="186c7bbd5aebeada159d33897ea9c3155a7414f465e2ed842327b59f7ac03699" Jul 24 17:29:05.636161 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:05.636146 2570 scope.go:117] "RemoveContainer" containerID="186c7bbd5aebeada159d33897ea9c3155a7414f465e2ed842327b59f7ac03699" Jul 24 17:29:05.636426 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:29:05.636408 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"186c7bbd5aebeada159d33897ea9c3155a7414f465e2ed842327b59f7ac03699\": container with ID starting with 186c7bbd5aebeada159d33897ea9c3155a7414f465e2ed842327b59f7ac03699 not found: ID does not exist" containerID="186c7bbd5aebeada159d33897ea9c3155a7414f465e2ed842327b59f7ac03699" Jul 24 17:29:05.636488 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:05.636435 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"186c7bbd5aebeada159d33897ea9c3155a7414f465e2ed842327b59f7ac03699"} err="failed to get container status \"186c7bbd5aebeada159d33897ea9c3155a7414f465e2ed842327b59f7ac03699\": rpc error: code = NotFound desc = could not find container \"186c7bbd5aebeada159d33897ea9c3155a7414f465e2ed842327b59f7ac03699\": container with ID starting with 186c7bbd5aebeada159d33897ea9c3155a7414f465e2ed842327b59f7ac03699 not found: ID does not exist" Jul 24 17:29:05.647699 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:05.647673 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n2tsl"] Jul 24 17:29:05.651644 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:05.651625 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-n2tsl"] Jul 24 17:29:06.913184 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:06.913141 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a191c326-188d-43c3-989f-a1c7c9393685" path="/var/lib/kubelet/pods/a191c326-188d-43c3-989f-a1c7c9393685/volumes" Jul 24 17:29:53.903848 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:53.903770 2570 generic.go:356] "Generic (PLEG): container finished" podID="20e6590f-5bb5-4797-9234-900b1ad54681" containerID="1a61336f92e8de3c0476e20204e87172f92104171f602d131649bc5ad7397d38" exitCode=0 Jul 24 17:29:53.903848 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:53.903806 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" event={"ID":"20e6590f-5bb5-4797-9234-900b1ad54681","Type":"ContainerDied","Data":"1a61336f92e8de3c0476e20204e87172f92104171f602d131649bc5ad7397d38"} Jul 24 17:29:53.904257 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:53.904181 2570 scope.go:117] "RemoveContainer" containerID="1a61336f92e8de3c0476e20204e87172f92104171f602d131649bc5ad7397d38" Jul 24 17:29:53.905276 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:53.905248 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 24 17:29:53.905392 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:53.905369 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 24 17:29:53.905438 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:53.905420 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 24 17:29:54.917932 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:54.917879 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" event={"ID":"20e6590f-5bb5-4797-9234-900b1ad54681","Type":"ContainerStarted","Data":"c353aa719e9237bf0255f9169df3970616c898ced4ba5fe78f3b630f0bd49192"} Jul 24 17:29:55.325623 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:55.325543 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" Jul 24 17:29:55.326587 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:55.326561 2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-njznb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Jul 24 17:29:55.326697 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:55.326613 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" podUID="20e6590f-5bb5-4797-9234-900b1ad54681" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Jul 24 17:29:56.324845 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:56.324809 2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-njznb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Jul 24 17:29:56.325234 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:56.324875 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" podUID="20e6590f-5bb5-4797-9234-900b1ad54681" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Jul 24 17:29:57.322521 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:57.322487 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" Jul 24 17:29:57.325228 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:57.325202 2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-njznb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Jul 24 17:29:57.325694 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:57.325255 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" podUID="20e6590f-5bb5-4797-9234-900b1ad54681" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Jul 24 17:29:58.325688 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:58.325647 2570 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-njznb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" start-of-body= Jul 24 17:29:58.326066 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:58.325703 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" podUID="20e6590f-5bb5-4797-9234-900b1ad54681" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.50:15021/healthz/ready\": dial tcp 10.134.0.50:15021: connect: connection refused" Jul 24 17:29:59.328280 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:59.328248 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" Jul 24 17:29:59.329226 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:29:59.329206 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-njznb" Jul 24 17:30:31.412521 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:30:31.412293 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2rl2q"] Jul 24 17:30:31.413238 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:30:31.412993 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a191c326-188d-43c3-989f-a1c7c9393685" containerName="authorino" Jul 24 17:30:31.413238 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:30:31.413011 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="a191c326-188d-43c3-989f-a1c7c9393685" containerName="authorino" Jul 24 17:30:31.413238 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:30:31.413084 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="a191c326-188d-43c3-989f-a1c7c9393685" containerName="authorino" Jul 24 17:30:31.415808 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:30:31.415791 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rl2q" Jul 24 17:30:31.419160 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:30:31.419143 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 24 17:30:31.420144 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:30:31.420126 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-8zm82\"" Jul 24 17:30:31.420229 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:30:31.420146 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 24 17:30:31.420229 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:30:31.420202 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 24 17:30:31.426255 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:30:31.426232 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2rl2q"] Jul 24 17:30:31.478287 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:30:31.478264 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20459e57-7eaf-4840-8cfb-8cbcf7cad816-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2rl2q\" (UID: \"20459e57-7eaf-4840-8cfb-8cbcf7cad816\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rl2q" Jul 24 17:30:31.478427 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:30:31.478295 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20459e57-7eaf-4840-8cfb-8cbcf7cad816-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2rl2q\" (UID: \"20459e57-7eaf-4840-8cfb-8cbcf7cad816\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rl2q" Jul 24 17:30:31.478427 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:30:31.478318 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20459e57-7eaf-4840-8cfb-8cbcf7cad816-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2rl2q\" (UID: \"20459e57-7eaf-4840-8cfb-8cbcf7cad816\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rl2q" Jul 24 17:30:31.478427 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:30:31.478421 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vvtp\" (UniqueName: \"kubernetes.io/projected/20459e57-7eaf-4840-8cfb-8cbcf7cad816-kube-api-access-4vvtp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2rl2q\" (UID: \"20459e57-7eaf-4840-8cfb-8cbcf7cad816\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rl2q" Jul 24 17:30:31.478539 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:30:31.478449 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20459e57-7eaf-4840-8cfb-8cbcf7cad816-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2rl2q\" (UID: \"20459e57-7eaf-4840-8cfb-8cbcf7cad816\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rl2q" Jul 24 17:30:31.478539 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:30:31.478472 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20459e57-7eaf-4840-8cfb-8cbcf7cad816-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2rl2q\" (UID: \"20459e57-7eaf-4840-8cfb-8cbcf7cad816\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rl2q" Jul 24 17:30:31.579543 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:30:31.579511 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20459e57-7eaf-4840-8cfb-8cbcf7cad816-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2rl2q\" (UID: \"20459e57-7eaf-4840-8cfb-8cbcf7cad816\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rl2q" Jul 24 17:30:31.579703 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:30:31.579553 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20459e57-7eaf-4840-8cfb-8cbcf7cad816-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2rl2q\" (UID: \"20459e57-7eaf-4840-8cfb-8cbcf7cad816\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rl2q" Jul 24 17:30:31.579703 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:30:31.579573 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20459e57-7eaf-4840-8cfb-8cbcf7cad816-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2rl2q\" (UID: \"20459e57-7eaf-4840-8cfb-8cbcf7cad816\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rl2q" Jul 24 17:30:31.579703 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:30:31.579593 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20459e57-7eaf-4840-8cfb-8cbcf7cad816-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2rl2q\" (UID: \"20459e57-7eaf-4840-8cfb-8cbcf7cad816\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rl2q" Jul 24 17:30:31.579703 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:30:31.579643 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vvtp\" (UniqueName: \"kubernetes.io/projected/20459e57-7eaf-4840-8cfb-8cbcf7cad816-kube-api-access-4vvtp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2rl2q\" (UID: \"20459e57-7eaf-4840-8cfb-8cbcf7cad816\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rl2q" Jul 24 17:30:31.579703 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:30:31.579683 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20459e57-7eaf-4840-8cfb-8cbcf7cad816-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2rl2q\" (UID: \"20459e57-7eaf-4840-8cfb-8cbcf7cad816\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rl2q" Jul 24 17:30:31.579975 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:30:31.579920 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/20459e57-7eaf-4840-8cfb-8cbcf7cad816-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2rl2q\" (UID: \"20459e57-7eaf-4840-8cfb-8cbcf7cad816\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rl2q" Jul 24 17:30:31.580018 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:30:31.579988 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/20459e57-7eaf-4840-8cfb-8cbcf7cad816-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2rl2q\" (UID: \"20459e57-7eaf-4840-8cfb-8cbcf7cad816\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rl2q" Jul 24 17:30:31.580068 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:30:31.580050 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/20459e57-7eaf-4840-8cfb-8cbcf7cad816-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2rl2q\" (UID: \"20459e57-7eaf-4840-8cfb-8cbcf7cad816\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rl2q" Jul 24 17:30:31.581963 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:30:31.581941 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/20459e57-7eaf-4840-8cfb-8cbcf7cad816-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2rl2q\" (UID: \"20459e57-7eaf-4840-8cfb-8cbcf7cad816\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rl2q" Jul 24 17:30:31.582374 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:30:31.582355 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/20459e57-7eaf-4840-8cfb-8cbcf7cad816-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2rl2q\" (UID: \"20459e57-7eaf-4840-8cfb-8cbcf7cad816\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rl2q" Jul 24 17:30:31.589047 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:30:31.589016 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vvtp\" (UniqueName: \"kubernetes.io/projected/20459e57-7eaf-4840-8cfb-8cbcf7cad816-kube-api-access-4vvtp\") pod \"e2e-trlp-test-simulated-kserve-598466548d-2rl2q\" (UID: \"20459e57-7eaf-4840-8cfb-8cbcf7cad816\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rl2q" Jul 24 17:30:31.728318 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:30:31.728233 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rl2q" Jul 24 17:30:31.881509 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:30:31.881480 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-2rl2q"] Jul 24 17:30:31.882453 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:30:31.882428 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20459e57_7eaf_4840_8cfb_8cbcf7cad816.slice/crio-bf2fecb622c8e1c8df9ba9b0870e1b8bf1afe53b130e82f34dd3439e50361f51 WatchSource:0}: Error finding container bf2fecb622c8e1c8df9ba9b0870e1b8bf1afe53b130e82f34dd3439e50361f51: Status 404 returned error can't find the container with id bf2fecb622c8e1c8df9ba9b0870e1b8bf1afe53b130e82f34dd3439e50361f51 Jul 24 17:30:31.883851 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:30:31.883828 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 17:30:32.115627 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:30:32.115598 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rl2q" event={"ID":"20459e57-7eaf-4840-8cfb-8cbcf7cad816","Type":"ContainerStarted","Data":"bf2fecb622c8e1c8df9ba9b0870e1b8bf1afe53b130e82f34dd3439e50361f51"} Jul 24 17:30:34.128653 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:30:34.128621 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rl2q" event={"ID":"20459e57-7eaf-4840-8cfb-8cbcf7cad816","Type":"ContainerStarted","Data":"3bd319453154a34007e8d2dc57d57e61620a3e00eccc4746033c84f3c7638455"} Jul 24 17:30:34.148881 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:30:34.148831 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rl2q" podStartSLOduration=1.9565379630000002 podStartE2EDuration="3.148816592s" totalImagesPullingTime="1.192278629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:30:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:30:34.146834998 +0000 UTC m=+629.815246024" watchObservedRunningTime="2026-07-24 17:30:34.148816592 +0000 UTC m=+629.817227594" Jul 24 17:30:41.728490 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:30:41.728459 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rl2q" Jul 24 17:30:41.728971 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:30:41.728517 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rl2q" Jul 24 17:30:41.740764 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:30:41.740743 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rl2q" Jul 24 17:30:42.185423 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:30:42.185399 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-2rl2q" Jul 24 17:31:45.366182 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:31:45.366145 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f94cdf55d-56qb5"] Jul 24 17:31:45.369814 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:31:45.369794 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f94cdf55d-56qb5" Jul 24 17:31:45.377598 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:31:45.377572 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f94cdf55d-56qb5"] Jul 24 17:31:45.501480 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:31:45.501445 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/19523d3e-9cdb-422d-8c4f-dadaba56bd70-tls-cert\") pod \"authorino-f94cdf55d-56qb5\" (UID: \"19523d3e-9cdb-422d-8c4f-dadaba56bd70\") " pod="kuadrant-system/authorino-f94cdf55d-56qb5" Jul 24 17:31:45.501631 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:31:45.501516 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vwj6\" (UniqueName: \"kubernetes.io/projected/19523d3e-9cdb-422d-8c4f-dadaba56bd70-kube-api-access-4vwj6\") pod \"authorino-f94cdf55d-56qb5\" (UID: \"19523d3e-9cdb-422d-8c4f-dadaba56bd70\") " pod="kuadrant-system/authorino-f94cdf55d-56qb5" Jul 24 17:31:45.602626 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:31:45.602596 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/19523d3e-9cdb-422d-8c4f-dadaba56bd70-tls-cert\") pod \"authorino-f94cdf55d-56qb5\" (UID: \"19523d3e-9cdb-422d-8c4f-dadaba56bd70\") " pod="kuadrant-system/authorino-f94cdf55d-56qb5" Jul 24 17:31:45.602771 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:31:45.602654 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vwj6\" (UniqueName: \"kubernetes.io/projected/19523d3e-9cdb-422d-8c4f-dadaba56bd70-kube-api-access-4vwj6\") pod \"authorino-f94cdf55d-56qb5\" (UID: \"19523d3e-9cdb-422d-8c4f-dadaba56bd70\") " pod="kuadrant-system/authorino-f94cdf55d-56qb5" Jul 24 17:31:45.605192 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:31:45.605170 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/19523d3e-9cdb-422d-8c4f-dadaba56bd70-tls-cert\") pod \"authorino-f94cdf55d-56qb5\" (UID: \"19523d3e-9cdb-422d-8c4f-dadaba56bd70\") " pod="kuadrant-system/authorino-f94cdf55d-56qb5" Jul 24 17:31:45.611118 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:31:45.611093 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vwj6\" (UniqueName: \"kubernetes.io/projected/19523d3e-9cdb-422d-8c4f-dadaba56bd70-kube-api-access-4vwj6\") pod \"authorino-f94cdf55d-56qb5\" (UID: \"19523d3e-9cdb-422d-8c4f-dadaba56bd70\") " pod="kuadrant-system/authorino-f94cdf55d-56qb5" Jul 24 17:31:45.680183 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:31:45.680115 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f94cdf55d-56qb5" Jul 24 17:31:45.827697 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:31:45.827668 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f94cdf55d-56qb5"] Jul 24 17:31:45.831408 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:31:45.831380 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod19523d3e_9cdb_422d_8c4f_dadaba56bd70.slice/crio-33600de761308dbacffaa2cd1d1c378a4faf0cece678f283740f4b3263033c53 WatchSource:0}: Error finding container 33600de761308dbacffaa2cd1d1c378a4faf0cece678f283740f4b3263033c53: Status 404 returned error can't find the container with id 33600de761308dbacffaa2cd1d1c378a4faf0cece678f283740f4b3263033c53 Jul 24 17:31:46.527102 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:31:46.527058 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f94cdf55d-56qb5" event={"ID":"19523d3e-9cdb-422d-8c4f-dadaba56bd70","Type":"ContainerStarted","Data":"ea1cf5f6129c4c7401c52af548591ef9f2b6025fb6c8851a35e00e020d80aa65"} Jul 24 17:31:46.527618 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:31:46.527112 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-f94cdf55d-56qb5" event={"ID":"19523d3e-9cdb-422d-8c4f-dadaba56bd70","Type":"ContainerStarted","Data":"33600de761308dbacffaa2cd1d1c378a4faf0cece678f283740f4b3263033c53"} Jul 24 17:31:46.552122 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:31:46.552060 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-f94cdf55d-56qb5" podStartSLOduration=1.04063197 podStartE2EDuration="1.552039843s" totalImagesPullingTime="511.407873ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:31:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:31:46.549446291 +0000 UTC m=+702.217857316" watchObservedRunningTime="2026-07-24 17:31:46.552039843 +0000 UTC m=+702.220450868" Jul 24 17:31:46.592479 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:31:46.592445 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-84df4547cf-zprzj"] Jul 24 17:31:46.593646 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:31:46.593565 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-84df4547cf-zprzj" podUID="1c526419-bf2d-44b9-896c-212ec83df13a" containerName="authorino" containerID="cri-o://2384efae197445b515cddacf8bd91f705c4dbf23afe9791a6721083640ccd802" gracePeriod=30 Jul 24 17:31:46.864749 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:31:46.864723 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84df4547cf-zprzj" Jul 24 17:31:47.016642 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:31:47.016602 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1c526419-bf2d-44b9-896c-212ec83df13a-tls-cert\") pod \"1c526419-bf2d-44b9-896c-212ec83df13a\" (UID: \"1c526419-bf2d-44b9-896c-212ec83df13a\") " Jul 24 17:31:47.016854 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:31:47.016685 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4vn7k\" (UniqueName: \"kubernetes.io/projected/1c526419-bf2d-44b9-896c-212ec83df13a-kube-api-access-4vn7k\") pod \"1c526419-bf2d-44b9-896c-212ec83df13a\" (UID: \"1c526419-bf2d-44b9-896c-212ec83df13a\") " Jul 24 17:31:47.019278 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:31:47.019250 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1c526419-bf2d-44b9-896c-212ec83df13a-kube-api-access-4vn7k" (OuterVolumeSpecName: "kube-api-access-4vn7k") pod "1c526419-bf2d-44b9-896c-212ec83df13a" (UID: "1c526419-bf2d-44b9-896c-212ec83df13a"). InnerVolumeSpecName "kube-api-access-4vn7k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 17:31:47.027949 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:31:47.027922 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1c526419-bf2d-44b9-896c-212ec83df13a-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "1c526419-bf2d-44b9-896c-212ec83df13a" (UID: "1c526419-bf2d-44b9-896c-212ec83df13a"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 17:31:47.117930 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:31:47.117846 2570 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1c526419-bf2d-44b9-896c-212ec83df13a-tls-cert\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:31:47.117930 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:31:47.117877 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4vn7k\" (UniqueName: \"kubernetes.io/projected/1c526419-bf2d-44b9-896c-212ec83df13a-kube-api-access-4vn7k\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:31:47.533686 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:31:47.533604 2570 generic.go:356] "Generic (PLEG): container finished" podID="1c526419-bf2d-44b9-896c-212ec83df13a" containerID="2384efae197445b515cddacf8bd91f705c4dbf23afe9791a6721083640ccd802" exitCode=0 Jul 24 17:31:47.533686 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:31:47.533647 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-84df4547cf-zprzj" Jul 24 17:31:47.534220 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:31:47.533681 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84df4547cf-zprzj" event={"ID":"1c526419-bf2d-44b9-896c-212ec83df13a","Type":"ContainerDied","Data":"2384efae197445b515cddacf8bd91f705c4dbf23afe9791a6721083640ccd802"} Jul 24 17:31:47.534220 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:31:47.533720 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-84df4547cf-zprzj" event={"ID":"1c526419-bf2d-44b9-896c-212ec83df13a","Type":"ContainerDied","Data":"38abd66048c4acf4cce34ca72ef4e937292881bd767876597da45a56d81926f5"} Jul 24 17:31:47.534220 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:31:47.533740 2570 scope.go:117] "RemoveContainer" containerID="2384efae197445b515cddacf8bd91f705c4dbf23afe9791a6721083640ccd802" Jul 24 17:31:47.544004 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:31:47.543987 2570 scope.go:117] "RemoveContainer" containerID="2384efae197445b515cddacf8bd91f705c4dbf23afe9791a6721083640ccd802" Jul 24 17:31:47.544244 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:31:47.544226 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2384efae197445b515cddacf8bd91f705c4dbf23afe9791a6721083640ccd802\": container with ID starting with 2384efae197445b515cddacf8bd91f705c4dbf23afe9791a6721083640ccd802 not found: ID does not exist" containerID="2384efae197445b515cddacf8bd91f705c4dbf23afe9791a6721083640ccd802" Jul 24 17:31:47.544317 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:31:47.544250 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2384efae197445b515cddacf8bd91f705c4dbf23afe9791a6721083640ccd802"} err="failed to get container status \"2384efae197445b515cddacf8bd91f705c4dbf23afe9791a6721083640ccd802\": rpc error: code = NotFound desc = could not find container \"2384efae197445b515cddacf8bd91f705c4dbf23afe9791a6721083640ccd802\": container with ID starting with 2384efae197445b515cddacf8bd91f705c4dbf23afe9791a6721083640ccd802 not found: ID does not exist" Jul 24 17:31:47.561187 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:31:47.561160 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-84df4547cf-zprzj"] Jul 24 17:31:47.565582 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:31:47.565561 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-84df4547cf-zprzj"] Jul 24 17:31:48.913415 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:31:48.913384 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1c526419-bf2d-44b9-896c-212ec83df13a" path="/var/lib/kubelet/pods/1c526419-bf2d-44b9-896c-212ec83df13a/volumes" Jul 24 17:38:34.834285 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:38:34.834242 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdlb8"] Jul 24 17:38:34.834826 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:38:34.834562 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdlb8" podUID="b2e00c82-3d10-495e-8613-5f6294dd8b23" containerName="manager" containerID="cri-o://350bcde8eaca35257a5d4b733059a12f507b076252a76c4910db03cb5693a671" gracePeriod=10 Jul 24 17:38:37.504809 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:38:37.504756 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdlb8" Jul 24 17:38:37.694788 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:38:37.694756 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2e00c82-3d10-495e-8613-5f6294dd8b23-extensions-socket-volume\") pod \"b2e00c82-3d10-495e-8613-5f6294dd8b23\" (UID: \"b2e00c82-3d10-495e-8613-5f6294dd8b23\") " Jul 24 17:38:37.694788 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:38:37.694795 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwwm4\" (UniqueName: \"kubernetes.io/projected/b2e00c82-3d10-495e-8613-5f6294dd8b23-kube-api-access-kwwm4\") pod \"b2e00c82-3d10-495e-8613-5f6294dd8b23\" (UID: \"b2e00c82-3d10-495e-8613-5f6294dd8b23\") " Jul 24 17:38:37.695120 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:38:37.695099 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2e00c82-3d10-495e-8613-5f6294dd8b23-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "b2e00c82-3d10-495e-8613-5f6294dd8b23" (UID: "b2e00c82-3d10-495e-8613-5f6294dd8b23"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 17:38:37.697093 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:38:37.697071 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2e00c82-3d10-495e-8613-5f6294dd8b23-kube-api-access-kwwm4" (OuterVolumeSpecName: "kube-api-access-kwwm4") pod "b2e00c82-3d10-495e-8613-5f6294dd8b23" (UID: "b2e00c82-3d10-495e-8613-5f6294dd8b23"). InnerVolumeSpecName "kube-api-access-kwwm4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 17:38:37.775783 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:38:37.775705 2570 generic.go:356] "Generic (PLEG): container finished" podID="b2e00c82-3d10-495e-8613-5f6294dd8b23" containerID="350bcde8eaca35257a5d4b733059a12f507b076252a76c4910db03cb5693a671" exitCode=0 Jul 24 17:38:37.775783 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:38:37.775756 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdlb8" Jul 24 17:38:37.775783 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:38:37.775773 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdlb8" event={"ID":"b2e00c82-3d10-495e-8613-5f6294dd8b23","Type":"ContainerDied","Data":"350bcde8eaca35257a5d4b733059a12f507b076252a76c4910db03cb5693a671"} Jul 24 17:38:37.776003 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:38:37.775817 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdlb8" event={"ID":"b2e00c82-3d10-495e-8613-5f6294dd8b23","Type":"ContainerDied","Data":"7b08393eef8ca9d67bb54cfae79c7cef24c44adb7b3aa80daf83016b82c7e89e"} Jul 24 17:38:37.776003 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:38:37.775839 2570 scope.go:117] "RemoveContainer" containerID="350bcde8eaca35257a5d4b733059a12f507b076252a76c4910db03cb5693a671" Jul 24 17:38:37.786713 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:38:37.786692 2570 scope.go:117] "RemoveContainer" containerID="350bcde8eaca35257a5d4b733059a12f507b076252a76c4910db03cb5693a671" Jul 24 17:38:37.787004 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:38:37.786982 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"350bcde8eaca35257a5d4b733059a12f507b076252a76c4910db03cb5693a671\": container with ID starting with 350bcde8eaca35257a5d4b733059a12f507b076252a76c4910db03cb5693a671 not found: ID does not exist" containerID="350bcde8eaca35257a5d4b733059a12f507b076252a76c4910db03cb5693a671" Jul 24 17:38:37.787082 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:38:37.787018 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"350bcde8eaca35257a5d4b733059a12f507b076252a76c4910db03cb5693a671"} err="failed to get container status \"350bcde8eaca35257a5d4b733059a12f507b076252a76c4910db03cb5693a671\": rpc error: code = NotFound desc = could not find container \"350bcde8eaca35257a5d4b733059a12f507b076252a76c4910db03cb5693a671\": container with ID starting with 350bcde8eaca35257a5d4b733059a12f507b076252a76c4910db03cb5693a671 not found: ID does not exist" Jul 24 17:38:37.795573 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:38:37.795552 2570 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/b2e00c82-3d10-495e-8613-5f6294dd8b23-extensions-socket-volume\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:38:37.795694 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:38:37.795577 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwwm4\" (UniqueName: \"kubernetes.io/projected/b2e00c82-3d10-495e-8613-5f6294dd8b23-kube-api-access-kwwm4\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:38:37.798077 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:38:37.798053 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdlb8"] Jul 24 17:38:37.801437 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:38:37.801417 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-qdlb8"] Jul 24 17:38:38.914115 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:38:38.914070 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2e00c82-3d10-495e-8613-5f6294dd8b23" path="/var/lib/kubelet/pods/b2e00c82-3d10-495e-8613-5f6294dd8b23/volumes" Jul 24 17:39:35.989201 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:39:35.989168 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnk9j"] Jul 24 17:39:35.989667 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:39:35.989566 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1c526419-bf2d-44b9-896c-212ec83df13a" containerName="authorino" Jul 24 17:39:35.989667 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:39:35.989579 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1c526419-bf2d-44b9-896c-212ec83df13a" containerName="authorino" Jul 24 17:39:35.989667 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:39:35.989591 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2e00c82-3d10-495e-8613-5f6294dd8b23" containerName="manager" Jul 24 17:39:35.989667 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:39:35.989596 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2e00c82-3d10-495e-8613-5f6294dd8b23" containerName="manager" Jul 24 17:39:35.989667 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:39:35.989660 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2e00c82-3d10-495e-8613-5f6294dd8b23" containerName="manager" Jul 24 17:39:35.989828 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:39:35.989672 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1c526419-bf2d-44b9-896c-212ec83df13a" containerName="authorino" Jul 24 17:39:35.992600 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:39:35.992585 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnk9j" Jul 24 17:39:35.996633 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:39:35.996613 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-24mcz\"" Jul 24 17:39:36.005803 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:39:36.005781 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnk9j"] Jul 24 17:39:36.173952 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:39:36.173921 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e34ed7ba-d9d0-49c0-9e37-6cf4022074f6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vnk9j\" (UID: \"e34ed7ba-d9d0-49c0-9e37-6cf4022074f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnk9j" Jul 24 17:39:36.173952 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:39:36.173956 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcfdk\" (UniqueName: \"kubernetes.io/projected/e34ed7ba-d9d0-49c0-9e37-6cf4022074f6-kube-api-access-lcfdk\") pod \"kuadrant-operator-controller-manager-86878c769f-vnk9j\" (UID: \"e34ed7ba-d9d0-49c0-9e37-6cf4022074f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnk9j" Jul 24 17:39:36.275293 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:39:36.275223 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e34ed7ba-d9d0-49c0-9e37-6cf4022074f6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vnk9j\" (UID: \"e34ed7ba-d9d0-49c0-9e37-6cf4022074f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnk9j" Jul 24 17:39:36.275293 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:39:36.275251 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcfdk\" (UniqueName: \"kubernetes.io/projected/e34ed7ba-d9d0-49c0-9e37-6cf4022074f6-kube-api-access-lcfdk\") pod \"kuadrant-operator-controller-manager-86878c769f-vnk9j\" (UID: \"e34ed7ba-d9d0-49c0-9e37-6cf4022074f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnk9j" Jul 24 17:39:36.275609 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:39:36.275590 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e34ed7ba-d9d0-49c0-9e37-6cf4022074f6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vnk9j\" (UID: \"e34ed7ba-d9d0-49c0-9e37-6cf4022074f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnk9j" Jul 24 17:39:36.288940 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:39:36.288911 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcfdk\" (UniqueName: \"kubernetes.io/projected/e34ed7ba-d9d0-49c0-9e37-6cf4022074f6-kube-api-access-lcfdk\") pod \"kuadrant-operator-controller-manager-86878c769f-vnk9j\" (UID: \"e34ed7ba-d9d0-49c0-9e37-6cf4022074f6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnk9j" Jul 24 17:39:36.302817 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:39:36.302800 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnk9j" Jul 24 17:39:36.443646 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:39:36.443619 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnk9j"] Jul 24 17:39:36.447430 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:39:36.447392 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode34ed7ba_d9d0_49c0_9e37_6cf4022074f6.slice/crio-88d52fbf6340d4bfd61501d158fa3d8d33f311926f839cc4d3fef579e3043bc8 WatchSource:0}: Error finding container 88d52fbf6340d4bfd61501d158fa3d8d33f311926f839cc4d3fef579e3043bc8: Status 404 returned error can't find the container with id 88d52fbf6340d4bfd61501d158fa3d8d33f311926f839cc4d3fef579e3043bc8 Jul 24 17:39:37.096652 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:39:37.096620 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnk9j" event={"ID":"e34ed7ba-d9d0-49c0-9e37-6cf4022074f6","Type":"ContainerStarted","Data":"27cbdfe287fabfb2d315bb91c33292222fe0c409b985351e6214c1d39d9727f4"} Jul 24 17:39:37.097073 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:39:37.096686 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnk9j" event={"ID":"e34ed7ba-d9d0-49c0-9e37-6cf4022074f6","Type":"ContainerStarted","Data":"88d52fbf6340d4bfd61501d158fa3d8d33f311926f839cc4d3fef579e3043bc8"} Jul 24 17:39:37.097073 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:39:37.096857 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnk9j" Jul 24 17:39:37.131692 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:39:37.131653 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnk9j" podStartSLOduration=2.131640627 podStartE2EDuration="2.131640627s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:39:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:39:37.129539602 +0000 UTC m=+1172.797950638" watchObservedRunningTime="2026-07-24 17:39:37.131640627 +0000 UTC m=+1172.800051650" Jul 24 17:39:48.104115 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:39:48.104078 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vnk9j" Jul 24 17:45:00.148341 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:45:00.148297 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748585-qrrq5"] Jul 24 17:45:00.151981 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:45:00.151958 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748585-qrrq5" Jul 24 17:45:00.154785 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:45:00.154765 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-dxd7g\"" Jul 24 17:45:00.161066 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:45:00.161051 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748585-qrrq5" Jul 24 17:45:00.175484 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:45:00.175461 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748585-qrrq5"] Jul 24 17:45:00.303835 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:45:00.303805 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29748585-qrrq5"] Jul 24 17:45:00.305783 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:45:00.305758 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bd6f082_4cb7_4fe2_9ce1_50b3f2dc879a.slice/crio-170833d03984899eb3134baa3b1fc0cc07cbea338525f7abbf9f2e88c389e634 WatchSource:0}: Error finding container 170833d03984899eb3134baa3b1fc0cc07cbea338525f7abbf9f2e88c389e634: Status 404 returned error can't find the container with id 170833d03984899eb3134baa3b1fc0cc07cbea338525f7abbf9f2e88c389e634 Jul 24 17:45:00.307614 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:45:00.307598 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 17:45:00.843687 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:45:00.843650 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748585-qrrq5" event={"ID":"9bd6f082-4cb7-4fe2-9ce1-50b3f2dc879a","Type":"ContainerStarted","Data":"170833d03984899eb3134baa3b1fc0cc07cbea338525f7abbf9f2e88c389e634"} Jul 24 17:45:03.865631 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:45:03.865603 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748585-qrrq5" event={"ID":"9bd6f082-4cb7-4fe2-9ce1-50b3f2dc879a","Type":"ContainerStarted","Data":"8c6b3b7cdfa44513e103d9950c5ceb88204f3157cf5f48fce3bc97cd09821bfb"} Jul 24 17:45:03.882412 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:45:03.882359 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748585-qrrq5" podStartSLOduration=0.677583066 podStartE2EDuration="3.88232022s" totalImagesPullingTime="3.204737154s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:45:03.880921093 +0000 UTC m=+1499.549332108" watchObservedRunningTime="2026-07-24 17:45:03.88232022 +0000 UTC m=+1499.550731292" Jul 24 17:45:04.872868 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:45:04.872837 2570 generic.go:356] "Generic (PLEG): container finished" podID="9bd6f082-4cb7-4fe2-9ce1-50b3f2dc879a" containerID="8c6b3b7cdfa44513e103d9950c5ceb88204f3157cf5f48fce3bc97cd09821bfb" exitCode=0 Jul 24 17:45:04.873300 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:45:04.872895 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748585-qrrq5" event={"ID":"9bd6f082-4cb7-4fe2-9ce1-50b3f2dc879a","Type":"ContainerDied","Data":"8c6b3b7cdfa44513e103d9950c5ceb88204f3157cf5f48fce3bc97cd09821bfb"} Jul 24 17:45:06.020030 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:45:06.020008 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748585-qrrq5" Jul 24 17:45:06.884449 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:45:06.884423 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748585-qrrq5" Jul 24 17:45:06.884631 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:45:06.884422 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29748585-qrrq5" event={"ID":"9bd6f082-4cb7-4fe2-9ce1-50b3f2dc879a","Type":"ContainerDied","Data":"170833d03984899eb3134baa3b1fc0cc07cbea338525f7abbf9f2e88c389e634"} Jul 24 17:45:06.884631 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:45:06.884549 2570 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="170833d03984899eb3134baa3b1fc0cc07cbea338525f7abbf9f2e88c389e634" Jul 24 17:46:43.173828 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:43.173798 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt"] Jul 24 17:46:43.176386 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:43.174179 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bd6f082-4cb7-4fe2-9ce1-50b3f2dc879a" containerName="cleanup" Jul 24 17:46:43.176386 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:43.174190 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bd6f082-4cb7-4fe2-9ce1-50b3f2dc879a" containerName="cleanup" Jul 24 17:46:43.176386 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:43.174268 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bd6f082-4cb7-4fe2-9ce1-50b3f2dc879a" containerName="cleanup" Jul 24 17:46:43.177479 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:43.177459 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" Jul 24 17:46:43.180554 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:43.180535 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-3102a353-openshift-default-dockercfg-pkxgx\"" Jul 24 17:46:43.199623 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:43.199601 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt"] Jul 24 17:46:43.278731 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:43.278696 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvvr8\" (UniqueName: \"kubernetes.io/projected/ca2239ef-8fd0-4abf-b875-4508f575144a-kube-api-access-zvvr8\") pod \"e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt\" (UID: \"ca2239ef-8fd0-4abf-b875-4508f575144a\") " pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" Jul 24 17:46:43.279046 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:43.278768 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca2239ef-8fd0-4abf-b875-4508f575144a-istio-token\") pod \"e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt\" (UID: \"ca2239ef-8fd0-4abf-b875-4508f575144a\") " pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" Jul 24 17:46:43.279046 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:43.278940 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca2239ef-8fd0-4abf-b875-4508f575144a-workload-certs\") pod \"e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt\" (UID: \"ca2239ef-8fd0-4abf-b875-4508f575144a\") " pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" Jul 24 17:46:43.279046 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:43.278984 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca2239ef-8fd0-4abf-b875-4508f575144a-istio-podinfo\") pod \"e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt\" (UID: \"ca2239ef-8fd0-4abf-b875-4508f575144a\") " pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" Jul 24 17:46:43.279046 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:43.279011 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca2239ef-8fd0-4abf-b875-4508f575144a-istio-envoy\") pod \"e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt\" (UID: \"ca2239ef-8fd0-4abf-b875-4508f575144a\") " pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" Jul 24 17:46:43.279046 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:43.279032 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca2239ef-8fd0-4abf-b875-4508f575144a-istiod-ca-cert\") pod \"e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt\" (UID: \"ca2239ef-8fd0-4abf-b875-4508f575144a\") " pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" Jul 24 17:46:43.279443 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:43.279091 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca2239ef-8fd0-4abf-b875-4508f575144a-istio-data\") pod \"e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt\" (UID: \"ca2239ef-8fd0-4abf-b875-4508f575144a\") " pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" Jul 24 17:46:43.279443 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:43.279134 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca2239ef-8fd0-4abf-b875-4508f575144a-workload-socket\") pod \"e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt\" (UID: \"ca2239ef-8fd0-4abf-b875-4508f575144a\") " pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" Jul 24 17:46:43.279443 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:43.279158 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca2239ef-8fd0-4abf-b875-4508f575144a-credential-socket\") pod \"e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt\" (UID: \"ca2239ef-8fd0-4abf-b875-4508f575144a\") " pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" Jul 24 17:46:43.379641 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:43.379615 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca2239ef-8fd0-4abf-b875-4508f575144a-istio-token\") pod \"e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt\" (UID: \"ca2239ef-8fd0-4abf-b875-4508f575144a\") " pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" Jul 24 17:46:43.379795 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:43.379664 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca2239ef-8fd0-4abf-b875-4508f575144a-workload-certs\") pod \"e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt\" (UID: \"ca2239ef-8fd0-4abf-b875-4508f575144a\") " pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" Jul 24 17:46:43.379795 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:43.379687 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca2239ef-8fd0-4abf-b875-4508f575144a-istio-podinfo\") pod \"e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt\" (UID: \"ca2239ef-8fd0-4abf-b875-4508f575144a\") " pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" Jul 24 17:46:43.379795 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:43.379705 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca2239ef-8fd0-4abf-b875-4508f575144a-istio-envoy\") pod \"e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt\" (UID: \"ca2239ef-8fd0-4abf-b875-4508f575144a\") " pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" Jul 24 17:46:43.379795 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:43.379720 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca2239ef-8fd0-4abf-b875-4508f575144a-istiod-ca-cert\") pod \"e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt\" (UID: \"ca2239ef-8fd0-4abf-b875-4508f575144a\") " pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" Jul 24 17:46:43.379795 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:43.379739 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca2239ef-8fd0-4abf-b875-4508f575144a-istio-data\") pod \"e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt\" (UID: \"ca2239ef-8fd0-4abf-b875-4508f575144a\") " pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" Jul 24 17:46:43.379795 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:43.379771 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca2239ef-8fd0-4abf-b875-4508f575144a-workload-socket\") pod \"e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt\" (UID: \"ca2239ef-8fd0-4abf-b875-4508f575144a\") " pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" Jul 24 17:46:43.379795 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:43.379794 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca2239ef-8fd0-4abf-b875-4508f575144a-credential-socket\") pod \"e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt\" (UID: \"ca2239ef-8fd0-4abf-b875-4508f575144a\") " pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" Jul 24 17:46:43.380171 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:43.379849 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvvr8\" (UniqueName: \"kubernetes.io/projected/ca2239ef-8fd0-4abf-b875-4508f575144a-kube-api-access-zvvr8\") pod \"e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt\" (UID: \"ca2239ef-8fd0-4abf-b875-4508f575144a\") " pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" Jul 24 17:46:43.380227 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:43.380180 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca2239ef-8fd0-4abf-b875-4508f575144a-workload-certs\") pod \"e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt\" (UID: \"ca2239ef-8fd0-4abf-b875-4508f575144a\") " pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" Jul 24 17:46:43.380227 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:43.380209 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca2239ef-8fd0-4abf-b875-4508f575144a-istio-data\") pod \"e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt\" (UID: \"ca2239ef-8fd0-4abf-b875-4508f575144a\") " pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" Jul 24 17:46:43.380324 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:43.380247 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca2239ef-8fd0-4abf-b875-4508f575144a-workload-socket\") pod \"e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt\" (UID: \"ca2239ef-8fd0-4abf-b875-4508f575144a\") " pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" Jul 24 17:46:43.380324 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:43.380313 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca2239ef-8fd0-4abf-b875-4508f575144a-credential-socket\") pod \"e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt\" (UID: \"ca2239ef-8fd0-4abf-b875-4508f575144a\") " pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" Jul 24 17:46:43.380625 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:43.380557 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca2239ef-8fd0-4abf-b875-4508f575144a-istiod-ca-cert\") pod \"e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt\" (UID: \"ca2239ef-8fd0-4abf-b875-4508f575144a\") " pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" Jul 24 17:46:43.382171 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:43.382151 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca2239ef-8fd0-4abf-b875-4508f575144a-istio-envoy\") pod \"e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt\" (UID: \"ca2239ef-8fd0-4abf-b875-4508f575144a\") " pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" Jul 24 17:46:43.382397 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:43.382380 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca2239ef-8fd0-4abf-b875-4508f575144a-istio-podinfo\") pod \"e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt\" (UID: \"ca2239ef-8fd0-4abf-b875-4508f575144a\") " pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" Jul 24 17:46:43.388629 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:43.388610 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca2239ef-8fd0-4abf-b875-4508f575144a-istio-token\") pod \"e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt\" (UID: \"ca2239ef-8fd0-4abf-b875-4508f575144a\") " pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" Jul 24 17:46:43.389019 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:43.388998 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvvr8\" (UniqueName: \"kubernetes.io/projected/ca2239ef-8fd0-4abf-b875-4508f575144a-kube-api-access-zvvr8\") pod \"e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt\" (UID: \"ca2239ef-8fd0-4abf-b875-4508f575144a\") " pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" Jul 24 17:46:43.487093 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:43.487024 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" Jul 24 17:46:43.632703 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:43.632674 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt"] Jul 24 17:46:43.634583 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:46:43.634557 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca2239ef_8fd0_4abf_b875_4508f575144a.slice/crio-c5333b7159200d3592498bdf92704bc6d5267b2ffab5a0c29502a1a8d9615f90 WatchSource:0}: Error finding container c5333b7159200d3592498bdf92704bc6d5267b2ffab5a0c29502a1a8d9615f90: Status 404 returned error can't find the container with id c5333b7159200d3592498bdf92704bc6d5267b2ffab5a0c29502a1a8d9615f90 Jul 24 17:46:43.637019 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:43.636979 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 24 17:46:43.644232 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:43.637125 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 24 17:46:43.644232 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:43.637227 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 24 17:46:44.424303 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:44.424270 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" event={"ID":"ca2239ef-8fd0-4abf-b875-4508f575144a","Type":"ContainerStarted","Data":"a10042f40169e253382880d88939d5052a20ba84836146f4de3b9f0d51597abb"} Jul 24 17:46:44.424694 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:44.424369 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" event={"ID":"ca2239ef-8fd0-4abf-b875-4508f575144a","Type":"ContainerStarted","Data":"c5333b7159200d3592498bdf92704bc6d5267b2ffab5a0c29502a1a8d9615f90"} Jul 24 17:46:44.447551 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:44.447506 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" podStartSLOduration=1.447493625 podStartE2EDuration="1.447493625s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:46:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:46:44.444035049 +0000 UTC m=+1600.112446073" watchObservedRunningTime="2026-07-24 17:46:44.447493625 +0000 UTC m=+1600.115904649" Jul 24 17:46:44.487636 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:44.487607 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" Jul 24 17:46:44.492609 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:44.492587 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" Jul 24 17:46:45.429808 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:45.429774 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" Jul 24 17:46:45.430655 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:46:45.430638 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" Jul 24 17:47:00.877632 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:47:00.876771 2570 patch_prober.go:28] interesting pod/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": read tcp 10.134.0.2:37602->10.134.0.57:15021: read: connection reset by peer" start-of-body= Jul 24 17:47:00.877632 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:47:00.876843 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" podUID="ca2239ef-8fd0-4abf-b875-4508f575144a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": read tcp 10.134.0.2:37602->10.134.0.57:15021: read: connection reset by peer" Jul 24 17:47:01.518229 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:47:01.518193 2570 generic.go:356] "Generic (PLEG): container finished" podID="ca2239ef-8fd0-4abf-b875-4508f575144a" containerID="a10042f40169e253382880d88939d5052a20ba84836146f4de3b9f0d51597abb" exitCode=0 Jul 24 17:47:01.518427 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:47:01.518271 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" event={"ID":"ca2239ef-8fd0-4abf-b875-4508f575144a","Type":"ContainerDied","Data":"a10042f40169e253382880d88939d5052a20ba84836146f4de3b9f0d51597abb"} Jul 24 17:47:01.518690 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:47:01.518676 2570 scope.go:117] "RemoveContainer" containerID="a10042f40169e253382880d88939d5052a20ba84836146f4de3b9f0d51597abb" Jul 24 17:47:01.519623 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:47:01.519597 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 24 17:47:01.519681 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:47:01.519672 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 24 17:47:01.519717 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:47:01.519703 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 24 17:47:02.526502 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:47:02.526471 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" event={"ID":"ca2239ef-8fd0-4abf-b875-4508f575144a","Type":"ContainerStarted","Data":"e46c7367352c21ae8b5dc377088996b54b78002730978f387bf6c49f4c0cd332"} Jul 24 17:47:03.488054 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:47:03.488014 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" Jul 24 17:47:03.488253 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:47:03.488207 2570 patch_prober.go:28] interesting pod/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body= Jul 24 17:47:03.488361 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:47:03.488265 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" podUID="ca2239ef-8fd0-4abf-b875-4508f575144a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" Jul 24 17:47:04.488297 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:47:04.488262 2570 patch_prober.go:28] interesting pod/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body= Jul 24 17:47:04.488724 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:47:04.488314 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" podUID="ca2239ef-8fd0-4abf-b875-4508f575144a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" Jul 24 17:47:05.487536 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:47:05.487499 2570 patch_prober.go:28] interesting pod/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body= Jul 24 17:47:05.487711 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:47:05.487563 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" podUID="ca2239ef-8fd0-4abf-b875-4508f575144a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" Jul 24 17:47:06.490918 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:47:06.490889 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" Jul 24 17:47:06.491292 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:47:06.491256 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" Jul 24 17:47:06.491876 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:47:06.491855 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" Jul 24 17:52:07.941599 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:07.941565 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt"] Jul 24 17:52:07.942041 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:07.941783 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" podUID="ca2239ef-8fd0-4abf-b875-4508f575144a" containerName="istio-proxy" containerID="cri-o://e46c7367352c21ae8b5dc377088996b54b78002730978f387bf6c49f4c0cd332" gracePeriod=30 Jul 24 17:52:09.026271 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:09.026238 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6"] Jul 24 17:52:09.029631 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:09.029614 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" Jul 24 17:52:09.032949 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:09.032932 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-54f231e4-gw-openshift-default-dockercfg-vmhbn\"" Jul 24 17:52:09.046405 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:09.046382 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6"] Jul 24 17:52:09.129784 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:09.129736 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-istiod-ca-cert\") pod \"e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6\" (UID: \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\") " pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" Jul 24 17:52:09.129784 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:09.129782 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-workload-socket\") pod \"e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6\" (UID: \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\") " pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" Jul 24 17:52:09.130033 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:09.129830 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-istio-token\") pod \"e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6\" (UID: \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\") " pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" Jul 24 17:52:09.130033 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:09.129868 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jvtgr\" (UniqueName: \"kubernetes.io/projected/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-kube-api-access-jvtgr\") pod \"e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6\" (UID: \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\") " pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" Jul 24 17:52:09.130033 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:09.129905 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-workload-certs\") pod \"e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6\" (UID: \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\") " pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" Jul 24 17:52:09.130033 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:09.129928 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-istio-envoy\") pod \"e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6\" (UID: \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\") " pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" Jul 24 17:52:09.130033 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:09.130002 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-credential-socket\") pod \"e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6\" (UID: \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\") " pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" Jul 24 17:52:09.130033 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:09.130026 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-istio-podinfo\") pod \"e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6\" (UID: \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\") " pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" Jul 24 17:52:09.130418 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:09.130056 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-istio-data\") pod \"e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6\" (UID: \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\") " pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" Jul 24 17:52:09.231195 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:09.231163 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-credential-socket\") pod \"e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6\" (UID: \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\") " pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" Jul 24 17:52:09.231195 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:09.231198 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-istio-podinfo\") pod \"e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6\" (UID: \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\") " pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" Jul 24 17:52:09.231472 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:09.231219 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-istio-data\") pod \"e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6\" (UID: \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\") " pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" Jul 24 17:52:09.231472 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:09.231253 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-istiod-ca-cert\") pod \"e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6\" (UID: \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\") " pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" Jul 24 17:52:09.231472 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:09.231281 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-workload-socket\") pod \"e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6\" (UID: \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\") " pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" Jul 24 17:52:09.231472 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:09.231352 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-istio-token\") pod \"e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6\" (UID: \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\") " pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" Jul 24 17:52:09.231472 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:09.231389 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jvtgr\" (UniqueName: \"kubernetes.io/projected/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-kube-api-access-jvtgr\") pod \"e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6\" (UID: \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\") " pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" Jul 24 17:52:09.231472 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:09.231425 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-workload-certs\") pod \"e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6\" (UID: \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\") " pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" Jul 24 17:52:09.231472 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:09.231449 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-istio-envoy\") pod \"e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6\" (UID: \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\") " pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" Jul 24 17:52:09.231812 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:09.231613 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-credential-socket\") pod \"e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6\" (UID: \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\") " pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" Jul 24 17:52:09.231812 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:09.231654 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-istio-data\") pod \"e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6\" (UID: \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\") " pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" Jul 24 17:52:09.231924 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:09.231871 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-workload-certs\") pod \"e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6\" (UID: \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\") " pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" Jul 24 17:52:09.231987 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:09.231960 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-workload-socket\") pod \"e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6\" (UID: \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\") " pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" Jul 24 17:52:09.232391 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:09.232368 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-istiod-ca-cert\") pod \"e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6\" (UID: \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\") " pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" Jul 24 17:52:09.233858 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:09.233830 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-istio-envoy\") pod \"e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6\" (UID: \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\") " pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" Jul 24 17:52:09.233983 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:09.233967 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-istio-podinfo\") pod \"e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6\" (UID: \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\") " pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" Jul 24 17:52:09.241301 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:09.241272 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-istio-token\") pod \"e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6\" (UID: \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\") " pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" Jul 24 17:52:09.241510 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:09.241496 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jvtgr\" (UniqueName: \"kubernetes.io/projected/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-kube-api-access-jvtgr\") pod \"e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6\" (UID: \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\") " pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" Jul 24 17:52:09.339546 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:09.339455 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" Jul 24 17:52:09.484496 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:09.484472 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6"] Jul 24 17:52:09.485555 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:52:09.485526 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbbe4f21_0e14_4ce0_9e2f_d52f38886ae1.slice/crio-7712dfe5620311e4f2435079816c6c3f11d576e4ed8b176cc3b9d127e095a174 WatchSource:0}: Error finding container 7712dfe5620311e4f2435079816c6c3f11d576e4ed8b176cc3b9d127e095a174: Status 404 returned error can't find the container with id 7712dfe5620311e4f2435079816c6c3f11d576e4ed8b176cc3b9d127e095a174 Jul 24 17:52:09.487812 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:09.487777 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 24 17:52:09.487878 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:09.487841 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 24 17:52:09.487878 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:09.487869 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 24 17:52:10.193413 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:10.193374 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" event={"ID":"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1","Type":"ContainerStarted","Data":"b8b87ac06bf32b79dd73b2798fccb37c13b75a3df217993cd2052086bbda41cd"} Jul 24 17:52:10.193815 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:10.193433 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" event={"ID":"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1","Type":"ContainerStarted","Data":"7712dfe5620311e4f2435079816c6c3f11d576e4ed8b176cc3b9d127e095a174"} Jul 24 17:52:10.217564 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:10.217520 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" podStartSLOduration=1.217505211 podStartE2EDuration="1.217505211s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:52:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:52:10.216374776 +0000 UTC m=+1925.884785798" watchObservedRunningTime="2026-07-24 17:52:10.217505211 +0000 UTC m=+1925.885916235" Jul 24 17:52:10.340507 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:10.340472 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" Jul 24 17:52:10.346606 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:10.346581 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" Jul 24 17:52:11.199641 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:11.199611 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" Jul 24 17:52:11.200485 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:11.200463 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" Jul 24 17:52:13.194691 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.194662 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" Jul 24 17:52:13.217895 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.217822 2570 generic.go:356] "Generic (PLEG): container finished" podID="ca2239ef-8fd0-4abf-b875-4508f575144a" containerID="e46c7367352c21ae8b5dc377088996b54b78002730978f387bf6c49f4c0cd332" exitCode=0 Jul 24 17:52:13.217895 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.217864 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" Jul 24 17:52:13.218050 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.217902 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" event={"ID":"ca2239ef-8fd0-4abf-b875-4508f575144a","Type":"ContainerDied","Data":"e46c7367352c21ae8b5dc377088996b54b78002730978f387bf6c49f4c0cd332"} Jul 24 17:52:13.218050 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.217951 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt" event={"ID":"ca2239ef-8fd0-4abf-b875-4508f575144a","Type":"ContainerDied","Data":"c5333b7159200d3592498bdf92704bc6d5267b2ffab5a0c29502a1a8d9615f90"} Jul 24 17:52:13.218050 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.217973 2570 scope.go:117] "RemoveContainer" containerID="e46c7367352c21ae8b5dc377088996b54b78002730978f387bf6c49f4c0cd332" Jul 24 17:52:13.227866 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.227850 2570 scope.go:117] "RemoveContainer" containerID="a10042f40169e253382880d88939d5052a20ba84836146f4de3b9f0d51597abb" Jul 24 17:52:13.237038 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.237020 2570 scope.go:117] "RemoveContainer" containerID="e46c7367352c21ae8b5dc377088996b54b78002730978f387bf6c49f4c0cd332" Jul 24 17:52:13.237259 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:52:13.237242 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e46c7367352c21ae8b5dc377088996b54b78002730978f387bf6c49f4c0cd332\": container with ID starting with e46c7367352c21ae8b5dc377088996b54b78002730978f387bf6c49f4c0cd332 not found: ID does not exist" containerID="e46c7367352c21ae8b5dc377088996b54b78002730978f387bf6c49f4c0cd332" Jul 24 17:52:13.237355 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.237265 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e46c7367352c21ae8b5dc377088996b54b78002730978f387bf6c49f4c0cd332"} err="failed to get container status \"e46c7367352c21ae8b5dc377088996b54b78002730978f387bf6c49f4c0cd332\": rpc error: code = NotFound desc = could not find container \"e46c7367352c21ae8b5dc377088996b54b78002730978f387bf6c49f4c0cd332\": container with ID starting with e46c7367352c21ae8b5dc377088996b54b78002730978f387bf6c49f4c0cd332 not found: ID does not exist" Jul 24 17:52:13.237355 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.237281 2570 scope.go:117] "RemoveContainer" containerID="a10042f40169e253382880d88939d5052a20ba84836146f4de3b9f0d51597abb" Jul 24 17:52:13.237561 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:52:13.237543 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a10042f40169e253382880d88939d5052a20ba84836146f4de3b9f0d51597abb\": container with ID starting with a10042f40169e253382880d88939d5052a20ba84836146f4de3b9f0d51597abb not found: ID does not exist" containerID="a10042f40169e253382880d88939d5052a20ba84836146f4de3b9f0d51597abb" Jul 24 17:52:13.237638 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.237569 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a10042f40169e253382880d88939d5052a20ba84836146f4de3b9f0d51597abb"} err="failed to get container status \"a10042f40169e253382880d88939d5052a20ba84836146f4de3b9f0d51597abb\": rpc error: code = NotFound desc = could not find container \"a10042f40169e253382880d88939d5052a20ba84836146f4de3b9f0d51597abb\": container with ID starting with a10042f40169e253382880d88939d5052a20ba84836146f4de3b9f0d51597abb not found: ID does not exist" Jul 24 17:52:13.269059 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.269040 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca2239ef-8fd0-4abf-b875-4508f575144a-istio-token\") pod \"ca2239ef-8fd0-4abf-b875-4508f575144a\" (UID: \"ca2239ef-8fd0-4abf-b875-4508f575144a\") " Jul 24 17:52:13.269159 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.269067 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca2239ef-8fd0-4abf-b875-4508f575144a-istio-envoy\") pod \"ca2239ef-8fd0-4abf-b875-4508f575144a\" (UID: \"ca2239ef-8fd0-4abf-b875-4508f575144a\") " Jul 24 17:52:13.269159 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.269093 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca2239ef-8fd0-4abf-b875-4508f575144a-istio-podinfo\") pod \"ca2239ef-8fd0-4abf-b875-4508f575144a\" (UID: \"ca2239ef-8fd0-4abf-b875-4508f575144a\") " Jul 24 17:52:13.269159 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.269115 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zvvr8\" (UniqueName: \"kubernetes.io/projected/ca2239ef-8fd0-4abf-b875-4508f575144a-kube-api-access-zvvr8\") pod \"ca2239ef-8fd0-4abf-b875-4508f575144a\" (UID: \"ca2239ef-8fd0-4abf-b875-4508f575144a\") " Jul 24 17:52:13.269313 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.269266 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca2239ef-8fd0-4abf-b875-4508f575144a-istiod-ca-cert\") pod \"ca2239ef-8fd0-4abf-b875-4508f575144a\" (UID: \"ca2239ef-8fd0-4abf-b875-4508f575144a\") " Jul 24 17:52:13.269387 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.269326 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca2239ef-8fd0-4abf-b875-4508f575144a-istio-data\") pod \"ca2239ef-8fd0-4abf-b875-4508f575144a\" (UID: \"ca2239ef-8fd0-4abf-b875-4508f575144a\") " Jul 24 17:52:13.269443 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.269407 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca2239ef-8fd0-4abf-b875-4508f575144a-workload-certs\") pod \"ca2239ef-8fd0-4abf-b875-4508f575144a\" (UID: \"ca2239ef-8fd0-4abf-b875-4508f575144a\") " Jul 24 17:52:13.269497 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.269466 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca2239ef-8fd0-4abf-b875-4508f575144a-workload-socket\") pod \"ca2239ef-8fd0-4abf-b875-4508f575144a\" (UID: \"ca2239ef-8fd0-4abf-b875-4508f575144a\") " Jul 24 17:52:13.269549 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.269515 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca2239ef-8fd0-4abf-b875-4508f575144a-credential-socket\") pod \"ca2239ef-8fd0-4abf-b875-4508f575144a\" (UID: \"ca2239ef-8fd0-4abf-b875-4508f575144a\") " Jul 24 17:52:13.270056 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.269633 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ca2239ef-8fd0-4abf-b875-4508f575144a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ca2239ef-8fd0-4abf-b875-4508f575144a" (UID: "ca2239ef-8fd0-4abf-b875-4508f575144a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 17:52:13.270056 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.269806 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca2239ef-8fd0-4abf-b875-4508f575144a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ca2239ef-8fd0-4abf-b875-4508f575144a" (UID: "ca2239ef-8fd0-4abf-b875-4508f575144a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 17:52:13.270056 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.269841 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca2239ef-8fd0-4abf-b875-4508f575144a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ca2239ef-8fd0-4abf-b875-4508f575144a" (UID: "ca2239ef-8fd0-4abf-b875-4508f575144a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 17:52:13.270056 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.269989 2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ca2239ef-8fd0-4abf-b875-4508f575144a-istiod-ca-cert\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:52:13.270056 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.270007 2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ca2239ef-8fd0-4abf-b875-4508f575144a-workload-certs\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:52:13.270056 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.270020 2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca2239ef-8fd0-4abf-b875-4508f575144a-workload-socket\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:52:13.270056 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.270017 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca2239ef-8fd0-4abf-b875-4508f575144a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ca2239ef-8fd0-4abf-b875-4508f575144a" (UID: "ca2239ef-8fd0-4abf-b875-4508f575144a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 17:52:13.270932 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.270909 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca2239ef-8fd0-4abf-b875-4508f575144a-istio-data" (OuterVolumeSpecName: "istio-data") pod "ca2239ef-8fd0-4abf-b875-4508f575144a" (UID: "ca2239ef-8fd0-4abf-b875-4508f575144a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 17:52:13.271912 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.271891 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ca2239ef-8fd0-4abf-b875-4508f575144a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ca2239ef-8fd0-4abf-b875-4508f575144a" (UID: "ca2239ef-8fd0-4abf-b875-4508f575144a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 17:52:13.272000 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.271977 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca2239ef-8fd0-4abf-b875-4508f575144a-kube-api-access-zvvr8" (OuterVolumeSpecName: "kube-api-access-zvvr8") pod "ca2239ef-8fd0-4abf-b875-4508f575144a" (UID: "ca2239ef-8fd0-4abf-b875-4508f575144a"). InnerVolumeSpecName "kube-api-access-zvvr8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 17:52:13.272046 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.272006 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca2239ef-8fd0-4abf-b875-4508f575144a-istio-token" (OuterVolumeSpecName: "istio-token") pod "ca2239ef-8fd0-4abf-b875-4508f575144a" (UID: "ca2239ef-8fd0-4abf-b875-4508f575144a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 17:52:13.272549 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.272529 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ca2239ef-8fd0-4abf-b875-4508f575144a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ca2239ef-8fd0-4abf-b875-4508f575144a" (UID: "ca2239ef-8fd0-4abf-b875-4508f575144a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 17:52:13.370778 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.370750 2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ca2239ef-8fd0-4abf-b875-4508f575144a-istio-data\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:52:13.370778 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.370778 2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ca2239ef-8fd0-4abf-b875-4508f575144a-credential-socket\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:52:13.370947 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.370787 2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ca2239ef-8fd0-4abf-b875-4508f575144a-istio-token\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:52:13.370947 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.370795 2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ca2239ef-8fd0-4abf-b875-4508f575144a-istio-envoy\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:52:13.370947 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.370802 2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ca2239ef-8fd0-4abf-b875-4508f575144a-istio-podinfo\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:52:13.370947 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.370810 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zvvr8\" (UniqueName: \"kubernetes.io/projected/ca2239ef-8fd0-4abf-b875-4508f575144a-kube-api-access-zvvr8\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:52:13.540077 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.540054 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt"] Jul 24 17:52:13.544523 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:13.544498 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-3102a353-openshift-default-7cf5d684c6-gpdzt"] Jul 24 17:52:14.914436 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:14.914392 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca2239ef-8fd0-4abf-b875-4508f575144a" path="/var/lib/kubelet/pods/ca2239ef-8fd0-4abf-b875-4508f575144a/volumes" Jul 24 17:52:26.201032 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:26.200991 2570 patch_prober.go:28] interesting pod/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body= Jul 24 17:52:26.201465 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:26.201051 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" podUID="cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" Jul 24 17:52:26.304994 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:26.304966 2570 generic.go:356] "Generic (PLEG): container finished" podID="cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1" containerID="b8b87ac06bf32b79dd73b2798fccb37c13b75a3df217993cd2052086bbda41cd" exitCode=0 Jul 24 17:52:26.305180 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:26.305049 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" event={"ID":"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1","Type":"ContainerDied","Data":"b8b87ac06bf32b79dd73b2798fccb37c13b75a3df217993cd2052086bbda41cd"} Jul 24 17:52:26.305522 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:26.305500 2570 scope.go:117] "RemoveContainer" containerID="b8b87ac06bf32b79dd73b2798fccb37c13b75a3df217993cd2052086bbda41cd" Jul 24 17:52:26.306512 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:26.306485 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 24 17:52:26.306573 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:26.306560 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 24 17:52:26.306615 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:26.306594 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 24 17:52:27.315089 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:27.315055 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" event={"ID":"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1","Type":"ContainerStarted","Data":"4e666658bdc330716d2373dc1a6fe55349ff5631da4681214b3cd38da59c84f0"} Jul 24 17:52:27.340638 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:27.340608 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" Jul 24 17:52:27.340826 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:27.340804 2570 patch_prober.go:28] interesting pod/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body= Jul 24 17:52:27.340897 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:27.340860 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" podUID="cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" Jul 24 17:52:28.340465 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:28.340424 2570 patch_prober.go:28] interesting pod/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body= Jul 24 17:52:28.340955 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:28.340492 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" podUID="cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" Jul 24 17:52:29.339795 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:29.339763 2570 patch_prober.go:28] interesting pod/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body= Jul 24 17:52:29.339964 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:29.339812 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" podUID="cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" Jul 24 17:52:30.340321 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:30.340289 2570 patch_prober.go:28] interesting pod/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body= Jul 24 17:52:30.340727 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:30.340362 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" podUID="cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" Jul 24 17:52:31.340635 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:31.340601 2570 patch_prober.go:28] interesting pod/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body= Jul 24 17:52:31.341027 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:31.340654 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" podUID="cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" Jul 24 17:52:32.344301 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:32.344272 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" Jul 24 17:52:32.344788 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:32.344664 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" Jul 24 17:52:32.345481 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:52:32.345460 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" Jul 24 17:55:35.789455 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:35.789383 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6"] Jul 24 17:55:35.789937 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:35.789586 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" podUID="cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1" containerName="istio-proxy" containerID="cri-o://4e666658bdc330716d2373dc1a6fe55349ff5631da4681214b3cd38da59c84f0" gracePeriod=30 Jul 24 17:55:36.598276 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:36.598240 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh"] Jul 24 17:55:36.598678 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:36.598665 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca2239ef-8fd0-4abf-b875-4508f575144a" containerName="istio-proxy" Jul 24 17:55:36.598724 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:36.598680 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca2239ef-8fd0-4abf-b875-4508f575144a" containerName="istio-proxy" Jul 24 17:55:36.598724 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:36.598696 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca2239ef-8fd0-4abf-b875-4508f575144a" containerName="istio-proxy" Jul 24 17:55:36.598724 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:36.598702 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca2239ef-8fd0-4abf-b875-4508f575144a" containerName="istio-proxy" Jul 24 17:55:36.598820 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:36.598791 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca2239ef-8fd0-4abf-b875-4508f575144a" containerName="istio-proxy" Jul 24 17:55:36.602207 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:36.602188 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 17:55:36.604927 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:36.604906 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-20962f79-openshift-default-dockercfg-nccgd\"" Jul 24 17:55:36.623980 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:36.623957 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh"] Jul 24 17:55:36.703409 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:36.703375 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b8d2168-7901-49ca-b6d1-a14abc699904-workload-socket\") pod \"e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh\" (UID: \"1b8d2168-7901-49ca-b6d1-a14abc699904\") " pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 17:55:36.703573 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:36.703421 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k87x5\" (UniqueName: \"kubernetes.io/projected/1b8d2168-7901-49ca-b6d1-a14abc699904-kube-api-access-k87x5\") pod \"e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh\" (UID: \"1b8d2168-7901-49ca-b6d1-a14abc699904\") " pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 17:55:36.703573 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:36.703521 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b8d2168-7901-49ca-b6d1-a14abc699904-istiod-ca-cert\") pod \"e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh\" (UID: \"1b8d2168-7901-49ca-b6d1-a14abc699904\") " pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 17:55:36.703573 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:36.703558 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b8d2168-7901-49ca-b6d1-a14abc699904-istio-envoy\") pod \"e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh\" (UID: \"1b8d2168-7901-49ca-b6d1-a14abc699904\") " pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 17:55:36.703684 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:36.703579 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b8d2168-7901-49ca-b6d1-a14abc699904-credential-socket\") pod \"e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh\" (UID: \"1b8d2168-7901-49ca-b6d1-a14abc699904\") " pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 17:55:36.703684 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:36.703594 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b8d2168-7901-49ca-b6d1-a14abc699904-istio-podinfo\") pod \"e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh\" (UID: \"1b8d2168-7901-49ca-b6d1-a14abc699904\") " pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 17:55:36.703684 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:36.703613 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b8d2168-7901-49ca-b6d1-a14abc699904-istio-data\") pod \"e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh\" (UID: \"1b8d2168-7901-49ca-b6d1-a14abc699904\") " pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 17:55:36.703684 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:36.703648 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b8d2168-7901-49ca-b6d1-a14abc699904-workload-certs\") pod \"e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh\" (UID: \"1b8d2168-7901-49ca-b6d1-a14abc699904\") " pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 17:55:36.703809 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:36.703690 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b8d2168-7901-49ca-b6d1-a14abc699904-istio-token\") pod \"e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh\" (UID: \"1b8d2168-7901-49ca-b6d1-a14abc699904\") " pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 17:55:36.804114 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:36.804080 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b8d2168-7901-49ca-b6d1-a14abc699904-istiod-ca-cert\") pod \"e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh\" (UID: \"1b8d2168-7901-49ca-b6d1-a14abc699904\") " pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 17:55:36.804114 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:36.804119 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b8d2168-7901-49ca-b6d1-a14abc699904-istio-envoy\") pod \"e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh\" (UID: \"1b8d2168-7901-49ca-b6d1-a14abc699904\") " pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 17:55:36.804592 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:36.804137 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b8d2168-7901-49ca-b6d1-a14abc699904-credential-socket\") pod \"e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh\" (UID: \"1b8d2168-7901-49ca-b6d1-a14abc699904\") " pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 17:55:36.804592 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:36.804151 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b8d2168-7901-49ca-b6d1-a14abc699904-istio-podinfo\") pod \"e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh\" (UID: \"1b8d2168-7901-49ca-b6d1-a14abc699904\") " pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 17:55:36.804592 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:36.804364 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b8d2168-7901-49ca-b6d1-a14abc699904-istio-data\") pod \"e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh\" (UID: \"1b8d2168-7901-49ca-b6d1-a14abc699904\") " pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 17:55:36.804592 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:36.804408 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b8d2168-7901-49ca-b6d1-a14abc699904-workload-certs\") pod \"e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh\" (UID: \"1b8d2168-7901-49ca-b6d1-a14abc699904\") " pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 17:55:36.804821 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:36.804697 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b8d2168-7901-49ca-b6d1-a14abc699904-istio-token\") pod \"e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh\" (UID: \"1b8d2168-7901-49ca-b6d1-a14abc699904\") " pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 17:55:36.804821 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:36.804721 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b8d2168-7901-49ca-b6d1-a14abc699904-credential-socket\") pod \"e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh\" (UID: \"1b8d2168-7901-49ca-b6d1-a14abc699904\") " pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 17:55:36.804821 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:36.804737 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b8d2168-7901-49ca-b6d1-a14abc699904-workload-certs\") pod \"e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh\" (UID: \"1b8d2168-7901-49ca-b6d1-a14abc699904\") " pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 17:55:36.804973 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:36.804820 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b8d2168-7901-49ca-b6d1-a14abc699904-workload-socket\") pod \"e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh\" (UID: \"1b8d2168-7901-49ca-b6d1-a14abc699904\") " pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 17:55:36.804973 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:36.804849 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k87x5\" (UniqueName: \"kubernetes.io/projected/1b8d2168-7901-49ca-b6d1-a14abc699904-kube-api-access-k87x5\") pod \"e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh\" (UID: \"1b8d2168-7901-49ca-b6d1-a14abc699904\") " pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 17:55:36.804973 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:36.804914 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b8d2168-7901-49ca-b6d1-a14abc699904-istio-data\") pod \"e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh\" (UID: \"1b8d2168-7901-49ca-b6d1-a14abc699904\") " pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 17:55:36.805123 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:36.804970 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b8d2168-7901-49ca-b6d1-a14abc699904-istiod-ca-cert\") pod \"e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh\" (UID: \"1b8d2168-7901-49ca-b6d1-a14abc699904\") " pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 17:55:36.805184 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:36.805132 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b8d2168-7901-49ca-b6d1-a14abc699904-workload-socket\") pod \"e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh\" (UID: \"1b8d2168-7901-49ca-b6d1-a14abc699904\") " pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 17:55:36.806917 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:36.806893 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b8d2168-7901-49ca-b6d1-a14abc699904-istio-podinfo\") pod \"e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh\" (UID: \"1b8d2168-7901-49ca-b6d1-a14abc699904\") " pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 17:55:36.807018 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:36.806923 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b8d2168-7901-49ca-b6d1-a14abc699904-istio-envoy\") pod \"e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh\" (UID: \"1b8d2168-7901-49ca-b6d1-a14abc699904\") " pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 17:55:36.813774 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:36.813751 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b8d2168-7901-49ca-b6d1-a14abc699904-istio-token\") pod \"e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh\" (UID: \"1b8d2168-7901-49ca-b6d1-a14abc699904\") " pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 17:55:36.814151 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:36.814126 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k87x5\" (UniqueName: \"kubernetes.io/projected/1b8d2168-7901-49ca-b6d1-a14abc699904-kube-api-access-k87x5\") pod \"e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh\" (UID: \"1b8d2168-7901-49ca-b6d1-a14abc699904\") " pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 17:55:36.911753 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:36.911721 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 17:55:37.063192 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:37.063169 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh"] Jul 24 17:55:37.064471 ip-10-0-141-115 kubenswrapper[2570]: W0724 17:55:37.064443 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b8d2168_7901_49ca_b6d1_a14abc699904.slice/crio-a9a62bb9bccbc3058d09702720c668fbb9a8de22e9cbaf6f9f58c60f44f27b98 WatchSource:0}: Error finding container a9a62bb9bccbc3058d09702720c668fbb9a8de22e9cbaf6f9f58c60f44f27b98: Status 404 returned error can't find the container with id a9a62bb9bccbc3058d09702720c668fbb9a8de22e9cbaf6f9f58c60f44f27b98 Jul 24 17:55:37.066831 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:37.066792 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 24 17:55:37.066926 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:37.066864 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 24 17:55:37.066926 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:37.066901 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 24 17:55:37.358442 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:37.358412 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" event={"ID":"1b8d2168-7901-49ca-b6d1-a14abc699904","Type":"ContainerStarted","Data":"950c5d08667518617a7a692515bdb1bc99cef6f25220ceec815f79674b7fbe05"} Jul 24 17:55:37.358636 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:37.358462 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" event={"ID":"1b8d2168-7901-49ca-b6d1-a14abc699904","Type":"ContainerStarted","Data":"a9a62bb9bccbc3058d09702720c668fbb9a8de22e9cbaf6f9f58c60f44f27b98"} Jul 24 17:55:37.382246 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:37.382199 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" podStartSLOduration=1.382183907 podStartE2EDuration="1.382183907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 17:55:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 17:55:37.381728608 +0000 UTC m=+2133.050139634" watchObservedRunningTime="2026-07-24 17:55:37.382183907 +0000 UTC m=+2133.050594930" Jul 24 17:55:37.912015 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:37.911983 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 17:55:38.917004 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:38.916971 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 17:55:39.371239 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:39.371213 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 17:55:39.372265 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:39.372242 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 17:55:41.045821 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.045799 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" Jul 24 17:55:41.145761 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.145738 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-credential-socket\") pod \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\" (UID: \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\") " Jul 24 17:55:41.145891 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.145767 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-istiod-ca-cert\") pod \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\" (UID: \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\") " Jul 24 17:55:41.145891 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.145797 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-istio-data\") pod \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\" (UID: \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\") " Jul 24 17:55:41.145891 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.145828 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-workload-certs\") pod \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\" (UID: \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\") " Jul 24 17:55:41.145891 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.145866 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-istio-envoy\") pod \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\" (UID: \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\") " Jul 24 17:55:41.146077 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.145929 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-workload-socket\") pod \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\" (UID: \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\") " Jul 24 17:55:41.146077 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.145949 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-istio-token\") pod \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\" (UID: \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\") " Jul 24 17:55:41.146077 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.145981 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-istio-podinfo\") pod \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\" (UID: \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\") " Jul 24 17:55:41.146077 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.146011 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1" (UID: "cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 17:55:41.146077 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.146058 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jvtgr\" (UniqueName: \"kubernetes.io/projected/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-kube-api-access-jvtgr\") pod \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\" (UID: \"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1\") " Jul 24 17:55:41.146371 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.146193 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1" (UID: "cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 17:55:41.146371 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.146273 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1" (UID: "cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 17:55:41.146480 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.146446 2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-credential-socket\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:55:41.146480 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.146468 2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-workload-certs\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:55:41.146591 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.146482 2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-workload-socket\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:55:41.146684 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.146659 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1" (UID: "cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 17:55:41.146946 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.146921 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-istio-data" (OuterVolumeSpecName: "istio-data") pod "cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1" (UID: "cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 17:55:41.148207 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.148186 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1" (UID: "cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 17:55:41.148303 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.148228 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-kube-api-access-jvtgr" (OuterVolumeSpecName: "kube-api-access-jvtgr") pod "cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1" (UID: "cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1"). InnerVolumeSpecName "kube-api-access-jvtgr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 17:55:41.148602 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.148582 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-istio-token" (OuterVolumeSpecName: "istio-token") pod "cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1" (UID: "cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 17:55:41.148699 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.148630 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1" (UID: "cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 17:55:41.248123 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.248059 2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-istio-token\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:55:41.248123 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.248116 2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-istio-podinfo\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:55:41.248392 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.248130 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jvtgr\" (UniqueName: \"kubernetes.io/projected/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-kube-api-access-jvtgr\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:55:41.248392 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.248176 2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-istiod-ca-cert\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:55:41.248392 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.248192 2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-istio-data\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:55:41.248392 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.248206 2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1-istio-envoy\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 17:55:41.384520 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.384490 2570 generic.go:356] "Generic (PLEG): container finished" podID="cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1" containerID="4e666658bdc330716d2373dc1a6fe55349ff5631da4681214b3cd38da59c84f0" exitCode=0 Jul 24 17:55:41.384697 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.384539 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" Jul 24 17:55:41.384697 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.384576 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" event={"ID":"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1","Type":"ContainerDied","Data":"4e666658bdc330716d2373dc1a6fe55349ff5631da4681214b3cd38da59c84f0"} Jul 24 17:55:41.384697 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.384638 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6" event={"ID":"cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1","Type":"ContainerDied","Data":"7712dfe5620311e4f2435079816c6c3f11d576e4ed8b176cc3b9d127e095a174"} Jul 24 17:55:41.384697 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.384668 2570 scope.go:117] "RemoveContainer" containerID="4e666658bdc330716d2373dc1a6fe55349ff5631da4681214b3cd38da59c84f0" Jul 24 17:55:41.394956 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.394940 2570 scope.go:117] "RemoveContainer" containerID="b8b87ac06bf32b79dd73b2798fccb37c13b75a3df217993cd2052086bbda41cd" Jul 24 17:55:41.403093 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.403077 2570 scope.go:117] "RemoveContainer" containerID="4e666658bdc330716d2373dc1a6fe55349ff5631da4681214b3cd38da59c84f0" Jul 24 17:55:41.403322 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:55:41.403305 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e666658bdc330716d2373dc1a6fe55349ff5631da4681214b3cd38da59c84f0\": container with ID starting with 4e666658bdc330716d2373dc1a6fe55349ff5631da4681214b3cd38da59c84f0 not found: ID does not exist" containerID="4e666658bdc330716d2373dc1a6fe55349ff5631da4681214b3cd38da59c84f0" Jul 24 17:55:41.403403 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.403353 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e666658bdc330716d2373dc1a6fe55349ff5631da4681214b3cd38da59c84f0"} err="failed to get container status \"4e666658bdc330716d2373dc1a6fe55349ff5631da4681214b3cd38da59c84f0\": rpc error: code = NotFound desc = could not find container \"4e666658bdc330716d2373dc1a6fe55349ff5631da4681214b3cd38da59c84f0\": container with ID starting with 4e666658bdc330716d2373dc1a6fe55349ff5631da4681214b3cd38da59c84f0 not found: ID does not exist" Jul 24 17:55:41.403403 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.403371 2570 scope.go:117] "RemoveContainer" containerID="b8b87ac06bf32b79dd73b2798fccb37c13b75a3df217993cd2052086bbda41cd" Jul 24 17:55:41.403552 ip-10-0-141-115 kubenswrapper[2570]: E0724 17:55:41.403536 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b8b87ac06bf32b79dd73b2798fccb37c13b75a3df217993cd2052086bbda41cd\": container with ID starting with b8b87ac06bf32b79dd73b2798fccb37c13b75a3df217993cd2052086bbda41cd not found: ID does not exist" containerID="b8b87ac06bf32b79dd73b2798fccb37c13b75a3df217993cd2052086bbda41cd" Jul 24 17:55:41.403591 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.403557 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b8b87ac06bf32b79dd73b2798fccb37c13b75a3df217993cd2052086bbda41cd"} err="failed to get container status \"b8b87ac06bf32b79dd73b2798fccb37c13b75a3df217993cd2052086bbda41cd\": rpc error: code = NotFound desc = could not find container \"b8b87ac06bf32b79dd73b2798fccb37c13b75a3df217993cd2052086bbda41cd\": container with ID starting with b8b87ac06bf32b79dd73b2798fccb37c13b75a3df217993cd2052086bbda41cd not found: ID does not exist" Jul 24 17:55:41.416592 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.416567 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6"] Jul 24 17:55:41.426160 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:41.426139 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-54f231e4-gw-openshift-default-986bdbdc6-wdff6"] Jul 24 17:55:42.914303 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:42.914273 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1" path="/var/lib/kubelet/pods/cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1/volumes" Jul 24 17:55:53.456885 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:53.456847 2570 generic.go:356] "Generic (PLEG): container finished" podID="1b8d2168-7901-49ca-b6d1-a14abc699904" containerID="950c5d08667518617a7a692515bdb1bc99cef6f25220ceec815f79674b7fbe05" exitCode=0 Jul 24 17:55:53.456885 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:53.456878 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" event={"ID":"1b8d2168-7901-49ca-b6d1-a14abc699904","Type":"ContainerDied","Data":"950c5d08667518617a7a692515bdb1bc99cef6f25220ceec815f79674b7fbe05"} Jul 24 17:55:53.457494 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:53.457389 2570 scope.go:117] "RemoveContainer" containerID="950c5d08667518617a7a692515bdb1bc99cef6f25220ceec815f79674b7fbe05" Jul 24 17:55:53.458458 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:53.458428 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 24 17:55:53.458564 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:53.458510 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 24 17:55:53.458564 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:53.458558 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 24 17:55:54.371862 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:54.371824 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 17:55:54.464296 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:54.464259 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" event={"ID":"1b8d2168-7901-49ca-b6d1-a14abc699904","Type":"ContainerStarted","Data":"4088d025d292a3bf1e6362a52446e091d003cc9a241e2e29d1df9bf862ff59ad"} Jul 24 17:55:54.913044 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:54.913012 2570 patch_prober.go:28] interesting pod/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body= Jul 24 17:55:54.913218 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:54.913069 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" podUID="1b8d2168-7901-49ca-b6d1-a14abc699904" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" Jul 24 17:55:54.913946 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:54.913927 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 17:55:55.912777 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:55.912743 2570 patch_prober.go:28] interesting pod/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body= Jul 24 17:55:55.913163 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:55.912789 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" podUID="1b8d2168-7901-49ca-b6d1-a14abc699904" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" Jul 24 17:55:56.912875 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:56.912834 2570 patch_prober.go:28] interesting pod/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body= Jul 24 17:55:56.913356 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:56.912906 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" podUID="1b8d2168-7901-49ca-b6d1-a14abc699904" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" Jul 24 17:55:57.912311 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:57.912277 2570 patch_prober.go:28] interesting pod/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body= Jul 24 17:55:57.912507 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:57.912360 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" podUID="1b8d2168-7901-49ca-b6d1-a14abc699904" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" Jul 24 17:55:58.912043 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:58.912011 2570 patch_prober.go:28] interesting pod/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" start-of-body= Jul 24 17:55:58.912441 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:58.912073 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" podUID="1b8d2168-7901-49ca-b6d1-a14abc699904" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.59:15021/healthz/ready\": dial tcp 10.134.0.59:15021: connect: connection refused" Jul 24 17:55:59.916572 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:59.916545 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 17:55:59.916944 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:59.916800 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 17:55:59.917628 ip-10-0-141-115 kubenswrapper[2570]: I0724 17:55:59.917612 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 18:01:00.611422 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:00.611392 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh"] Jul 24 18:01:00.613796 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:00.611616 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" podUID="1b8d2168-7901-49ca-b6d1-a14abc699904" containerName="istio-proxy" containerID="cri-o://4088d025d292a3bf1e6362a52446e091d003cc9a241e2e29d1df9bf862ff59ad" gracePeriod=30 Jul 24 18:01:01.413712 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.413682 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs"] Jul 24 18:01:01.414076 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.414064 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1" containerName="istio-proxy" Jul 24 18:01:01.414130 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.414078 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1" containerName="istio-proxy" Jul 24 18:01:01.414130 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.414094 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1" containerName="istio-proxy" Jul 24 18:01:01.414130 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.414099 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1" containerName="istio-proxy" Jul 24 18:01:01.414234 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.414169 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1" containerName="istio-proxy" Jul 24 18:01:01.414234 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.414178 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="cbbe4f21-0e14-4ce0-9e2f-d52f38886ae1" containerName="istio-proxy" Jul 24 18:01:01.414234 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.414187 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca2239ef-8fd0-4abf-b875-4508f575144a" containerName="istio-proxy" Jul 24 18:01:01.417385 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.417364 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" Jul 24 18:01:01.420218 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.420196 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-842768d6-openshift-default-dockercfg-9qtr7\"" Jul 24 18:01:01.433479 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.433459 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs"] Jul 24 18:01:01.496872 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.496845 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/209a5813-0275-4463-97a6-9a8f47493b3f-istio-envoy\") pod \"e2e-derive-842768d6-openshift-default-554998dc56-5plcs\" (UID: \"209a5813-0275-4463-97a6-9a8f47493b3f\") " pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" Jul 24 18:01:01.497043 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.496913 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/209a5813-0275-4463-97a6-9a8f47493b3f-workload-certs\") pod \"e2e-derive-842768d6-openshift-default-554998dc56-5plcs\" (UID: \"209a5813-0275-4463-97a6-9a8f47493b3f\") " pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" Jul 24 18:01:01.497043 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.496960 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/209a5813-0275-4463-97a6-9a8f47493b3f-istio-podinfo\") pod \"e2e-derive-842768d6-openshift-default-554998dc56-5plcs\" (UID: \"209a5813-0275-4463-97a6-9a8f47493b3f\") " pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" Jul 24 18:01:01.497182 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.497132 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/209a5813-0275-4463-97a6-9a8f47493b3f-workload-socket\") pod \"e2e-derive-842768d6-openshift-default-554998dc56-5plcs\" (UID: \"209a5813-0275-4463-97a6-9a8f47493b3f\") " pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" Jul 24 18:01:01.497249 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.497233 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/209a5813-0275-4463-97a6-9a8f47493b3f-istio-data\") pod \"e2e-derive-842768d6-openshift-default-554998dc56-5plcs\" (UID: \"209a5813-0275-4463-97a6-9a8f47493b3f\") " pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" Jul 24 18:01:01.497306 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.497284 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chnb8\" (UniqueName: \"kubernetes.io/projected/209a5813-0275-4463-97a6-9a8f47493b3f-kube-api-access-chnb8\") pod \"e2e-derive-842768d6-openshift-default-554998dc56-5plcs\" (UID: \"209a5813-0275-4463-97a6-9a8f47493b3f\") " pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" Jul 24 18:01:01.497410 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.497310 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/209a5813-0275-4463-97a6-9a8f47493b3f-istiod-ca-cert\") pod \"e2e-derive-842768d6-openshift-default-554998dc56-5plcs\" (UID: \"209a5813-0275-4463-97a6-9a8f47493b3f\") " pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" Jul 24 18:01:01.497410 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.497369 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/209a5813-0275-4463-97a6-9a8f47493b3f-istio-token\") pod \"e2e-derive-842768d6-openshift-default-554998dc56-5plcs\" (UID: \"209a5813-0275-4463-97a6-9a8f47493b3f\") " pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" Jul 24 18:01:01.497528 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.497424 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/209a5813-0275-4463-97a6-9a8f47493b3f-credential-socket\") pod \"e2e-derive-842768d6-openshift-default-554998dc56-5plcs\" (UID: \"209a5813-0275-4463-97a6-9a8f47493b3f\") " pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" Jul 24 18:01:01.598471 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.598435 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/209a5813-0275-4463-97a6-9a8f47493b3f-workload-socket\") pod \"e2e-derive-842768d6-openshift-default-554998dc56-5plcs\" (UID: \"209a5813-0275-4463-97a6-9a8f47493b3f\") " pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" Jul 24 18:01:01.598675 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.598484 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/209a5813-0275-4463-97a6-9a8f47493b3f-istio-data\") pod \"e2e-derive-842768d6-openshift-default-554998dc56-5plcs\" (UID: \"209a5813-0275-4463-97a6-9a8f47493b3f\") " pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" Jul 24 18:01:01.598675 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.598509 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chnb8\" (UniqueName: \"kubernetes.io/projected/209a5813-0275-4463-97a6-9a8f47493b3f-kube-api-access-chnb8\") pod \"e2e-derive-842768d6-openshift-default-554998dc56-5plcs\" (UID: \"209a5813-0275-4463-97a6-9a8f47493b3f\") " pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" Jul 24 18:01:01.598675 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.598528 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/209a5813-0275-4463-97a6-9a8f47493b3f-istiod-ca-cert\") pod \"e2e-derive-842768d6-openshift-default-554998dc56-5plcs\" (UID: \"209a5813-0275-4463-97a6-9a8f47493b3f\") " pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" Jul 24 18:01:01.598675 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.598555 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/209a5813-0275-4463-97a6-9a8f47493b3f-istio-token\") pod \"e2e-derive-842768d6-openshift-default-554998dc56-5plcs\" (UID: \"209a5813-0275-4463-97a6-9a8f47493b3f\") " pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" Jul 24 18:01:01.598675 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.598610 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/209a5813-0275-4463-97a6-9a8f47493b3f-credential-socket\") pod \"e2e-derive-842768d6-openshift-default-554998dc56-5plcs\" (UID: \"209a5813-0275-4463-97a6-9a8f47493b3f\") " pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" Jul 24 18:01:01.598675 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.598660 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/209a5813-0275-4463-97a6-9a8f47493b3f-istio-envoy\") pod \"e2e-derive-842768d6-openshift-default-554998dc56-5plcs\" (UID: \"209a5813-0275-4463-97a6-9a8f47493b3f\") " pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" Jul 24 18:01:01.599008 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.598715 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/209a5813-0275-4463-97a6-9a8f47493b3f-workload-certs\") pod \"e2e-derive-842768d6-openshift-default-554998dc56-5plcs\" (UID: \"209a5813-0275-4463-97a6-9a8f47493b3f\") " pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" Jul 24 18:01:01.599008 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.598763 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/209a5813-0275-4463-97a6-9a8f47493b3f-istio-podinfo\") pod \"e2e-derive-842768d6-openshift-default-554998dc56-5plcs\" (UID: \"209a5813-0275-4463-97a6-9a8f47493b3f\") " pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" Jul 24 18:01:01.599008 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.598834 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/209a5813-0275-4463-97a6-9a8f47493b3f-istio-data\") pod \"e2e-derive-842768d6-openshift-default-554998dc56-5plcs\" (UID: \"209a5813-0275-4463-97a6-9a8f47493b3f\") " pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" Jul 24 18:01:01.599008 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.598930 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/209a5813-0275-4463-97a6-9a8f47493b3f-workload-socket\") pod \"e2e-derive-842768d6-openshift-default-554998dc56-5plcs\" (UID: \"209a5813-0275-4463-97a6-9a8f47493b3f\") " pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" Jul 24 18:01:01.599156 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.599024 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/209a5813-0275-4463-97a6-9a8f47493b3f-credential-socket\") pod \"e2e-derive-842768d6-openshift-default-554998dc56-5plcs\" (UID: \"209a5813-0275-4463-97a6-9a8f47493b3f\") " pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" Jul 24 18:01:01.599156 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.599094 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/209a5813-0275-4463-97a6-9a8f47493b3f-workload-certs\") pod \"e2e-derive-842768d6-openshift-default-554998dc56-5plcs\" (UID: \"209a5813-0275-4463-97a6-9a8f47493b3f\") " pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" Jul 24 18:01:01.599365 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.599317 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/209a5813-0275-4463-97a6-9a8f47493b3f-istiod-ca-cert\") pod \"e2e-derive-842768d6-openshift-default-554998dc56-5plcs\" (UID: \"209a5813-0275-4463-97a6-9a8f47493b3f\") " pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" Jul 24 18:01:01.601065 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.601044 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/209a5813-0275-4463-97a6-9a8f47493b3f-istio-envoy\") pod \"e2e-derive-842768d6-openshift-default-554998dc56-5plcs\" (UID: \"209a5813-0275-4463-97a6-9a8f47493b3f\") " pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" Jul 24 18:01:01.601258 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.601242 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/209a5813-0275-4463-97a6-9a8f47493b3f-istio-podinfo\") pod \"e2e-derive-842768d6-openshift-default-554998dc56-5plcs\" (UID: \"209a5813-0275-4463-97a6-9a8f47493b3f\") " pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" Jul 24 18:01:01.607838 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.607817 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/209a5813-0275-4463-97a6-9a8f47493b3f-istio-token\") pod \"e2e-derive-842768d6-openshift-default-554998dc56-5plcs\" (UID: \"209a5813-0275-4463-97a6-9a8f47493b3f\") " pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" Jul 24 18:01:01.607973 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.607867 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chnb8\" (UniqueName: \"kubernetes.io/projected/209a5813-0275-4463-97a6-9a8f47493b3f-kube-api-access-chnb8\") pod \"e2e-derive-842768d6-openshift-default-554998dc56-5plcs\" (UID: \"209a5813-0275-4463-97a6-9a8f47493b3f\") " pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" Jul 24 18:01:01.727546 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.727458 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" Jul 24 18:01:01.888965 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.888919 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs"] Jul 24 18:01:01.891719 ip-10-0-141-115 kubenswrapper[2570]: W0724 18:01:01.891690 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod209a5813_0275_4463_97a6_9a8f47493b3f.slice/crio-e1ef5593949ef34f34c3341fdfe7eeb2a4243c792717ff78a2c75e99ba936029 WatchSource:0}: Error finding container e1ef5593949ef34f34c3341fdfe7eeb2a4243c792717ff78a2c75e99ba936029: Status 404 returned error can't find the container with id e1ef5593949ef34f34c3341fdfe7eeb2a4243c792717ff78a2c75e99ba936029 Jul 24 18:01:01.893915 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.893883 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 24 18:01:01.894003 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.893965 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 24 18:01:01.894089 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:01.894032 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 24 18:01:02.114364 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:02.114307 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" event={"ID":"209a5813-0275-4463-97a6-9a8f47493b3f","Type":"ContainerStarted","Data":"08b358eb98256522d19c14c3f4aeab17df8e4fbae40a8bb9454734f652831e43"} Jul 24 18:01:02.114526 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:02.114380 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" event={"ID":"209a5813-0275-4463-97a6-9a8f47493b3f","Type":"ContainerStarted","Data":"e1ef5593949ef34f34c3341fdfe7eeb2a4243c792717ff78a2c75e99ba936029"} Jul 24 18:01:02.138967 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:02.138901 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" podStartSLOduration=1.138881053 podStartE2EDuration="1.138881053s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:01:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:01:02.137808512 +0000 UTC m=+2457.806219570" watchObservedRunningTime="2026-07-24 18:01:02.138881053 +0000 UTC m=+2457.807292076" Jul 24 18:01:02.728393 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:02.728363 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" Jul 24 18:01:02.732970 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:02.732945 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" Jul 24 18:01:03.121924 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:03.121899 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" Jul 24 18:01:03.122986 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:03.122965 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" Jul 24 18:01:05.884187 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:05.884134 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 18:01:06.040504 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.040477 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b8d2168-7901-49ca-b6d1-a14abc699904-istio-data\") pod \"1b8d2168-7901-49ca-b6d1-a14abc699904\" (UID: \"1b8d2168-7901-49ca-b6d1-a14abc699904\") " Jul 24 18:01:06.040660 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.040520 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b8d2168-7901-49ca-b6d1-a14abc699904-istio-podinfo\") pod \"1b8d2168-7901-49ca-b6d1-a14abc699904\" (UID: \"1b8d2168-7901-49ca-b6d1-a14abc699904\") " Jul 24 18:01:06.040660 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.040550 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b8d2168-7901-49ca-b6d1-a14abc699904-istiod-ca-cert\") pod \"1b8d2168-7901-49ca-b6d1-a14abc699904\" (UID: \"1b8d2168-7901-49ca-b6d1-a14abc699904\") " Jul 24 18:01:06.040660 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.040581 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b8d2168-7901-49ca-b6d1-a14abc699904-istio-envoy\") pod \"1b8d2168-7901-49ca-b6d1-a14abc699904\" (UID: \"1b8d2168-7901-49ca-b6d1-a14abc699904\") " Jul 24 18:01:06.040660 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.040598 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b8d2168-7901-49ca-b6d1-a14abc699904-istio-token\") pod \"1b8d2168-7901-49ca-b6d1-a14abc699904\" (UID: \"1b8d2168-7901-49ca-b6d1-a14abc699904\") " Jul 24 18:01:06.040872 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.040775 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b8d2168-7901-49ca-b6d1-a14abc699904-credential-socket\") pod \"1b8d2168-7901-49ca-b6d1-a14abc699904\" (UID: \"1b8d2168-7901-49ca-b6d1-a14abc699904\") " Jul 24 18:01:06.040872 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.040815 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b8d2168-7901-49ca-b6d1-a14abc699904-workload-certs\") pod \"1b8d2168-7901-49ca-b6d1-a14abc699904\" (UID: \"1b8d2168-7901-49ca-b6d1-a14abc699904\") " Jul 24 18:01:06.040872 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.040845 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b8d2168-7901-49ca-b6d1-a14abc699904-workload-socket\") pod \"1b8d2168-7901-49ca-b6d1-a14abc699904\" (UID: \"1b8d2168-7901-49ca-b6d1-a14abc699904\") " Jul 24 18:01:06.041010 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.040889 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-k87x5\" (UniqueName: \"kubernetes.io/projected/1b8d2168-7901-49ca-b6d1-a14abc699904-kube-api-access-k87x5\") pod \"1b8d2168-7901-49ca-b6d1-a14abc699904\" (UID: \"1b8d2168-7901-49ca-b6d1-a14abc699904\") " Jul 24 18:01:06.041061 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.041012 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b8d2168-7901-49ca-b6d1-a14abc699904-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1b8d2168-7901-49ca-b6d1-a14abc699904" (UID: "1b8d2168-7901-49ca-b6d1-a14abc699904"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 18:01:06.041061 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.041043 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b8d2168-7901-49ca-b6d1-a14abc699904-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1b8d2168-7901-49ca-b6d1-a14abc699904" (UID: "1b8d2168-7901-49ca-b6d1-a14abc699904"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 18:01:06.041495 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.041240 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b8d2168-7901-49ca-b6d1-a14abc699904-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1b8d2168-7901-49ca-b6d1-a14abc699904" (UID: "1b8d2168-7901-49ca-b6d1-a14abc699904"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 18:01:06.041495 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.041465 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b8d2168-7901-49ca-b6d1-a14abc699904-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1b8d2168-7901-49ca-b6d1-a14abc699904" (UID: "1b8d2168-7901-49ca-b6d1-a14abc699904"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 18:01:06.041844 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.041503 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b8d2168-7901-49ca-b6d1-a14abc699904-istio-data" (OuterVolumeSpecName: "istio-data") pod "1b8d2168-7901-49ca-b6d1-a14abc699904" (UID: "1b8d2168-7901-49ca-b6d1-a14abc699904"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 18:01:06.041844 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.041610 2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b8d2168-7901-49ca-b6d1-a14abc699904-credential-socket\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 18:01:06.041844 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.041630 2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1b8d2168-7901-49ca-b6d1-a14abc699904-workload-certs\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 18:01:06.041844 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.041644 2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1b8d2168-7901-49ca-b6d1-a14abc699904-istiod-ca-cert\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 18:01:06.043084 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.043057 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1b8d2168-7901-49ca-b6d1-a14abc699904-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1b8d2168-7901-49ca-b6d1-a14abc699904" (UID: "1b8d2168-7901-49ca-b6d1-a14abc699904"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 18:01:06.043276 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.043258 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b8d2168-7901-49ca-b6d1-a14abc699904-kube-api-access-k87x5" (OuterVolumeSpecName: "kube-api-access-k87x5") pod "1b8d2168-7901-49ca-b6d1-a14abc699904" (UID: "1b8d2168-7901-49ca-b6d1-a14abc699904"). InnerVolumeSpecName "kube-api-access-k87x5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 18:01:06.043468 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.043450 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1b8d2168-7901-49ca-b6d1-a14abc699904-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1b8d2168-7901-49ca-b6d1-a14abc699904" (UID: "1b8d2168-7901-49ca-b6d1-a14abc699904"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 18:01:06.043555 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.043541 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b8d2168-7901-49ca-b6d1-a14abc699904-istio-token" (OuterVolumeSpecName: "istio-token") pod "1b8d2168-7901-49ca-b6d1-a14abc699904" (UID: "1b8d2168-7901-49ca-b6d1-a14abc699904"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 18:01:06.138988 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.138913 2570 generic.go:356] "Generic (PLEG): container finished" podID="1b8d2168-7901-49ca-b6d1-a14abc699904" containerID="4088d025d292a3bf1e6362a52446e091d003cc9a241e2e29d1df9bf862ff59ad" exitCode=0 Jul 24 18:01:06.138988 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.138959 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" Jul 24 18:01:06.139182 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.138960 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" event={"ID":"1b8d2168-7901-49ca-b6d1-a14abc699904","Type":"ContainerDied","Data":"4088d025d292a3bf1e6362a52446e091d003cc9a241e2e29d1df9bf862ff59ad"} Jul 24 18:01:06.139182 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.139079 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh" event={"ID":"1b8d2168-7901-49ca-b6d1-a14abc699904","Type":"ContainerDied","Data":"a9a62bb9bccbc3058d09702720c668fbb9a8de22e9cbaf6f9f58c60f44f27b98"} Jul 24 18:01:06.139182 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.139102 2570 scope.go:117] "RemoveContainer" containerID="4088d025d292a3bf1e6362a52446e091d003cc9a241e2e29d1df9bf862ff59ad" Jul 24 18:01:06.142264 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.142246 2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1b8d2168-7901-49ca-b6d1-a14abc699904-istio-envoy\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 18:01:06.142264 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.142264 2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1b8d2168-7901-49ca-b6d1-a14abc699904-istio-token\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 18:01:06.142264 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.142273 2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1b8d2168-7901-49ca-b6d1-a14abc699904-workload-socket\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 18:01:06.142541 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.142282 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-k87x5\" (UniqueName: \"kubernetes.io/projected/1b8d2168-7901-49ca-b6d1-a14abc699904-kube-api-access-k87x5\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 18:01:06.142541 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.142291 2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1b8d2168-7901-49ca-b6d1-a14abc699904-istio-data\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 18:01:06.142541 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.142299 2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1b8d2168-7901-49ca-b6d1-a14abc699904-istio-podinfo\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 18:01:06.148142 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.148126 2570 scope.go:117] "RemoveContainer" containerID="950c5d08667518617a7a692515bdb1bc99cef6f25220ceec815f79674b7fbe05" Jul 24 18:01:06.158267 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.158251 2570 scope.go:117] "RemoveContainer" containerID="4088d025d292a3bf1e6362a52446e091d003cc9a241e2e29d1df9bf862ff59ad" Jul 24 18:01:06.158541 ip-10-0-141-115 kubenswrapper[2570]: E0724 18:01:06.158523 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4088d025d292a3bf1e6362a52446e091d003cc9a241e2e29d1df9bf862ff59ad\": container with ID starting with 4088d025d292a3bf1e6362a52446e091d003cc9a241e2e29d1df9bf862ff59ad not found: ID does not exist" containerID="4088d025d292a3bf1e6362a52446e091d003cc9a241e2e29d1df9bf862ff59ad" Jul 24 18:01:06.158637 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.158552 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4088d025d292a3bf1e6362a52446e091d003cc9a241e2e29d1df9bf862ff59ad"} err="failed to get container status \"4088d025d292a3bf1e6362a52446e091d003cc9a241e2e29d1df9bf862ff59ad\": rpc error: code = NotFound desc = could not find container \"4088d025d292a3bf1e6362a52446e091d003cc9a241e2e29d1df9bf862ff59ad\": container with ID starting with 4088d025d292a3bf1e6362a52446e091d003cc9a241e2e29d1df9bf862ff59ad not found: ID does not exist" Jul 24 18:01:06.158637 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.158574 2570 scope.go:117] "RemoveContainer" containerID="950c5d08667518617a7a692515bdb1bc99cef6f25220ceec815f79674b7fbe05" Jul 24 18:01:06.158841 ip-10-0-141-115 kubenswrapper[2570]: E0724 18:01:06.158823 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"950c5d08667518617a7a692515bdb1bc99cef6f25220ceec815f79674b7fbe05\": container with ID starting with 950c5d08667518617a7a692515bdb1bc99cef6f25220ceec815f79674b7fbe05 not found: ID does not exist" containerID="950c5d08667518617a7a692515bdb1bc99cef6f25220ceec815f79674b7fbe05" Jul 24 18:01:06.158896 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.158849 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"950c5d08667518617a7a692515bdb1bc99cef6f25220ceec815f79674b7fbe05"} err="failed to get container status \"950c5d08667518617a7a692515bdb1bc99cef6f25220ceec815f79674b7fbe05\": rpc error: code = NotFound desc = could not find container \"950c5d08667518617a7a692515bdb1bc99cef6f25220ceec815f79674b7fbe05\": container with ID starting with 950c5d08667518617a7a692515bdb1bc99cef6f25220ceec815f79674b7fbe05 not found: ID does not exist" Jul 24 18:01:06.166367 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.166348 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh"] Jul 24 18:01:06.172970 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.172952 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-20962f79-openshift-default-6578f7c54-rxlmh"] Jul 24 18:01:06.914552 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:06.914522 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b8d2168-7901-49ca-b6d1-a14abc699904" path="/var/lib/kubelet/pods/1b8d2168-7901-49ca-b6d1-a14abc699904/volumes" Jul 24 18:01:18.123561 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:18.123494 2570 patch_prober.go:28] interesting pod/e2e-derive-842768d6-openshift-default-554998dc56-5plcs container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body= Jul 24 18:01:18.123922 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:18.123559 2570 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" podUID="209a5813-0275-4463-97a6-9a8f47493b3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" Jul 24 18:01:18.215193 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:18.215165 2570 generic.go:356] "Generic (PLEG): container finished" podID="209a5813-0275-4463-97a6-9a8f47493b3f" containerID="08b358eb98256522d19c14c3f4aeab17df8e4fbae40a8bb9454734f652831e43" exitCode=0 Jul 24 18:01:18.215380 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:18.215244 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" event={"ID":"209a5813-0275-4463-97a6-9a8f47493b3f","Type":"ContainerDied","Data":"08b358eb98256522d19c14c3f4aeab17df8e4fbae40a8bb9454734f652831e43"} Jul 24 18:01:18.215692 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:18.215675 2570 scope.go:117] "RemoveContainer" containerID="08b358eb98256522d19c14c3f4aeab17df8e4fbae40a8bb9454734f652831e43" Jul 24 18:01:18.216711 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:18.216671 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 24 18:01:18.216790 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:18.216748 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 24 18:01:18.216833 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:18.216801 2570 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jul 24 18:01:19.223820 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:19.223780 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" event={"ID":"209a5813-0275-4463-97a6-9a8f47493b3f","Type":"ContainerStarted","Data":"e7cb3ffcb4a5d52d6a153e949a31e9d2cf501eac7bec647028f5efd1deefd5c8"} Jul 24 18:01:19.728068 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:19.728036 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" Jul 24 18:01:19.728261 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:19.728241 2570 patch_prober.go:28] interesting pod/e2e-derive-842768d6-openshift-default-554998dc56-5plcs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body= Jul 24 18:01:19.728318 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:19.728300 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" podUID="209a5813-0275-4463-97a6-9a8f47493b3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" Jul 24 18:01:20.728341 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:20.728305 2570 patch_prober.go:28] interesting pod/e2e-derive-842768d6-openshift-default-554998dc56-5plcs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body= Jul 24 18:01:20.728736 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:20.728380 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" podUID="209a5813-0275-4463-97a6-9a8f47493b3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" Jul 24 18:01:21.728687 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:21.728649 2570 patch_prober.go:28] interesting pod/e2e-derive-842768d6-openshift-default-554998dc56-5plcs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body= Jul 24 18:01:21.729165 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:21.728723 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" podUID="209a5813-0275-4463-97a6-9a8f47493b3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" Jul 24 18:01:22.728211 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:22.728180 2570 patch_prober.go:28] interesting pod/e2e-derive-842768d6-openshift-default-554998dc56-5plcs container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body= Jul 24 18:01:22.728421 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:22.728233 2570 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" podUID="209a5813-0275-4463-97a6-9a8f47493b3f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" Jul 24 18:01:23.732519 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:23.732483 2570 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" Jul 24 18:01:23.733025 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:23.732773 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" Jul 24 18:01:23.733704 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:01:23.733680 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" Jul 24 18:06:25.258162 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:25.258074 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs"] Jul 24 18:06:25.258636 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:25.258312 2570 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" podUID="209a5813-0275-4463-97a6-9a8f47493b3f" containerName="istio-proxy" containerID="cri-o://e7cb3ffcb4a5d52d6a153e949a31e9d2cf501eac7bec647028f5efd1deefd5c8" gracePeriod=30 Jul 24 18:06:25.934699 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:25.934668 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-f94cdf55d-56qb5_19523d3e-9cdb-422d-8c4f-dadaba56bd70/authorino/0.log" Jul 24 18:06:30.506619 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.506593 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" Jul 24 18:06:30.541999 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.541915 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-chnb8\" (UniqueName: \"kubernetes.io/projected/209a5813-0275-4463-97a6-9a8f47493b3f-kube-api-access-chnb8\") pod \"209a5813-0275-4463-97a6-9a8f47493b3f\" (UID: \"209a5813-0275-4463-97a6-9a8f47493b3f\") " Jul 24 18:06:30.541999 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.541972 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/209a5813-0275-4463-97a6-9a8f47493b3f-workload-certs\") pod \"209a5813-0275-4463-97a6-9a8f47493b3f\" (UID: \"209a5813-0275-4463-97a6-9a8f47493b3f\") " Jul 24 18:06:30.542224 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.542002 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/209a5813-0275-4463-97a6-9a8f47493b3f-istiod-ca-cert\") pod \"209a5813-0275-4463-97a6-9a8f47493b3f\" (UID: \"209a5813-0275-4463-97a6-9a8f47493b3f\") " Jul 24 18:06:30.542224 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.542049 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/209a5813-0275-4463-97a6-9a8f47493b3f-istio-podinfo\") pod \"209a5813-0275-4463-97a6-9a8f47493b3f\" (UID: \"209a5813-0275-4463-97a6-9a8f47493b3f\") " Jul 24 18:06:30.542224 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.542078 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/209a5813-0275-4463-97a6-9a8f47493b3f-istio-token\") pod \"209a5813-0275-4463-97a6-9a8f47493b3f\" (UID: \"209a5813-0275-4463-97a6-9a8f47493b3f\") " Jul 24 18:06:30.542224 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.542146 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/209a5813-0275-4463-97a6-9a8f47493b3f-workload-socket\") pod \"209a5813-0275-4463-97a6-9a8f47493b3f\" (UID: \"209a5813-0275-4463-97a6-9a8f47493b3f\") " Jul 24 18:06:30.542224 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.542186 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/209a5813-0275-4463-97a6-9a8f47493b3f-istio-data\") pod \"209a5813-0275-4463-97a6-9a8f47493b3f\" (UID: \"209a5813-0275-4463-97a6-9a8f47493b3f\") " Jul 24 18:06:30.542224 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.542216 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/209a5813-0275-4463-97a6-9a8f47493b3f-credential-socket\") pod \"209a5813-0275-4463-97a6-9a8f47493b3f\" (UID: \"209a5813-0275-4463-97a6-9a8f47493b3f\") " Jul 24 18:06:30.542551 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.542251 2570 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/209a5813-0275-4463-97a6-9a8f47493b3f-istio-envoy\") pod \"209a5813-0275-4463-97a6-9a8f47493b3f\" (UID: \"209a5813-0275-4463-97a6-9a8f47493b3f\") " Jul 24 18:06:30.542551 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.542361 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/209a5813-0275-4463-97a6-9a8f47493b3f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "209a5813-0275-4463-97a6-9a8f47493b3f" (UID: "209a5813-0275-4463-97a6-9a8f47493b3f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 18:06:30.542656 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.542567 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/209a5813-0275-4463-97a6-9a8f47493b3f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "209a5813-0275-4463-97a6-9a8f47493b3f" (UID: "209a5813-0275-4463-97a6-9a8f47493b3f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 18:06:30.542656 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.542594 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/209a5813-0275-4463-97a6-9a8f47493b3f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "209a5813-0275-4463-97a6-9a8f47493b3f" (UID: "209a5813-0275-4463-97a6-9a8f47493b3f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 18:06:30.542757 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.542709 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/209a5813-0275-4463-97a6-9a8f47493b3f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "209a5813-0275-4463-97a6-9a8f47493b3f" (UID: "209a5813-0275-4463-97a6-9a8f47493b3f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 18:06:30.542823 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.542786 2570 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/209a5813-0275-4463-97a6-9a8f47493b3f-workload-socket\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 18:06:30.542823 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.542807 2570 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/209a5813-0275-4463-97a6-9a8f47493b3f-credential-socket\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 18:06:30.542823 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.542819 2570 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/209a5813-0275-4463-97a6-9a8f47493b3f-workload-certs\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 18:06:30.543638 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.543613 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/209a5813-0275-4463-97a6-9a8f47493b3f-istio-data" (OuterVolumeSpecName: "istio-data") pod "209a5813-0275-4463-97a6-9a8f47493b3f" (UID: "209a5813-0275-4463-97a6-9a8f47493b3f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 18:06:30.544541 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.544512 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/209a5813-0275-4463-97a6-9a8f47493b3f-kube-api-access-chnb8" (OuterVolumeSpecName: "kube-api-access-chnb8") pod "209a5813-0275-4463-97a6-9a8f47493b3f" (UID: "209a5813-0275-4463-97a6-9a8f47493b3f"). InnerVolumeSpecName "kube-api-access-chnb8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 18:06:30.544673 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.544651 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/209a5813-0275-4463-97a6-9a8f47493b3f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "209a5813-0275-4463-97a6-9a8f47493b3f" (UID: "209a5813-0275-4463-97a6-9a8f47493b3f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 24 18:06:30.545080 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.545057 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/209a5813-0275-4463-97a6-9a8f47493b3f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "209a5813-0275-4463-97a6-9a8f47493b3f" (UID: "209a5813-0275-4463-97a6-9a8f47493b3f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 18:06:30.545385 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.545365 2570 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/209a5813-0275-4463-97a6-9a8f47493b3f-istio-token" (OuterVolumeSpecName: "istio-token") pod "209a5813-0275-4463-97a6-9a8f47493b3f" (UID: "209a5813-0275-4463-97a6-9a8f47493b3f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 18:06:30.643833 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.643797 2570 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/209a5813-0275-4463-97a6-9a8f47493b3f-istio-podinfo\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 18:06:30.643833 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.643828 2570 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/209a5813-0275-4463-97a6-9a8f47493b3f-istio-token\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 18:06:30.643833 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.643839 2570 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/209a5813-0275-4463-97a6-9a8f47493b3f-istio-data\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 18:06:30.644078 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.643848 2570 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/209a5813-0275-4463-97a6-9a8f47493b3f-istio-envoy\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 18:06:30.644078 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.643856 2570 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-chnb8\" (UniqueName: \"kubernetes.io/projected/209a5813-0275-4463-97a6-9a8f47493b3f-kube-api-access-chnb8\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 18:06:30.644078 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.643864 2570 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/209a5813-0275-4463-97a6-9a8f47493b3f-istiod-ca-cert\") on node \"ip-10-0-141-115.ec2.internal\" DevicePath \"\"" Jul 24 18:06:30.907536 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.907502 2570 generic.go:356] "Generic (PLEG): container finished" podID="209a5813-0275-4463-97a6-9a8f47493b3f" containerID="e7cb3ffcb4a5d52d6a153e949a31e9d2cf501eac7bec647028f5efd1deefd5c8" exitCode=0 Jul 24 18:06:30.907753 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.907628 2570 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" Jul 24 18:06:30.920157 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.920116 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" event={"ID":"209a5813-0275-4463-97a6-9a8f47493b3f","Type":"ContainerDied","Data":"e7cb3ffcb4a5d52d6a153e949a31e9d2cf501eac7bec647028f5efd1deefd5c8"} Jul 24 18:06:30.920353 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.920185 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs" event={"ID":"209a5813-0275-4463-97a6-9a8f47493b3f","Type":"ContainerDied","Data":"e1ef5593949ef34f34c3341fdfe7eeb2a4243c792717ff78a2c75e99ba936029"} Jul 24 18:06:30.920353 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.920210 2570 scope.go:117] "RemoveContainer" containerID="e7cb3ffcb4a5d52d6a153e949a31e9d2cf501eac7bec647028f5efd1deefd5c8" Jul 24 18:06:30.929818 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.929792 2570 scope.go:117] "RemoveContainer" containerID="08b358eb98256522d19c14c3f4aeab17df8e4fbae40a8bb9454734f652831e43" Jul 24 18:06:30.938491 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.938466 2570 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs"] Jul 24 18:06:30.938991 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.938966 2570 scope.go:117] "RemoveContainer" containerID="e7cb3ffcb4a5d52d6a153e949a31e9d2cf501eac7bec647028f5efd1deefd5c8" Jul 24 18:06:30.939385 ip-10-0-141-115 kubenswrapper[2570]: E0724 18:06:30.939326 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7cb3ffcb4a5d52d6a153e949a31e9d2cf501eac7bec647028f5efd1deefd5c8\": container with ID starting with e7cb3ffcb4a5d52d6a153e949a31e9d2cf501eac7bec647028f5efd1deefd5c8 not found: ID does not exist" containerID="e7cb3ffcb4a5d52d6a153e949a31e9d2cf501eac7bec647028f5efd1deefd5c8" Jul 24 18:06:30.939540 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.939511 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7cb3ffcb4a5d52d6a153e949a31e9d2cf501eac7bec647028f5efd1deefd5c8"} err="failed to get container status \"e7cb3ffcb4a5d52d6a153e949a31e9d2cf501eac7bec647028f5efd1deefd5c8\": rpc error: code = NotFound desc = could not find container \"e7cb3ffcb4a5d52d6a153e949a31e9d2cf501eac7bec647028f5efd1deefd5c8\": container with ID starting with e7cb3ffcb4a5d52d6a153e949a31e9d2cf501eac7bec647028f5efd1deefd5c8 not found: ID does not exist" Jul 24 18:06:30.939687 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.939571 2570 scope.go:117] "RemoveContainer" containerID="08b358eb98256522d19c14c3f4aeab17df8e4fbae40a8bb9454734f652831e43" Jul 24 18:06:30.939945 ip-10-0-141-115 kubenswrapper[2570]: E0724 18:06:30.939916 2570 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"08b358eb98256522d19c14c3f4aeab17df8e4fbae40a8bb9454734f652831e43\": container with ID starting with 08b358eb98256522d19c14c3f4aeab17df8e4fbae40a8bb9454734f652831e43 not found: ID does not exist" containerID="08b358eb98256522d19c14c3f4aeab17df8e4fbae40a8bb9454734f652831e43" Jul 24 18:06:30.940031 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.939948 2570 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"08b358eb98256522d19c14c3f4aeab17df8e4fbae40a8bb9454734f652831e43"} err="failed to get container status \"08b358eb98256522d19c14c3f4aeab17df8e4fbae40a8bb9454734f652831e43\": rpc error: code = NotFound desc = could not find container \"08b358eb98256522d19c14c3f4aeab17df8e4fbae40a8bb9454734f652831e43\": container with ID starting with 08b358eb98256522d19c14c3f4aeab17df8e4fbae40a8bb9454734f652831e43 not found: ID does not exist" Jul 24 18:06:30.942108 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:30.942089 2570 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-842768d6-openshift-default-554998dc56-5plcs"] Jul 24 18:06:31.307834 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:31.307753 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-f895w_4ad8d83e-9ca4-428c-a946-c488ae19b5bd/manager/0.log" Jul 24 18:06:31.416318 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:31.416284 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-g4v8b_ee3e514a-4214-42d9-af3e-ea7a04ec833b/manager/0.log" Jul 24 18:06:31.659287 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:31.659259 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-pg8cg_8673e062-6460-4949-a5ea-47edab7b658b/server/0.log" Jul 24 18:06:31.782260 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:31.782228 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-wqlns_f09b18a6-1bb4-4dbe-8844-3cd914ab2119/manager/0.log" Jul 24 18:06:31.899190 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:31.899163 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6_bcefe486-3f20-4ee8-8a1c-07e898c7dac7/copy-manifests/0.log" Jul 24 18:06:31.908635 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:31.908611 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6_bcefe486-3f20-4ee8-8a1c-07e898c7dac7/manager/0.log" Jul 24 18:06:32.794055 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:32.794030 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29748585-qrrq5_9bd6f082-4cb7-4fe2-9ce1-50b3f2dc879a/cleanup/0.log" Jul 24 18:06:32.914209 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:32.914176 2570 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="209a5813-0275-4463-97a6-9a8f47493b3f" path="/var/lib/kubelet/pods/209a5813-0275-4463-97a6-9a8f47493b3f/volumes" Jul 24 18:06:33.750900 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:33.750867 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rpkht_63c97bbf-d9b4-423a-990a-b1c1737e58d8/extract/0.log" Jul 24 18:06:33.758684 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:33.758658 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rpkht_63c97bbf-d9b4-423a-990a-b1c1737e58d8/util/0.log" Jul 24 18:06:33.768487 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:33.768467 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rpkht_63c97bbf-d9b4-423a-990a-b1c1737e58d8/pull/0.log" Jul 24 18:06:33.881416 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:33.881380 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qchvs_a7b5f426-51f9-419e-87bf-adbeb31f99e0/util/0.log" Jul 24 18:06:33.890660 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:33.890633 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qchvs_a7b5f426-51f9-419e-87bf-adbeb31f99e0/pull/0.log" Jul 24 18:06:33.900123 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:33.900101 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qchvs_a7b5f426-51f9-419e-87bf-adbeb31f99e0/extract/0.log" Jul 24 18:06:34.021599 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:34.021516 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ss2tc_21e16a0d-c14b-4db4-b1ac-77774ab24b32/extract/0.log" Jul 24 18:06:34.036446 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:34.036425 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ss2tc_21e16a0d-c14b-4db4-b1ac-77774ab24b32/util/0.log" Jul 24 18:06:34.064301 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:34.064275 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ss2tc_21e16a0d-c14b-4db4-b1ac-77774ab24b32/pull/0.log" Jul 24 18:06:34.178685 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:34.178654 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dct6g_e0f39cbb-82fc-4d2d-9ab9-1cb173525bed/util/0.log" Jul 24 18:06:34.186981 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:34.186959 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dct6g_e0f39cbb-82fc-4d2d-9ab9-1cb173525bed/pull/0.log" Jul 24 18:06:34.196636 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:34.196620 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dct6g_e0f39cbb-82fc-4d2d-9ab9-1cb173525bed/extract/0.log" Jul 24 18:06:34.313434 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:34.313362 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-f94cdf55d-56qb5_19523d3e-9cdb-422d-8c4f-dadaba56bd70/authorino/0.log" Jul 24 18:06:34.443635 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:34.443604 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-ztqgj_66c2753a-ca06-456e-b3b7-726c7ec94a05/manager/0.log" Jul 24 18:06:34.556797 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:34.556761 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-95vrj_ee47cea9-c3dd-4d4d-9e4a-0ac86875ae7f/manager/0.log" Jul 24 18:06:34.674567 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:34.674538 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-nvszp_28cd9d64-e35f-488d-a15b-33c00bfccf6d/kuadrant-console-plugin/0.log" Jul 24 18:06:34.794590 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:34.794565 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-hb7fp_e39c3c22-3d43-4317-9b60-575e85e03ffa/registry-server/0.log" Jul 24 18:06:34.916872 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:34.916842 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-vnk9j_e34ed7ba-d9d0-49c0-9e37-6cf4022074f6/manager/0.log" Jul 24 18:06:35.176930 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:35.176900 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-kglgk_3174426f-1bf6-43ce-90f8-0abc78e55c2c/manager/0.log" Jul 24 18:06:35.525005 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:35.524929 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd_423cdcad-b5fb-4eb1-b896-fe235a7bb0fe/istio-proxy/0.log" Jul 24 18:06:35.750857 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:35.750826 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bd989cf94-psc42_78a4bd00-791d-4dea-b8bb-18b39dca5133/kube-auth-proxy/0.log" Jul 24 18:06:35.979375 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:35.979341 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-njznb_20e6590f-5bb5-4797-9234-900b1ad54681/istio-proxy/1.log" Jul 24 18:06:36.917877 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:36.917851 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-2rl2q_20459e57-7eaf-4840-8cfb-8cbcf7cad816/main/0.log" Jul 24 18:06:42.259549 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:42.259512 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5wz2s/must-gather-6z4sv"] Jul 24 18:06:42.259897 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:42.259890 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b8d2168-7901-49ca-b6d1-a14abc699904" containerName="istio-proxy" Jul 24 18:06:42.259938 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:42.259900 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b8d2168-7901-49ca-b6d1-a14abc699904" containerName="istio-proxy" Jul 24 18:06:42.259938 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:42.259923 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="209a5813-0275-4463-97a6-9a8f47493b3f" containerName="istio-proxy" Jul 24 18:06:42.259938 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:42.259928 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="209a5813-0275-4463-97a6-9a8f47493b3f" containerName="istio-proxy" Jul 24 18:06:42.259938 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:42.259935 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="209a5813-0275-4463-97a6-9a8f47493b3f" containerName="istio-proxy" Jul 24 18:06:42.260068 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:42.259942 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="209a5813-0275-4463-97a6-9a8f47493b3f" containerName="istio-proxy" Jul 24 18:06:42.260068 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:42.260005 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b8d2168-7901-49ca-b6d1-a14abc699904" containerName="istio-proxy" Jul 24 18:06:42.260068 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:42.260014 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="209a5813-0275-4463-97a6-9a8f47493b3f" containerName="istio-proxy" Jul 24 18:06:42.260068 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:42.260021 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="209a5813-0275-4463-97a6-9a8f47493b3f" containerName="istio-proxy" Jul 24 18:06:42.260182 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:42.260089 2570 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b8d2168-7901-49ca-b6d1-a14abc699904" containerName="istio-proxy" Jul 24 18:06:42.260182 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:42.260095 2570 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b8d2168-7901-49ca-b6d1-a14abc699904" containerName="istio-proxy" Jul 24 18:06:42.260182 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:42.260152 2570 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b8d2168-7901-49ca-b6d1-a14abc699904" containerName="istio-proxy" Jul 24 18:06:42.262125 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:42.262105 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5wz2s/must-gather-6z4sv" Jul 24 18:06:42.264967 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:42.264945 2570 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-5wz2s\"/\"default-dockercfg-85krf\"" Jul 24 18:06:42.265448 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:42.265426 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5wz2s\"/\"kube-root-ca.crt\"" Jul 24 18:06:42.266104 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:42.266086 2570 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-5wz2s\"/\"openshift-service-ca.crt\"" Jul 24 18:06:42.276807 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:42.276787 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5wz2s/must-gather-6z4sv"] Jul 24 18:06:42.345850 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:42.345820 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8dbe180c-5323-4967-bd59-ad85cdccf14c-must-gather-output\") pod \"must-gather-6z4sv\" (UID: \"8dbe180c-5323-4967-bd59-ad85cdccf14c\") " pod="openshift-must-gather-5wz2s/must-gather-6z4sv" Jul 24 18:06:42.345967 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:42.345853 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jxgj7\" (UniqueName: \"kubernetes.io/projected/8dbe180c-5323-4967-bd59-ad85cdccf14c-kube-api-access-jxgj7\") pod \"must-gather-6z4sv\" (UID: \"8dbe180c-5323-4967-bd59-ad85cdccf14c\") " pod="openshift-must-gather-5wz2s/must-gather-6z4sv" Jul 24 18:06:42.446400 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:42.446372 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8dbe180c-5323-4967-bd59-ad85cdccf14c-must-gather-output\") pod \"must-gather-6z4sv\" (UID: \"8dbe180c-5323-4967-bd59-ad85cdccf14c\") " pod="openshift-must-gather-5wz2s/must-gather-6z4sv" Jul 24 18:06:42.446530 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:42.446404 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jxgj7\" (UniqueName: \"kubernetes.io/projected/8dbe180c-5323-4967-bd59-ad85cdccf14c-kube-api-access-jxgj7\") pod \"must-gather-6z4sv\" (UID: \"8dbe180c-5323-4967-bd59-ad85cdccf14c\") " pod="openshift-must-gather-5wz2s/must-gather-6z4sv" Jul 24 18:06:42.446710 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:42.446689 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/8dbe180c-5323-4967-bd59-ad85cdccf14c-must-gather-output\") pod \"must-gather-6z4sv\" (UID: \"8dbe180c-5323-4967-bd59-ad85cdccf14c\") " pod="openshift-must-gather-5wz2s/must-gather-6z4sv" Jul 24 18:06:42.455972 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:42.455952 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jxgj7\" (UniqueName: \"kubernetes.io/projected/8dbe180c-5323-4967-bd59-ad85cdccf14c-kube-api-access-jxgj7\") pod \"must-gather-6z4sv\" (UID: \"8dbe180c-5323-4967-bd59-ad85cdccf14c\") " pod="openshift-must-gather-5wz2s/must-gather-6z4sv" Jul 24 18:06:42.571672 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:42.571609 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5wz2s/must-gather-6z4sv" Jul 24 18:06:42.708229 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:42.708205 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5wz2s/must-gather-6z4sv"] Jul 24 18:06:42.709529 ip-10-0-141-115 kubenswrapper[2570]: W0724 18:06:42.709502 2570 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8dbe180c_5323_4967_bd59_ad85cdccf14c.slice/crio-ddebfcf2d1208cc43fa6a056def99c4efaa8bd6ea2124d6b2aba25bf2f5d87a6 WatchSource:0}: Error finding container ddebfcf2d1208cc43fa6a056def99c4efaa8bd6ea2124d6b2aba25bf2f5d87a6: Status 404 returned error can't find the container with id ddebfcf2d1208cc43fa6a056def99c4efaa8bd6ea2124d6b2aba25bf2f5d87a6 Jul 24 18:06:42.711659 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:42.711641 2570 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 18:06:42.974567 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:42.974539 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5wz2s/must-gather-6z4sv" event={"ID":"8dbe180c-5323-4967-bd59-ad85cdccf14c","Type":"ContainerStarted","Data":"ddebfcf2d1208cc43fa6a056def99c4efaa8bd6ea2124d6b2aba25bf2f5d87a6"} Jul 24 18:06:43.982926 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:43.982887 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5wz2s/must-gather-6z4sv" event={"ID":"8dbe180c-5323-4967-bd59-ad85cdccf14c","Type":"ContainerStarted","Data":"4cbdbb4e20fad36e533c3337cb7c7f54b84f729c803111615ec759e8b4acfd0d"} Jul 24 18:06:43.983292 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:43.982942 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5wz2s/must-gather-6z4sv" event={"ID":"8dbe180c-5323-4967-bd59-ad85cdccf14c","Type":"ContainerStarted","Data":"ec18d7a3d385df4c29af075d5f087460fc470750649984024fb2132bb48c9d67"} Jul 24 18:06:44.004940 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:44.004878 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5wz2s/must-gather-6z4sv" podStartSLOduration=1.3390901259999999 podStartE2EDuration="2.004858909s" totalImagesPullingTime="665.768783ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 18:06:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:06:44.002570483 +0000 UTC m=+2799.670981507" watchObservedRunningTime="2026-07-24 18:06:44.004858909 +0000 UTC m=+2799.673269933" Jul 24 18:06:45.045936 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:45.045906 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7smjt_8dd24b3b-de29-4d73-9b9a-519287ab38c0/global-pull-secret-syncer/0.log" Jul 24 18:06:45.237797 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:45.237767 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-fqhxk_bcf29f60-9cc0-40b2-906e-774225ebf9ad/konnectivity-agent/0.log" Jul 24 18:06:45.325619 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:45.325548 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-115.ec2.internal_18378e7a938206fd65fc7da834e2352c/haproxy/0.log" Jul 24 18:06:49.679210 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:49.679185 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rpkht_63c97bbf-d9b4-423a-990a-b1c1737e58d8/extract/0.log" Jul 24 18:06:49.706758 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:49.706734 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rpkht_63c97bbf-d9b4-423a-990a-b1c1737e58d8/util/0.log" Jul 24 18:06:49.732890 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:49.732850 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759rpkht_63c97bbf-d9b4-423a-990a-b1c1737e58d8/pull/0.log" Jul 24 18:06:49.770877 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:49.770853 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qchvs_a7b5f426-51f9-419e-87bf-adbeb31f99e0/extract/0.log" Jul 24 18:06:49.798872 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:49.798839 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qchvs_a7b5f426-51f9-419e-87bf-adbeb31f99e0/util/0.log" Jul 24 18:06:49.828714 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:49.828664 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0qchvs_a7b5f426-51f9-419e-87bf-adbeb31f99e0/pull/0.log" Jul 24 18:06:49.859869 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:49.859845 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ss2tc_21e16a0d-c14b-4db4-b1ac-77774ab24b32/extract/0.log" Jul 24 18:06:49.884481 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:49.884446 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ss2tc_21e16a0d-c14b-4db4-b1ac-77774ab24b32/util/0.log" Jul 24 18:06:49.914637 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:49.914531 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73ss2tc_21e16a0d-c14b-4db4-b1ac-77774ab24b32/pull/0.log" Jul 24 18:06:49.951549 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:49.951455 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dct6g_e0f39cbb-82fc-4d2d-9ab9-1cb173525bed/extract/0.log" Jul 24 18:06:49.981536 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:49.981504 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dct6g_e0f39cbb-82fc-4d2d-9ab9-1cb173525bed/util/0.log" Jul 24 18:06:50.013108 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:50.013073 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1dct6g_e0f39cbb-82fc-4d2d-9ab9-1cb173525bed/pull/0.log" Jul 24 18:06:50.331948 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:50.331828 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-f94cdf55d-56qb5_19523d3e-9cdb-422d-8c4f-dadaba56bd70/authorino/0.log" Jul 24 18:06:50.385306 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:50.385256 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-ztqgj_66c2753a-ca06-456e-b3b7-726c7ec94a05/manager/0.log" Jul 24 18:06:50.423481 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:50.423415 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-95vrj_ee47cea9-c3dd-4d4d-9e4a-0ac86875ae7f/manager/0.log" Jul 24 18:06:50.455853 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:50.455820 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-nvszp_28cd9d64-e35f-488d-a15b-33c00bfccf6d/kuadrant-console-plugin/0.log" Jul 24 18:06:50.507102 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:50.507070 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-hb7fp_e39c3c22-3d43-4317-9b60-575e85e03ffa/registry-server/0.log" Jul 24 18:06:50.661355 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:50.648424 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-vnk9j_e34ed7ba-d9d0-49c0-9e37-6cf4022074f6/manager/0.log" Jul 24 18:06:50.750269 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:50.750233 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-kglgk_3174426f-1bf6-43ce-90f8-0abc78e55c2c/manager/0.log" Jul 24 18:06:52.773749 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:52.773715 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-svd9m_aa0f5571-f91b-404f-b68d-08459015cf14/kube-state-metrics/0.log" Jul 24 18:06:52.801020 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:52.800992 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-svd9m_aa0f5571-f91b-404f-b68d-08459015cf14/kube-rbac-proxy-main/0.log" Jul 24 18:06:52.826998 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:52.826975 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-svd9m_aa0f5571-f91b-404f-b68d-08459015cf14/kube-rbac-proxy-self/0.log" Jul 24 18:06:52.940718 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:52.940647 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bwxn7_a3fef7c5-29be-4c9c-8f7e-c3256ed730b2/node-exporter/0.log" Jul 24 18:06:52.963972 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:52.963951 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bwxn7_a3fef7c5-29be-4c9c-8f7e-c3256ed730b2/kube-rbac-proxy/0.log" Jul 24 18:06:52.998024 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:52.998001 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bwxn7_a3fef7c5-29be-4c9c-8f7e-c3256ed730b2/init-textfile/0.log" Jul 24 18:06:53.193144 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:53.193109 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-w56p6_85035b30-6f00-407e-99b1-c3eae43f6950/kube-rbac-proxy-main/0.log" Jul 24 18:06:53.219379 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:53.219327 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-w56p6_85035b30-6f00-407e-99b1-c3eae43f6950/kube-rbac-proxy-self/0.log" Jul 24 18:06:53.247905 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:53.247855 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-w56p6_85035b30-6f00-407e-99b1-c3eae43f6950/openshift-state-metrics/0.log" Jul 24 18:06:53.532292 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:53.532212 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-gnmr5_1be59003-7ba3-4f21-a4c2-e07549584507/prometheus-operator/0.log" Jul 24 18:06:53.558763 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:53.558730 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-gnmr5_1be59003-7ba3-4f21-a4c2-e07549584507/kube-rbac-proxy/0.log" Jul 24 18:06:53.591386 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:53.591314 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-7f8d78f54b-cszt2_d7dbcd57-7669-4990-81f5-bfe66052ac67/prometheus-operator-admission-webhook/0.log" Jul 24 18:06:53.632199 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:53.632151 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6b449d66d7-cvb9n_4b9781aa-7018-4d87-9d63-d8a2c3c1b24d/telemeter-client/0.log" Jul 24 18:06:53.660421 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:53.660395 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6b449d66d7-cvb9n_4b9781aa-7018-4d87-9d63-d8a2c3c1b24d/reload/0.log" Jul 24 18:06:53.688221 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:53.688192 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6b449d66d7-cvb9n_4b9781aa-7018-4d87-9d63-d8a2c3c1b24d/kube-rbac-proxy/0.log" Jul 24 18:06:54.829180 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:54.829147 2570 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-5wz2s/perf-node-gather-daemonset-scfzr"] Jul 24 18:06:54.834971 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:54.834943 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5wz2s/perf-node-gather-daemonset-scfzr" Jul 24 18:06:54.844438 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:54.844409 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5wz2s/perf-node-gather-daemonset-scfzr"] Jul 24 18:06:54.989117 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:54.989087 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1ade682c-a6d2-463b-9373-19216cf11e41-proc\") pod \"perf-node-gather-daemonset-scfzr\" (UID: \"1ade682c-a6d2-463b-9373-19216cf11e41\") " pod="openshift-must-gather-5wz2s/perf-node-gather-daemonset-scfzr" Jul 24 18:06:54.989313 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:54.989134 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1ade682c-a6d2-463b-9373-19216cf11e41-lib-modules\") pod \"perf-node-gather-daemonset-scfzr\" (UID: \"1ade682c-a6d2-463b-9373-19216cf11e41\") " pod="openshift-must-gather-5wz2s/perf-node-gather-daemonset-scfzr" Jul 24 18:06:54.989313 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:54.989265 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htnwl\" (UniqueName: \"kubernetes.io/projected/1ade682c-a6d2-463b-9373-19216cf11e41-kube-api-access-htnwl\") pod \"perf-node-gather-daemonset-scfzr\" (UID: \"1ade682c-a6d2-463b-9373-19216cf11e41\") " pod="openshift-must-gather-5wz2s/perf-node-gather-daemonset-scfzr" Jul 24 18:06:54.989313 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:54.989290 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ade682c-a6d2-463b-9373-19216cf11e41-sys\") pod \"perf-node-gather-daemonset-scfzr\" (UID: \"1ade682c-a6d2-463b-9373-19216cf11e41\") " pod="openshift-must-gather-5wz2s/perf-node-gather-daemonset-scfzr" Jul 24 18:06:54.989520 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:54.989321 2570 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1ade682c-a6d2-463b-9373-19216cf11e41-podres\") pod \"perf-node-gather-daemonset-scfzr\" (UID: \"1ade682c-a6d2-463b-9373-19216cf11e41\") " pod="openshift-must-gather-5wz2s/perf-node-gather-daemonset-scfzr" Jul 24 18:06:55.091149 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:55.091060 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1ade682c-a6d2-463b-9373-19216cf11e41-proc\") pod \"perf-node-gather-daemonset-scfzr\" (UID: \"1ade682c-a6d2-463b-9373-19216cf11e41\") " pod="openshift-must-gather-5wz2s/perf-node-gather-daemonset-scfzr" Jul 24 18:06:55.091149 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:55.091134 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1ade682c-a6d2-463b-9373-19216cf11e41-lib-modules\") pod \"perf-node-gather-daemonset-scfzr\" (UID: \"1ade682c-a6d2-463b-9373-19216cf11e41\") " pod="openshift-must-gather-5wz2s/perf-node-gather-daemonset-scfzr" Jul 24 18:06:55.091409 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:55.091227 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htnwl\" (UniqueName: \"kubernetes.io/projected/1ade682c-a6d2-463b-9373-19216cf11e41-kube-api-access-htnwl\") pod \"perf-node-gather-daemonset-scfzr\" (UID: \"1ade682c-a6d2-463b-9373-19216cf11e41\") " pod="openshift-must-gather-5wz2s/perf-node-gather-daemonset-scfzr" Jul 24 18:06:55.091409 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:55.091258 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ade682c-a6d2-463b-9373-19216cf11e41-sys\") pod \"perf-node-gather-daemonset-scfzr\" (UID: \"1ade682c-a6d2-463b-9373-19216cf11e41\") " pod="openshift-must-gather-5wz2s/perf-node-gather-daemonset-scfzr" Jul 24 18:06:55.091409 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:55.091291 2570 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1ade682c-a6d2-463b-9373-19216cf11e41-podres\") pod \"perf-node-gather-daemonset-scfzr\" (UID: \"1ade682c-a6d2-463b-9373-19216cf11e41\") " pod="openshift-must-gather-5wz2s/perf-node-gather-daemonset-scfzr" Jul 24 18:06:55.091575 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:55.091509 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/1ade682c-a6d2-463b-9373-19216cf11e41-podres\") pod \"perf-node-gather-daemonset-scfzr\" (UID: \"1ade682c-a6d2-463b-9373-19216cf11e41\") " pod="openshift-must-gather-5wz2s/perf-node-gather-daemonset-scfzr" Jul 24 18:06:55.091630 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:55.091577 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/1ade682c-a6d2-463b-9373-19216cf11e41-proc\") pod \"perf-node-gather-daemonset-scfzr\" (UID: \"1ade682c-a6d2-463b-9373-19216cf11e41\") " pod="openshift-must-gather-5wz2s/perf-node-gather-daemonset-scfzr" Jul 24 18:06:55.091710 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:55.091690 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/1ade682c-a6d2-463b-9373-19216cf11e41-lib-modules\") pod \"perf-node-gather-daemonset-scfzr\" (UID: \"1ade682c-a6d2-463b-9373-19216cf11e41\") " pod="openshift-must-gather-5wz2s/perf-node-gather-daemonset-scfzr" Jul 24 18:06:55.092057 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:55.092027 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1ade682c-a6d2-463b-9373-19216cf11e41-sys\") pod \"perf-node-gather-daemonset-scfzr\" (UID: \"1ade682c-a6d2-463b-9373-19216cf11e41\") " pod="openshift-must-gather-5wz2s/perf-node-gather-daemonset-scfzr" Jul 24 18:06:55.102572 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:55.102518 2570 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htnwl\" (UniqueName: \"kubernetes.io/projected/1ade682c-a6d2-463b-9373-19216cf11e41-kube-api-access-htnwl\") pod \"perf-node-gather-daemonset-scfzr\" (UID: \"1ade682c-a6d2-463b-9373-19216cf11e41\") " pod="openshift-must-gather-5wz2s/perf-node-gather-daemonset-scfzr" Jul 24 18:06:55.149949 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:55.149920 2570 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-5wz2s/perf-node-gather-daemonset-scfzr" Jul 24 18:06:55.369369 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:55.368890 2570 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-5wz2s/perf-node-gather-daemonset-scfzr"] Jul 24 18:06:56.077927 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:56.077890 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5wz2s/perf-node-gather-daemonset-scfzr" event={"ID":"1ade682c-a6d2-463b-9373-19216cf11e41","Type":"ContainerStarted","Data":"88418ab507babb5ebe175bff2249c8e7217bdcfd67045859cdd4cf52a416d00f"} Jul 24 18:06:56.078452 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:56.077955 2570 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-5wz2s/perf-node-gather-daemonset-scfzr" event={"ID":"1ade682c-a6d2-463b-9373-19216cf11e41","Type":"ContainerStarted","Data":"09d387c6bb7fcdb80f4742f67ed36b7af631263fd9a8e81abf648add3380aab4"} Jul 24 18:06:56.078452 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:56.077997 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-5wz2s/perf-node-gather-daemonset-scfzr" Jul 24 18:06:56.113356 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:56.110952 2570 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-5wz2s/perf-node-gather-daemonset-scfzr" podStartSLOduration=2.110932003 podStartE2EDuration="2.110932003s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 18:06:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 18:06:56.109461975 +0000 UTC m=+2811.777873000" watchObservedRunningTime="2026-07-24 18:06:56.110932003 +0000 UTC m=+2811.779343028" Jul 24 18:06:56.299397 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:56.299307 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-8467dcb8cc-jtg6w_f1b60958-6a16-4413-9571-a41f3d8247e1/console/0.log" Jul 24 18:06:56.335713 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:56.335620 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-bl5xg_078115f0-2fb4-4cc2-89a0-74c58e7d79fa/download-server/0.log" Jul 24 18:06:57.982658 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:57.982630 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qsn2t_009f5e78-050b-4c16-8cb3-14dea0ea93ef/dns/0.log" Jul 24 18:06:58.014901 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:58.014863 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qsn2t_009f5e78-050b-4c16-8cb3-14dea0ea93ef/kube-rbac-proxy/0.log" Jul 24 18:06:58.206924 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:58.206894 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jj8qn_0d218512-e801-4d6e-8f09-bd0ee5a815d9/dns-node-resolver/0.log" Jul 24 18:06:58.773909 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:58.773877 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-69489f8bf8-tmxrk_017adad1-4a9a-4d09-8c33-4f612c9cbd5b/registry/0.log" Jul 24 18:06:58.886567 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:58.886540 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-qc64j_57db7dd7-3eed-4936-818f-0fcf8d031c0f/node-ca/0.log" Jul 24 18:06:59.908382 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:06:59.908348 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd_423cdcad-b5fb-4eb1-b896-fe235a7bb0fe/istio-proxy/0.log" Jul 24 18:07:00.047184 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:07:00.047160 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bd989cf94-psc42_78a4bd00-791d-4dea-b8bb-18b39dca5133/kube-auth-proxy/0.log" Jul 24 18:07:00.109185 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:07:00.109160 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-njznb_20e6590f-5bb5-4797-9234-900b1ad54681/istio-proxy/0.log" Jul 24 18:07:00.142692 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:07:00.142663 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-njznb_20e6590f-5bb5-4797-9234-900b1ad54681/istio-proxy/1.log" Jul 24 18:07:01.019881 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:07:01.019853 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-qjpvd_1b2b7518-d0bb-4993-abb8-ac53aaba9825/serve-healthcheck-canary/0.log" Jul 24 18:07:01.619926 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:07:01.619856 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nbhc9_2ee78578-9e17-4d87-99bc-9eb4c154fcc7/kube-rbac-proxy/0.log" Jul 24 18:07:01.669000 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:07:01.668974 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nbhc9_2ee78578-9e17-4d87-99bc-9eb4c154fcc7/exporter/0.log" Jul 24 18:07:01.712039 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:07:01.712013 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nbhc9_2ee78578-9e17-4d87-99bc-9eb4c154fcc7/extractor/0.log" Jul 24 18:07:02.095385 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:07:02.095288 2570 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-5wz2s/perf-node-gather-daemonset-scfzr" Jul 24 18:07:04.338593 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:07:04.338507 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-f895w_4ad8d83e-9ca4-428c-a946-c488ae19b5bd/manager/0.log" Jul 24 18:07:04.456254 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:07:04.456216 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-g4v8b_ee3e514a-4214-42d9-af3e-ea7a04ec833b/manager/0.log" Jul 24 18:07:04.596998 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:07:04.596902 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-pg8cg_8673e062-6460-4949-a5ea-47edab7b658b/server/0.log" Jul 24 18:07:04.693459 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:07:04.693158 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-wqlns_f09b18a6-1bb4-4dbe-8844-3cd914ab2119/manager/0.log" Jul 24 18:07:04.746537 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:07:04.746508 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6_bcefe486-3f20-4ee8-8a1c-07e898c7dac7/manager/0.log" Jul 24 18:07:04.777889 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:07:04.777864 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dc5bcb4dc-ctxw6_bcefe486-3f20-4ee8-8a1c-07e898c7dac7/copy-manifests/0.log" Jul 24 18:07:05.368881 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:07:05.368852 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd_423cdcad-b5fb-4eb1-b896-fe235a7bb0fe/istio-proxy/0.log" Jul 24 18:07:05.496106 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:07:05.496076 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bd989cf94-psc42_78a4bd00-791d-4dea-b8bb-18b39dca5133/kube-auth-proxy/0.log" Jul 24 18:07:05.555224 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:07:05.555197 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-njznb_20e6590f-5bb5-4797-9234-900b1ad54681/istio-proxy/0.log" Jul 24 18:07:05.591886 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:07:05.591861 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-njznb_20e6590f-5bb5-4797-9234-900b1ad54681/istio-proxy/1.log" Jul 24 18:07:06.403998 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:07:06.403961 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-xlft4_053433c7-574d-4963-8c31-20e7d6dd7353/openshift-lws-operator/0.log" Jul 24 18:07:06.965927 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:07:06.965895 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799ch7nzd_423cdcad-b5fb-4eb1-b896-fe235a7bb0fe/istio-proxy/0.log" Jul 24 18:07:07.084080 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:07:07.083981 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bd989cf94-psc42_78a4bd00-791d-4dea-b8bb-18b39dca5133/kube-auth-proxy/0.log" Jul 24 18:07:07.135509 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:07:07.135471 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-njznb_20e6590f-5bb5-4797-9234-900b1ad54681/istio-proxy/0.log" Jul 24 18:07:07.170119 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:07:07.170092 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-njznb_20e6590f-5bb5-4797-9234-900b1ad54681/istio-proxy/1.log" Jul 24 18:07:11.406983 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:07:11.406954 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-xtlwj_71b354f3-6c11-4552-908a-29dee8a42c94/migrator/0.log" Jul 24 18:07:11.432601 ip-10-0-141-115 kubenswrapper[2570]: I0724 18:07:11.432573 2570 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-xtlwj_71b354f3-6c11-4552-908a-29dee8a42c94/graceful-termination/0.log"