Jul 12 19:20:28.412575 ip-10-0-137-63 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 12 19:20:28.412586 ip-10-0-137-63 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 12 19:20:28.412592 ip-10-0-137-63 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 12 19:20:28.412804 ip-10-0-137-63 systemd[1]: Failed to start Kubernetes Kubelet. Jul 12 19:20:38.662264 ip-10-0-137-63 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 12 19:20:38.662279 ip-10-0-137-63 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 6c1425eaf4a8469587754240c7b58941 -- Jul 12 19:22:08.414263 ip-10-0-137-63 systemd[1]: Starting Kubernetes Kubelet... Jul 12 19:22:08.901367 ip-10-0-137-63 kubenswrapper[2576]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 12 19:22:08.901367 ip-10-0-137-63 kubenswrapper[2576]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 12 19:22:08.901367 ip-10-0-137-63 kubenswrapper[2576]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 12 19:22:08.901367 ip-10-0-137-63 kubenswrapper[2576]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 12 19:22:08.901367 ip-10-0-137-63 kubenswrapper[2576]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 12 19:22:08.901367 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.890507 2576 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 12 19:22:08.901367 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895076 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 12 19:22:08.901367 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895090 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 12 19:22:08.901367 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895094 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 12 19:22:08.901367 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895098 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 12 19:22:08.901367 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895102 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 12 19:22:08.901367 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895105 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 12 19:22:08.901367 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895108 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 12 19:22:08.903766 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895111 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 12 19:22:08.903766 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895113 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 12 19:22:08.903766 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895116 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 12 19:22:08.903766 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895119 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 12 19:22:08.903766 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895122 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 12 19:22:08.903766 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895125 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 12 19:22:08.903766 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895127 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 12 19:22:08.903766 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895138 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 12 19:22:08.903766 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895141 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 12 19:22:08.903766 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895144 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 12 19:22:08.903766 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895147 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 12 19:22:08.903766 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895149 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 12 19:22:08.903766 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895152 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 12 19:22:08.903766 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895155 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 12 19:22:08.903766 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895158 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 12 19:22:08.903766 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895160 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 12 19:22:08.903766 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895163 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 12 19:22:08.903766 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895167 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 12 19:22:08.903766 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895170 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 12 19:22:08.903766 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895173 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 12 19:22:08.912842 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895176 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 12 19:22:08.912842 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895178 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 12 19:22:08.912842 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895181 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 12 19:22:08.912842 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895183 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 12 19:22:08.912842 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895186 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 12 19:22:08.912842 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895188 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 12 19:22:08.912842 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895191 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 12 19:22:08.912842 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895193 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 12 19:22:08.912842 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895196 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 12 19:22:08.912842 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895198 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 12 19:22:08.912842 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895203 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 12 19:22:08.912842 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895207 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 12 19:22:08.912842 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895210 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 12 19:22:08.912842 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895213 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 12 19:22:08.912842 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895216 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 12 19:22:08.912842 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895219 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 12 19:22:08.912842 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895222 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 12 19:22:08.912842 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895224 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 12 19:22:08.912842 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895226 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 12 19:22:08.912842 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895237 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 12 19:22:08.915107 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895241 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 12 19:22:08.915107 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895243 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 12 19:22:08.915107 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895246 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 12 19:22:08.915107 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895248 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 12 19:22:08.915107 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895253 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 12 19:22:08.915107 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895257 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 12 19:22:08.915107 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895260 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 12 19:22:08.915107 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895263 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 12 19:22:08.915107 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895266 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 12 19:22:08.915107 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895269 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 12 19:22:08.915107 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895271 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 12 19:22:08.915107 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895274 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 12 19:22:08.915107 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895278 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 12 19:22:08.915107 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895281 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 12 19:22:08.915107 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895283 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 12 19:22:08.915107 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895286 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 12 19:22:08.915107 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895289 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 12 19:22:08.915107 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895291 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 12 19:22:08.915107 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895294 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 12 19:22:08.915107 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895297 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 12 19:22:08.920818 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895299 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 12 19:22:08.920818 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895302 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 12 19:22:08.920818 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895304 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 12 19:22:08.920818 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895307 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 12 19:22:08.920818 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895309 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 12 19:22:08.920818 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895312 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 12 19:22:08.920818 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895315 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 12 19:22:08.920818 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895317 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 12 19:22:08.920818 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895319 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 12 19:22:08.920818 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895322 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 12 19:22:08.920818 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895324 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 12 19:22:08.920818 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895327 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 12 19:22:08.920818 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895329 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 12 19:22:08.920818 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895333 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 12 19:22:08.920818 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895336 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 12 19:22:08.920818 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895338 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 12 19:22:08.920818 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895341 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 12 19:22:08.920818 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895345 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 12 19:22:08.920818 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895347 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 12 19:22:08.920818 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895350 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 12 19:22:08.924578 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895353 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 12 19:22:08.924578 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895356 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 12 19:22:08.924578 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895359 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 12 19:22:08.924578 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895361 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 12 19:22:08.924578 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895364 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 12 19:22:08.924578 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895366 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 12 19:22:08.924578 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895368 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 12 19:22:08.924578 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895371 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 12 19:22:08.924578 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895373 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 12 19:22:08.924578 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895376 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 12 19:22:08.924578 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895378 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 12 19:22:08.924578 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.895381 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 12 19:22:08.924578 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896124 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 12 19:22:08.924578 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896131 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 12 19:22:08.924578 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896134 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 12 19:22:08.924578 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896137 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 12 19:22:08.924578 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896141 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 12 19:22:08.924578 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896145 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 12 19:22:08.924578 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896149 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 12 19:22:08.928859 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896153 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 12 19:22:08.928859 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896156 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 12 19:22:08.928859 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896159 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 12 19:22:08.928859 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896163 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 12 19:22:08.928859 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896165 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 12 19:22:08.928859 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896168 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 12 19:22:08.928859 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896171 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 12 19:22:08.928859 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896175 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 12 19:22:08.928859 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896177 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 12 19:22:08.928859 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896180 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 12 19:22:08.928859 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896183 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 12 19:22:08.928859 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896186 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 12 19:22:08.928859 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896188 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 12 19:22:08.928859 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896192 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 12 19:22:08.928859 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896194 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 12 19:22:08.928859 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896197 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 12 19:22:08.928859 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896199 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 12 19:22:08.928859 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896202 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 12 19:22:08.928859 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896205 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 12 19:22:08.936194 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896208 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 12 19:22:08.936194 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896210 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 12 19:22:08.936194 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896213 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 12 19:22:08.936194 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896215 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 12 19:22:08.936194 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896218 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 12 19:22:08.936194 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896220 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 12 19:22:08.936194 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896224 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 12 19:22:08.936194 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896226 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 12 19:22:08.936194 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896229 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 12 19:22:08.936194 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896232 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 12 19:22:08.936194 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896234 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 12 19:22:08.936194 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896237 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 12 19:22:08.936194 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896240 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 12 19:22:08.936194 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896242 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 12 19:22:08.936194 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896245 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 12 19:22:08.936194 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896247 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 12 19:22:08.936194 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896250 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 12 19:22:08.936194 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896253 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 12 19:22:08.936194 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896256 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 12 19:22:08.936194 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896258 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 12 19:22:08.936964 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896261 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 12 19:22:08.936964 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896265 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 12 19:22:08.936964 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896268 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 12 19:22:08.936964 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896271 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 12 19:22:08.936964 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896274 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 12 19:22:08.936964 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896276 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 12 19:22:08.936964 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896279 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 12 19:22:08.936964 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896282 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 12 19:22:08.936964 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896285 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 12 19:22:08.936964 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896287 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 12 19:22:08.936964 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896290 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 12 19:22:08.936964 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896292 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 12 19:22:08.936964 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896295 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 12 19:22:08.936964 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896297 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 12 19:22:08.936964 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896300 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 12 19:22:08.936964 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896302 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 12 19:22:08.936964 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896305 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 12 19:22:08.936964 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896308 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 12 19:22:08.936964 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896310 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 12 19:22:08.936964 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896313 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 12 19:22:08.937648 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896316 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 12 19:22:08.937648 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896320 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 12 19:22:08.937648 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896323 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 12 19:22:08.937648 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896326 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 12 19:22:08.937648 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896328 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 12 19:22:08.937648 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896331 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 12 19:22:08.937648 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896334 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 12 19:22:08.937648 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896336 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 12 19:22:08.937648 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896339 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 12 19:22:08.937648 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896341 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 12 19:22:08.937648 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896344 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 12 19:22:08.937648 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896346 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 12 19:22:08.937648 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896350 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 12 19:22:08.937648 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896354 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 12 19:22:08.937648 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896359 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 12 19:22:08.937648 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896362 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 12 19:22:08.937648 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896365 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 12 19:22:08.937648 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896368 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 12 19:22:08.937648 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896371 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 12 19:22:08.938141 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896373 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 12 19:22:08.938141 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896376 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 12 19:22:08.938141 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896379 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 12 19:22:08.938141 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896381 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 12 19:22:08.938141 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896384 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 12 19:22:08.938141 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896386 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 12 19:22:08.938141 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896389 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 12 19:22:08.938141 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896391 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 12 19:22:08.938141 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896394 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 12 19:22:08.938141 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896397 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 12 19:22:08.938141 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896400 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 12 19:22:08.938141 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896402 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 12 19:22:08.938141 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896405 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 12 19:22:08.938141 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.896407 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 12 19:22:08.938141 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897654 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 12 19:22:08.938141 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897660 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 12 19:22:08.938141 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897663 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 12 19:22:08.938141 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897666 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 12 19:22:08.938141 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897669 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 12 19:22:08.938141 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897672 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 12 19:22:08.938630 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897675 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 12 19:22:08.938630 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897678 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 12 19:22:08.938630 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897680 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 12 19:22:08.938630 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897683 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 12 19:22:08.938630 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897686 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 12 19:22:08.938630 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897689 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 12 19:22:08.938630 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897692 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 12 19:22:08.938630 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897696 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 12 19:22:08.938630 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897703 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 12 19:22:08.938630 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897707 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 12 19:22:08.938630 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897710 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 12 19:22:08.938630 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897713 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 12 19:22:08.938630 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897716 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 12 19:22:08.938630 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897719 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 12 19:22:08.938630 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897721 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 12 19:22:08.938630 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897724 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 12 19:22:08.938630 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897726 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 12 19:22:08.938630 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897729 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 12 19:22:08.938630 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897731 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 12 19:22:08.938630 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897734 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 12 19:22:08.939131 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897737 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 12 19:22:08.939131 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897740 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 12 19:22:08.939131 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897742 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 12 19:22:08.939131 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897745 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 12 19:22:08.939131 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897748 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 12 19:22:08.939131 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897750 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 12 19:22:08.939131 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897753 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 12 19:22:08.939131 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897756 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 12 19:22:08.939131 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897758 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 12 19:22:08.939131 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897761 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 12 19:22:08.939131 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897763 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 12 19:22:08.939131 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897766 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 12 19:22:08.939131 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897768 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 12 19:22:08.939131 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897771 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 12 19:22:08.939131 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897774 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 12 19:22:08.939131 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897776 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 12 19:22:08.939131 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897779 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 12 19:22:08.939131 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897782 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 12 19:22:08.939131 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897784 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 12 19:22:08.939131 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897787 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 12 19:22:08.939667 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897798 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 12 19:22:08.939667 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897801 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 12 19:22:08.939667 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897803 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 12 19:22:08.939667 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897806 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 12 19:22:08.939667 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897808 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 12 19:22:08.939667 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897811 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 12 19:22:08.939667 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897813 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 12 19:22:08.939667 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897816 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 12 19:22:08.939667 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897818 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 12 19:22:08.939667 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897821 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 12 19:22:08.939667 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897823 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 12 19:22:08.939667 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897827 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 12 19:22:08.939667 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897830 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 12 19:22:08.939667 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897832 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 12 19:22:08.939667 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897835 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 12 19:22:08.939667 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897837 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 12 19:22:08.939667 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897841 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 12 19:22:08.939667 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897845 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 12 19:22:08.939667 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897848 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 12 19:22:08.940154 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897850 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 12 19:22:08.940154 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897853 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 12 19:22:08.940154 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897855 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 12 19:22:08.940154 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897858 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 12 19:22:08.940154 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897860 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 12 19:22:08.940154 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897863 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 12 19:22:08.940154 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897865 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 12 19:22:08.940154 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897868 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 12 19:22:08.940154 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897870 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 12 19:22:08.940154 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897873 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 12 19:22:08.940154 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897875 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 12 19:22:08.940154 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897878 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 12 19:22:08.940154 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897880 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 12 19:22:08.940154 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897885 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 12 19:22:08.940154 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897888 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 12 19:22:08.940154 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897891 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 12 19:22:08.940154 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897893 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 12 19:22:08.940154 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897896 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 12 19:22:08.940154 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897899 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 12 19:22:08.940154 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897902 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 12 19:22:08.940693 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897905 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 12 19:22:08.940693 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897907 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 12 19:22:08.940693 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897910 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 12 19:22:08.940693 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897912 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 12 19:22:08.940693 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897918 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 12 19:22:08.940693 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897921 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 12 19:22:08.940693 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897924 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 12 19:22:08.940693 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897927 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 12 19:22:08.940693 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897930 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 12 19:22:08.940693 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897933 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 12 19:22:08.940693 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897936 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 12 19:22:08.940693 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897939 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 12 19:22:08.940693 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897942 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 12 19:22:08.940693 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.897944 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 12 19:22:08.940693 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898034 2576 flags.go:64] FLAG: --address="0.0.0.0" Jul 12 19:22:08.940693 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898042 2576 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 12 19:22:08.940693 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898048 2576 flags.go:64] FLAG: --anonymous-auth="true" Jul 12 19:22:08.940693 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898053 2576 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 12 19:22:08.940693 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898057 2576 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 12 19:22:08.940693 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898060 2576 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 12 19:22:08.940693 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898064 2576 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 12 19:22:08.941226 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898069 2576 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 12 19:22:08.941226 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898072 2576 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 12 19:22:08.941226 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898075 2576 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 12 19:22:08.941226 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898079 2576 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 12 19:22:08.941226 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898084 2576 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 12 19:22:08.941226 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898087 2576 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 12 19:22:08.941226 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898090 2576 flags.go:64] FLAG: --cgroup-root="" Jul 12 19:22:08.941226 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898093 2576 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 12 19:22:08.941226 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898097 2576 flags.go:64] FLAG: --client-ca-file="" Jul 12 19:22:08.941226 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898100 2576 flags.go:64] FLAG: --cloud-provider="external" Jul 12 19:22:08.941226 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898103 2576 flags.go:64] FLAG: --cluster-dns="[]" Jul 12 19:22:08.941226 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898107 2576 flags.go:64] FLAG: --cluster-domain="" Jul 12 19:22:08.941226 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898110 2576 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 12 19:22:08.941226 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898113 2576 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 12 19:22:08.941226 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898116 2576 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 12 19:22:08.941226 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898121 2576 flags.go:64] FLAG: --container-log-max-files="5" Jul 12 19:22:08.941226 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898125 2576 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 12 19:22:08.941226 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898128 2576 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 12 19:22:08.941226 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898131 2576 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 12 19:22:08.941226 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898134 2576 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 12 19:22:08.941226 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898137 2576 flags.go:64] FLAG: --contention-profiling="false" Jul 12 19:22:08.941226 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898140 2576 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 12 19:22:08.941226 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898143 2576 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 12 19:22:08.941226 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898146 2576 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 12 19:22:08.941833 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898150 2576 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 12 19:22:08.941833 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898154 2576 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 12 19:22:08.941833 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898157 2576 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 12 19:22:08.941833 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898159 2576 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 12 19:22:08.941833 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898162 2576 flags.go:64] FLAG: --enable-load-reader="false" Jul 12 19:22:08.941833 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898165 2576 flags.go:64] FLAG: --enable-server="true" Jul 12 19:22:08.941833 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898168 2576 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 12 19:22:08.941833 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898173 2576 flags.go:64] FLAG: --event-burst="100" Jul 12 19:22:08.941833 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898176 2576 flags.go:64] FLAG: --event-qps="50" Jul 12 19:22:08.941833 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898179 2576 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 12 19:22:08.941833 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898182 2576 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 12 19:22:08.941833 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898186 2576 flags.go:64] FLAG: --eviction-hard="" Jul 12 19:22:08.941833 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898191 2576 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 12 19:22:08.941833 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898194 2576 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 12 19:22:08.941833 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898196 2576 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 12 19:22:08.941833 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898200 2576 flags.go:64] FLAG: --eviction-soft="" Jul 12 19:22:08.941833 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898203 2576 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 12 19:22:08.941833 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898206 2576 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 12 19:22:08.941833 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898209 2576 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 12 19:22:08.941833 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898212 2576 flags.go:64] FLAG: --experimental-mounter-path="" Jul 12 19:22:08.941833 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898215 2576 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 12 19:22:08.941833 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898218 2576 flags.go:64] FLAG: --fail-swap-on="true" Jul 12 19:22:08.941833 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898221 2576 flags.go:64] FLAG: --feature-gates="" Jul 12 19:22:08.941833 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898226 2576 flags.go:64] FLAG: --file-check-frequency="20s" Jul 12 19:22:08.941833 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898229 2576 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 12 19:22:08.942450 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898232 2576 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 12 19:22:08.942450 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898235 2576 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 12 19:22:08.942450 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898238 2576 flags.go:64] FLAG: --healthz-port="10248" Jul 12 19:22:08.942450 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898241 2576 flags.go:64] FLAG: --help="false" Jul 12 19:22:08.942450 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898244 2576 flags.go:64] FLAG: --hostname-override="ip-10-0-137-63.ec2.internal" Jul 12 19:22:08.942450 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898247 2576 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 12 19:22:08.942450 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898250 2576 flags.go:64] FLAG: --http-check-frequency="20s" Jul 12 19:22:08.942450 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898253 2576 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 12 19:22:08.942450 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898257 2576 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 12 19:22:08.942450 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898260 2576 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 12 19:22:08.942450 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898263 2576 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 12 19:22:08.942450 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898266 2576 flags.go:64] FLAG: --image-service-endpoint="" Jul 12 19:22:08.942450 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898269 2576 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 12 19:22:08.942450 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898272 2576 flags.go:64] FLAG: --kube-api-burst="100" Jul 12 19:22:08.942450 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898275 2576 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 12 19:22:08.942450 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898278 2576 flags.go:64] FLAG: --kube-api-qps="50" Jul 12 19:22:08.942450 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898280 2576 flags.go:64] FLAG: --kube-reserved="" Jul 12 19:22:08.942450 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898283 2576 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 12 19:22:08.942450 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898286 2576 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 12 19:22:08.942450 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898291 2576 flags.go:64] FLAG: --kubelet-cgroups="" Jul 12 19:22:08.942450 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898294 2576 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 12 19:22:08.942450 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898297 2576 flags.go:64] FLAG: --lock-file="" Jul 12 19:22:08.942450 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898300 2576 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 12 19:22:08.942450 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898303 2576 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 12 19:22:08.943088 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898306 2576 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 12 19:22:08.943088 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898312 2576 flags.go:64] FLAG: --log-json-split-stream="false" Jul 12 19:22:08.943088 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898315 2576 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 12 19:22:08.943088 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898317 2576 flags.go:64] FLAG: --log-text-split-stream="false" Jul 12 19:22:08.943088 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898321 2576 flags.go:64] FLAG: --logging-format="text" Jul 12 19:22:08.943088 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898324 2576 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 12 19:22:08.943088 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898328 2576 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 12 19:22:08.943088 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898331 2576 flags.go:64] FLAG: --manifest-url="" Jul 12 19:22:08.943088 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898334 2576 flags.go:64] FLAG: --manifest-url-header="" Jul 12 19:22:08.943088 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898338 2576 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 12 19:22:08.943088 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898341 2576 flags.go:64] FLAG: --max-open-files="1000000" Jul 12 19:22:08.943088 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898346 2576 flags.go:64] FLAG: --max-pods="110" Jul 12 19:22:08.943088 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898349 2576 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 12 19:22:08.943088 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898351 2576 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 12 19:22:08.943088 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898354 2576 flags.go:64] FLAG: --memory-manager-policy="None" Jul 12 19:22:08.943088 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898357 2576 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 12 19:22:08.943088 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898360 2576 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 12 19:22:08.943088 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898363 2576 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 12 19:22:08.943088 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898366 2576 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 12 19:22:08.943088 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898373 2576 flags.go:64] FLAG: --node-status-max-images="50" Jul 12 19:22:08.943088 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898376 2576 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 12 19:22:08.943088 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898380 2576 flags.go:64] FLAG: --oom-score-adj="-999" Jul 12 19:22:08.943088 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898383 2576 flags.go:64] FLAG: --pod-cidr="" Jul 12 19:22:08.943655 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898386 2576 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 12 19:22:08.943655 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898391 2576 flags.go:64] FLAG: --pod-manifest-path="" Jul 12 19:22:08.943655 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898394 2576 flags.go:64] FLAG: --pod-max-pids="-1" Jul 12 19:22:08.943655 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898397 2576 flags.go:64] FLAG: --pods-per-core="0" Jul 12 19:22:08.943655 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898400 2576 flags.go:64] FLAG: --port="10250" Jul 12 19:22:08.943655 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898405 2576 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 12 19:22:08.943655 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898408 2576 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-050e065536dd46f0e" Jul 12 19:22:08.943655 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898411 2576 flags.go:64] FLAG: --qos-reserved="" Jul 12 19:22:08.943655 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898415 2576 flags.go:64] FLAG: --read-only-port="10255" Jul 12 19:22:08.943655 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898418 2576 flags.go:64] FLAG: --register-node="true" Jul 12 19:22:08.943655 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898421 2576 flags.go:64] FLAG: --register-with-taints="" Jul 12 19:22:08.943655 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898425 2576 flags.go:64] FLAG: --registry-burst="10" Jul 12 19:22:08.943655 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898427 2576 flags.go:64] FLAG: --registry-qps="5" Jul 12 19:22:08.943655 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898430 2576 flags.go:64] FLAG: --reserved-cpus="" Jul 12 19:22:08.943655 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898433 2576 flags.go:64] FLAG: --reserved-memory="" Jul 12 19:22:08.943655 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898438 2576 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 12 19:22:08.943655 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898441 2576 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 12 19:22:08.943655 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898444 2576 flags.go:64] FLAG: --rotate-certificates="false" Jul 12 19:22:08.943655 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898447 2576 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 12 19:22:08.943655 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898450 2576 flags.go:64] FLAG: --runonce="false" Jul 12 19:22:08.943655 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898453 2576 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 12 19:22:08.943655 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898456 2576 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 12 19:22:08.943655 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898459 2576 flags.go:64] FLAG: --seccomp-default="false" Jul 12 19:22:08.943655 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898462 2576 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 12 19:22:08.943655 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898465 2576 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 12 19:22:08.944292 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898468 2576 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 12 19:22:08.944292 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898471 2576 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 12 19:22:08.944292 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898474 2576 flags.go:64] FLAG: --storage-driver-password="root" Jul 12 19:22:08.944292 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898477 2576 flags.go:64] FLAG: --storage-driver-secure="false" Jul 12 19:22:08.944292 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898480 2576 flags.go:64] FLAG: --storage-driver-table="stats" Jul 12 19:22:08.944292 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898483 2576 flags.go:64] FLAG: --storage-driver-user="root" Jul 12 19:22:08.944292 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898486 2576 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 12 19:22:08.944292 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898489 2576 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 12 19:22:08.944292 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898492 2576 flags.go:64] FLAG: --system-cgroups="" Jul 12 19:22:08.944292 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898495 2576 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 12 19:22:08.944292 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898500 2576 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 12 19:22:08.944292 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898502 2576 flags.go:64] FLAG: --tls-cert-file="" Jul 12 19:22:08.944292 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898507 2576 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 12 19:22:08.944292 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898511 2576 flags.go:64] FLAG: --tls-min-version="" Jul 12 19:22:08.944292 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898514 2576 flags.go:64] FLAG: --tls-private-key-file="" Jul 12 19:22:08.944292 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898517 2576 flags.go:64] FLAG: --topology-manager-policy="none" Jul 12 19:22:08.944292 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898520 2576 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 12 19:22:08.944292 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898523 2576 flags.go:64] FLAG: --topology-manager-scope="container" Jul 12 19:22:08.944292 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898527 2576 flags.go:64] FLAG: --v="2" Jul 12 19:22:08.944292 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898531 2576 flags.go:64] FLAG: --version="false" Jul 12 19:22:08.944292 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898535 2576 flags.go:64] FLAG: --vmodule="" Jul 12 19:22:08.944292 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898538 2576 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 12 19:22:08.944292 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898543 2576 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 12 19:22:08.944292 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898651 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 12 19:22:08.944292 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898654 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 12 19:22:08.944905 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898658 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 12 19:22:08.944905 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898660 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 12 19:22:08.944905 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898663 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 12 19:22:08.944905 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898666 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 12 19:22:08.944905 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898669 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 12 19:22:08.944905 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898672 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 12 19:22:08.944905 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898676 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 12 19:22:08.944905 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898679 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 12 19:22:08.944905 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898682 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 12 19:22:08.944905 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898685 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 12 19:22:08.944905 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898687 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 12 19:22:08.944905 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898690 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 12 19:22:08.944905 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898692 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 12 19:22:08.944905 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898695 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 12 19:22:08.944905 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898698 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 12 19:22:08.944905 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898700 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 12 19:22:08.944905 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898702 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 12 19:22:08.944905 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898705 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 12 19:22:08.944905 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898708 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 12 19:22:08.944905 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898711 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 12 19:22:08.945447 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898714 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 12 19:22:08.945447 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898716 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 12 19:22:08.945447 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898719 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 12 19:22:08.945447 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898722 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 12 19:22:08.945447 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898726 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 12 19:22:08.945447 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898730 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 12 19:22:08.945447 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898733 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 12 19:22:08.945447 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898736 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 12 19:22:08.945447 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898739 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 12 19:22:08.945447 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898743 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 12 19:22:08.945447 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898745 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 12 19:22:08.945447 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898748 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 12 19:22:08.945447 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898752 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 12 19:22:08.945447 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898755 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 12 19:22:08.945447 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898758 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 12 19:22:08.945447 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898761 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 12 19:22:08.945447 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898764 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 12 19:22:08.945447 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898767 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 12 19:22:08.945447 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898769 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 12 19:22:08.945447 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898772 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 12 19:22:08.945941 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898775 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 12 19:22:08.945941 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898778 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 12 19:22:08.945941 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898781 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 12 19:22:08.945941 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898784 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 12 19:22:08.945941 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898786 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 12 19:22:08.945941 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898789 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 12 19:22:08.945941 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898792 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 12 19:22:08.945941 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898795 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 12 19:22:08.945941 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898797 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 12 19:22:08.945941 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898800 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 12 19:22:08.945941 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898802 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 12 19:22:08.945941 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898806 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 12 19:22:08.945941 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898809 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 12 19:22:08.945941 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898812 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 12 19:22:08.945941 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898814 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 12 19:22:08.945941 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898817 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 12 19:22:08.945941 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898819 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 12 19:22:08.945941 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898822 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 12 19:22:08.945941 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898825 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 12 19:22:08.946426 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898828 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 12 19:22:08.946426 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898831 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 12 19:22:08.946426 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898834 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 12 19:22:08.946426 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898837 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 12 19:22:08.946426 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898840 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 12 19:22:08.946426 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898842 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 12 19:22:08.946426 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898845 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 12 19:22:08.946426 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898847 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 12 19:22:08.946426 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898850 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 12 19:22:08.946426 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898852 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 12 19:22:08.946426 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898855 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 12 19:22:08.946426 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898857 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 12 19:22:08.946426 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898860 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 12 19:22:08.946426 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898862 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 12 19:22:08.946426 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898865 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 12 19:22:08.946426 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898868 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 12 19:22:08.946426 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898870 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 12 19:22:08.946426 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898873 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 12 19:22:08.946426 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898875 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 12 19:22:08.946900 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898878 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 12 19:22:08.946900 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898880 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 12 19:22:08.946900 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898883 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 12 19:22:08.946900 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898885 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 12 19:22:08.946900 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898888 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 12 19:22:08.946900 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898892 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 12 19:22:08.946900 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898895 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 12 19:22:08.946900 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898897 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 12 19:22:08.946900 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898900 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 12 19:22:08.946900 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898902 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 12 19:22:08.946900 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898905 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 12 19:22:08.946900 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898908 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 12 19:22:08.946900 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898910 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 12 19:22:08.946900 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898913 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 12 19:22:08.946900 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898916 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 12 19:22:08.946900 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898920 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 12 19:22:08.946900 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898922 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 12 19:22:08.946900 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898925 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 12 19:22:08.946900 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.898928 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 12 19:22:08.947396 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.898933 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 12 19:22:08.947396 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.905702 2576 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 12 19:22:08.947396 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.905716 2576 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 12 19:22:08.947396 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.905737 2576 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 12 19:22:08.947396 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.905743 2576 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 12 19:22:08.947396 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905805 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 12 19:22:08.947396 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905813 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 12 19:22:08.947396 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905819 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 12 19:22:08.947396 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905822 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 12 19:22:08.947396 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905826 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 12 19:22:08.947396 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905829 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 12 19:22:08.947396 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905832 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 12 19:22:08.947396 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905835 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 12 19:22:08.947396 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905838 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 12 19:22:08.947396 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905841 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 12 19:22:08.947772 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905844 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 12 19:22:08.947772 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905846 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 12 19:22:08.947772 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905849 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 12 19:22:08.947772 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905852 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 12 19:22:08.947772 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905854 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 12 19:22:08.947772 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905857 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 12 19:22:08.947772 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905862 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 12 19:22:08.947772 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905866 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 12 19:22:08.947772 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905869 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 12 19:22:08.947772 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905872 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 12 19:22:08.947772 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905875 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 12 19:22:08.947772 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905879 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 12 19:22:08.947772 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905883 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 12 19:22:08.947772 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905887 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 12 19:22:08.947772 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905892 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 12 19:22:08.947772 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905896 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 12 19:22:08.947772 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905898 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 12 19:22:08.947772 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905901 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 12 19:22:08.947772 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905904 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 12 19:22:08.948325 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905907 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 12 19:22:08.948325 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905910 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 12 19:22:08.948325 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905913 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 12 19:22:08.948325 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905915 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 12 19:22:08.948325 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905918 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 12 19:22:08.948325 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905921 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 12 19:22:08.948325 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905924 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 12 19:22:08.948325 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905928 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 12 19:22:08.948325 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905931 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 12 19:22:08.948325 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905934 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 12 19:22:08.948325 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905937 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 12 19:22:08.948325 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905941 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 12 19:22:08.948325 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905943 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 12 19:22:08.948325 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905946 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 12 19:22:08.948325 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905949 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 12 19:22:08.948325 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905951 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 12 19:22:08.948325 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905954 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 12 19:22:08.948325 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905956 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 12 19:22:08.948325 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905960 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 12 19:22:08.948325 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905964 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 12 19:22:08.948819 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905968 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 12 19:22:08.948819 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905973 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 12 19:22:08.948819 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905976 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 12 19:22:08.948819 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905979 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 12 19:22:08.948819 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905981 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 12 19:22:08.948819 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.905998 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 12 19:22:08.948819 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906001 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 12 19:22:08.948819 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906004 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 12 19:22:08.948819 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906007 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 12 19:22:08.948819 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906009 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 12 19:22:08.948819 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906012 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 12 19:22:08.948819 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906015 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 12 19:22:08.948819 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906018 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 12 19:22:08.948819 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906021 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 12 19:22:08.948819 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906024 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 12 19:22:08.948819 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906026 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 12 19:22:08.948819 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906029 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 12 19:22:08.948819 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906032 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 12 19:22:08.948819 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906035 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 12 19:22:08.948819 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906039 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 12 19:22:08.949469 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906043 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 12 19:22:08.949469 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906047 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 12 19:22:08.949469 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906052 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 12 19:22:08.949469 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906055 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 12 19:22:08.949469 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906058 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 12 19:22:08.949469 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906061 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 12 19:22:08.949469 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906064 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 12 19:22:08.949469 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906066 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 12 19:22:08.949469 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906069 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 12 19:22:08.949469 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906073 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 12 19:22:08.949469 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906075 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 12 19:22:08.949469 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906078 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 12 19:22:08.949469 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906081 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 12 19:22:08.949469 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906084 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 12 19:22:08.949469 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906086 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 12 19:22:08.949469 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906089 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 12 19:22:08.949469 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906092 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 12 19:22:08.949469 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906094 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 12 19:22:08.949469 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906097 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 12 19:22:08.949469 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906100 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 12 19:22:08.949980 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906102 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 12 19:22:08.949980 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906105 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 12 19:22:08.949980 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906108 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 12 19:22:08.949980 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906111 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 12 19:22:08.949980 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906116 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 12 19:22:08.949980 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906121 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 12 19:22:08.949980 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906126 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 12 19:22:08.949980 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906131 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 12 19:22:08.949980 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906136 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 12 19:22:08.949980 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906139 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 12 19:22:08.949980 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.906144 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 12 19:22:08.949980 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906286 2576 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 12 19:22:08.949980 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906294 2576 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 12 19:22:08.949980 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906298 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 12 19:22:08.950366 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906301 2576 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 12 19:22:08.950366 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906304 2576 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 12 19:22:08.950366 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906307 2576 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 12 19:22:08.950366 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906309 2576 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 12 19:22:08.950366 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906312 2576 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 12 19:22:08.950366 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906314 2576 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 12 19:22:08.950366 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906317 2576 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 12 19:22:08.950366 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906319 2576 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 12 19:22:08.950366 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906322 2576 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 12 19:22:08.950366 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906324 2576 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 12 19:22:08.950366 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906327 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 12 19:22:08.950366 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906331 2576 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 12 19:22:08.950366 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906334 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 12 19:22:08.950366 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906337 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 12 19:22:08.950366 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906339 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 12 19:22:08.950366 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906342 2576 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 12 19:22:08.950366 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906345 2576 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 12 19:22:08.950366 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906348 2576 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 12 19:22:08.950366 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906351 2576 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 12 19:22:08.950366 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906354 2576 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 12 19:22:08.950872 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906358 2576 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 12 19:22:08.950872 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906365 2576 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 12 19:22:08.950872 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906372 2576 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 12 19:22:08.950872 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906376 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 12 19:22:08.950872 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906379 2576 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 12 19:22:08.950872 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906382 2576 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 12 19:22:08.950872 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906385 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 12 19:22:08.950872 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906388 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 12 19:22:08.950872 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906391 2576 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 12 19:22:08.950872 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906393 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 12 19:22:08.950872 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906396 2576 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 12 19:22:08.950872 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906399 2576 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 12 19:22:08.950872 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906401 2576 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 12 19:22:08.950872 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906404 2576 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 12 19:22:08.950872 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906408 2576 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 12 19:22:08.950872 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906411 2576 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 12 19:22:08.950872 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906414 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 12 19:22:08.950872 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906417 2576 feature_gate.go:328] unrecognized feature gate: Example2 Jul 12 19:22:08.950872 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906420 2576 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 12 19:22:08.951406 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906422 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 12 19:22:08.951406 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906425 2576 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 12 19:22:08.951406 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906428 2576 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 12 19:22:08.951406 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906430 2576 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 12 19:22:08.951406 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906433 2576 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 12 19:22:08.951406 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906437 2576 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 12 19:22:08.951406 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906441 2576 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 12 19:22:08.951406 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906445 2576 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 12 19:22:08.951406 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906449 2576 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 12 19:22:08.951406 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906453 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 12 19:22:08.951406 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906456 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 12 19:22:08.951406 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906460 2576 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 12 19:22:08.951406 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906463 2576 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 12 19:22:08.951406 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906466 2576 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 12 19:22:08.951406 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906469 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 12 19:22:08.951406 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906472 2576 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 12 19:22:08.951406 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906475 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 12 19:22:08.951406 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906477 2576 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 12 19:22:08.951406 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906480 2576 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 12 19:22:08.951406 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906482 2576 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 12 19:22:08.951897 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906485 2576 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 12 19:22:08.951897 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906488 2576 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 12 19:22:08.951897 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906490 2576 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 12 19:22:08.951897 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906493 2576 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 12 19:22:08.951897 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906495 2576 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 12 19:22:08.951897 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906498 2576 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 12 19:22:08.951897 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906500 2576 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 12 19:22:08.951897 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906503 2576 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 12 19:22:08.951897 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906506 2576 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 12 19:22:08.951897 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906508 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 12 19:22:08.951897 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906511 2576 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 12 19:22:08.951897 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906513 2576 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 12 19:22:08.951897 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906517 2576 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 12 19:22:08.951897 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906521 2576 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 12 19:22:08.951897 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906525 2576 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 12 19:22:08.951897 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906529 2576 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 12 19:22:08.951897 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906533 2576 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 12 19:22:08.951897 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906536 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 12 19:22:08.951897 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906538 2576 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 12 19:22:08.952374 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906541 2576 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 12 19:22:08.952374 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906543 2576 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 12 19:22:08.952374 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906545 2576 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 12 19:22:08.952374 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906548 2576 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 12 19:22:08.952374 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906551 2576 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 12 19:22:08.952374 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906554 2576 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 12 19:22:08.952374 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906557 2576 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 12 19:22:08.952374 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906559 2576 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 12 19:22:08.952374 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906565 2576 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 12 19:22:08.952374 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906567 2576 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 12 19:22:08.952374 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906570 2576 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 12 19:22:08.952374 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906572 2576 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 12 19:22:08.952374 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906575 2576 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 12 19:22:08.952374 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906577 2576 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 12 19:22:08.952374 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906580 2576 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 12 19:22:08.952374 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906583 2576 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 12 19:22:08.952374 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906585 2576 feature_gate.go:328] unrecognized feature gate: Example Jul 12 19:22:08.952374 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:08.906587 2576 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 12 19:22:08.953004 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.906592 2576 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 12 19:22:08.953004 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.906704 2576 server.go:962] "Client rotation is on, will bootstrap in background" Jul 12 19:22:08.953004 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.908821 2576 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 12 19:22:08.953004 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.910286 2576 server.go:1019] "Starting client certificate rotation" Jul 12 19:22:08.953004 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.910381 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 12 19:22:08.953004 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.910417 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 12 19:22:08.953004 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.914084 2576 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 12 19:22:08.953004 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.917454 2576 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 12 19:22:08.953004 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.926929 2576 log.go:25] "Validated CRI v1 runtime API" Jul 12 19:22:08.953004 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.929276 2576 log.go:25] "Validated CRI v1 image API" Jul 12 19:22:08.953004 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.930076 2576 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 12 19:22:08.953004 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.932779 2576 fs.go:135] Filesystem UUIDs: map[785d62f2-ebc6-4ec2-8175-a550c05efb19:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 893b22a1-bc56-4170-bcc2-1278f1ab64a3:/dev/nvme0n1p4] Jul 12 19:22:08.953443 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.932794 2576 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 12 19:22:08.953481 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.938879 2576 manager.go:216] Machine: {Timestamp:2026-07-12 19:22:08.93741237 +0000 UTC m=+0.392005324 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3098531 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20bba38fa69f1f32f721ebf25e9beb SystemUUID:ec20bba3-8fa6-9f1f-32f7-21ebf25e9beb BootID:6c1425ea-f4a8-4695-8775-4240c7b58941 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fd:ae:96:c9:f9 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fd:ae:96:c9:f9 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ce:3c:d5:f8:98:71 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 12 19:22:08.953481 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.938975 2576 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 12 19:22:08.953481 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.939058 2576 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 12 19:22:08.953481 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.940456 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 12 19:22:08.953481 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.942685 2576 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 12 19:22:08.953481 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.942708 2576 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-63.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 12 19:22:08.953481 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.943527 2576 topology_manager.go:138] "Creating topology manager with none policy" Jul 12 19:22:08.953702 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.943538 2576 container_manager_linux.go:309] "Creating device plugin manager" Jul 12 19:22:08.953702 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.943546 2576 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 12 19:22:08.953702 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.943557 2576 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 12 19:22:08.953702 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.944734 2576 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 12 19:22:08.953702 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.947840 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 12 19:22:08.953702 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.947950 2576 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 12 19:22:08.953702 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.947977 2576 kubelet.go:486] "Attempting to sync node with API server" Jul 12 19:22:08.953702 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.948001 2576 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 12 19:22:08.953702 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.948015 2576 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 12 19:22:08.953702 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.948026 2576 kubelet.go:398] "Adding apiserver pod source" Jul 12 19:22:08.953702 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.948042 2576 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 12 19:22:08.953702 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.948366 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 12 19:22:08.953702 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.948382 2576 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 12 19:22:08.953702 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.951023 2576 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 12 19:22:08.953702 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.952766 2576 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 12 19:22:08.953702 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.952794 2576 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 12 19:22:08.953702 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.953638 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 12 19:22:08.953702 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.953651 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 12 19:22:08.953702 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.953657 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 12 19:22:08.953702 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.953662 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 12 19:22:08.953702 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.953673 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 12 19:22:08.953702 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.953682 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 12 19:22:08.953702 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.953695 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 12 19:22:08.953702 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.953701 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 12 19:22:08.953702 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.953708 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 12 19:22:08.953702 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.953714 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 12 19:22:08.954441 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.953722 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 12 19:22:08.954441 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.953728 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 12 19:22:08.954640 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.954630 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 12 19:22:08.954673 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.954642 2576 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 12 19:22:08.957882 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.957869 2576 server.go:1268] "Started kubelet" Jul 12 19:22:08.957975 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.957954 2576 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 12 19:22:08.958142 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.958028 2576 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 12 19:22:08.958142 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.958105 2576 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 12 19:22:08.958604 ip-10-0-137-63 systemd[1]: Started Kubernetes Kubelet. Jul 12 19:22:08.958745 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:08.958612 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 12 19:22:08.958745 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.958694 2576 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-63.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 12 19:22:08.958887 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:08.958866 2576 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-63.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 12 19:22:08.959458 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.959441 2576 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 12 19:22:08.962189 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.962154 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-967lr" Jul 12 19:22:08.963310 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.963292 2576 server.go:310] "Adding debug handlers to kubelet server" Jul 12 19:22:08.963747 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:08.963636 2576 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 12 19:22:08.967542 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.967524 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-967lr" Jul 12 19:22:08.969598 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:08.968444 2576 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-63.ec2.internal.18c1a129f2fb24ff default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-63.ec2.internal,UID:ip-10-0-137-63.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-63.ec2.internal,},FirstTimestamp:2026-07-12 19:22:08.957703423 +0000 UTC m=+0.412296378,LastTimestamp:2026-07-12 19:22:08.957703423 +0000 UTC m=+0.412296378,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-63.ec2.internal,}" Jul 12 19:22:08.969706 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.969607 2576 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 12 19:22:08.969706 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.969621 2576 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 12 19:22:08.969813 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:08.969717 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-63.ec2.internal\" not found" Jul 12 19:22:08.970325 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.970302 2576 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 12 19:22:08.970415 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.970339 2576 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 12 19:22:08.970415 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.970300 2576 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 12 19:22:08.970511 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.970436 2576 factory.go:55] Registering systemd factory Jul 12 19:22:08.970511 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.970443 2576 reconstruct.go:97] "Volume reconstruction finished" Jul 12 19:22:08.970511 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.970451 2576 reconciler.go:29] "Reconciler: start to sync state" Jul 12 19:22:08.970511 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.970475 2576 factory.go:223] Registration of the systemd container factory successfully Jul 12 19:22:08.970691 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.970671 2576 factory.go:153] Registering CRI-O factory Jul 12 19:22:08.970691 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.970685 2576 factory.go:223] Registration of the crio container factory successfully Jul 12 19:22:08.970785 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.970733 2576 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 12 19:22:08.970785 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.970756 2576 factory.go:103] Registering Raw factory Jul 12 19:22:08.970785 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.970770 2576 manager.go:1196] Started watching for new ooms in manager Jul 12 19:22:08.971097 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.971082 2576 manager.go:349] Starting recovery of all containers Jul 12 19:22:08.978102 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.978080 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 12 19:22:08.982996 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:08.980833 2576 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-137-63.ec2.internal\" not found" node="ip-10-0-137-63.ec2.internal" Jul 12 19:22:08.982996 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.981564 2576 manager.go:354] Recovery completed Jul 12 19:22:08.985305 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.985288 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 19:22:08.986940 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.986924 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientMemory" Jul 12 19:22:08.987032 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.986956 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 19:22:08.987032 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.986970 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientPID" Jul 12 19:22:08.987521 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.987501 2576 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 12 19:22:08.987521 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.987508 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 19:22:08.987521 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.987512 2576 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 12 19:22:08.987629 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.987529 2576 state_mem.go:36] "Initialized new in-memory state store" Jul 12 19:22:08.988124 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.988111 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientMemory" Jul 12 19:22:08.988194 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.988132 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 19:22:08.988194 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.988143 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientPID" Jul 12 19:22:08.988455 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.988441 2576 policy_none.go:49] "None policy: Start" Jul 12 19:22:08.988496 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.988463 2576 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 12 19:22:08.988496 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.988476 2576 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 12 19:22:08.991134 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:08.989521 2576 policy_none.go:47] "Start" Jul 12 19:22:09.011664 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.011647 2576 manager.go:337] "Starting Device Plugin manager" Jul 12 19:22:09.011766 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:09.011690 2576 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 12 19:22:09.011766 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.011702 2576 server.go:87] "Starting device plugin registration server" Jul 12 19:22:09.011922 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.011909 2576 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 12 19:22:09.011974 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.011926 2576 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 12 19:22:09.012089 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.012075 2576 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 12 19:22:09.012154 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.012145 2576 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 12 19:22:09.012154 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.012153 2576 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 12 19:22:09.012635 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:09.012616 2576 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 12 19:22:09.012722 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:09.012664 2576 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-63.ec2.internal\" not found" Jul 12 19:22:09.075914 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.075879 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 12 19:22:09.077048 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.077030 2576 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 12 19:22:09.077130 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.077068 2576 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 12 19:22:09.077130 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.077089 2576 kubelet.go:2448] "Starting kubelet main sync loop" Jul 12 19:22:09.077130 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:09.077126 2576 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 12 19:22:09.085684 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.085662 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 12 19:22:09.112529 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.112414 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 19:22:09.113324 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.113307 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientMemory" Jul 12 19:22:09.113414 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.113333 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 19:22:09.113414 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.113342 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientPID" Jul 12 19:22:09.113414 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.113363 2576 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-63.ec2.internal" Jul 12 19:22:09.123428 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.123407 2576 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-63.ec2.internal" Jul 12 19:22:09.123498 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:09.123432 2576 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-63.ec2.internal\": node \"ip-10-0-137-63.ec2.internal\" not found" Jul 12 19:22:09.142932 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:09.142912 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-63.ec2.internal\" not found" Jul 12 19:22:09.177484 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.177458 2576 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-63.ec2.internal"] Jul 12 19:22:09.177559 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.177529 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 19:22:09.178901 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.178886 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientMemory" Jul 12 19:22:09.178950 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.178914 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 19:22:09.178950 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.178926 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientPID" Jul 12 19:22:09.180091 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.180080 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 19:22:09.180233 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.180216 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal" Jul 12 19:22:09.180269 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.180253 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 19:22:09.180758 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.180733 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientMemory" Jul 12 19:22:09.180858 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.180763 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 19:22:09.180858 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.180779 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientPID" Jul 12 19:22:09.180858 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.180796 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientMemory" Jul 12 19:22:09.180858 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.180819 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 19:22:09.180858 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.180834 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientPID" Jul 12 19:22:09.183122 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.183104 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-63.ec2.internal" Jul 12 19:22:09.183201 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.183144 2576 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 12 19:22:09.183794 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.183777 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientMemory" Jul 12 19:22:09.183873 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.183810 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasNoDiskPressure" Jul 12 19:22:09.183873 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.183823 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeHasSufficientPID" Jul 12 19:22:09.212529 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:09.212513 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-63.ec2.internal\" not found" node="ip-10-0-137-63.ec2.internal" Jul 12 19:22:09.216846 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:09.216833 2576 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-63.ec2.internal\" not found" node="ip-10-0-137-63.ec2.internal" Jul 12 19:22:09.243665 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:09.243623 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-63.ec2.internal\" not found" Jul 12 19:22:09.272242 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.272226 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/12004e7284b18d57c7b16f9e578840a6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal\" (UID: \"12004e7284b18d57c7b16f9e578840a6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal" Jul 12 19:22:09.272319 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.272251 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12004e7284b18d57c7b16f9e578840a6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal\" (UID: \"12004e7284b18d57c7b16f9e578840a6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal" Jul 12 19:22:09.272319 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.272270 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b2a2874da17abefb7e09b1f75564bde1-config\") pod \"kube-apiserver-proxy-ip-10-0-137-63.ec2.internal\" (UID: \"b2a2874da17abefb7e09b1f75564bde1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-63.ec2.internal" Jul 12 19:22:09.344207 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:09.344183 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-63.ec2.internal\" not found" Jul 12 19:22:09.372542 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.372520 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/12004e7284b18d57c7b16f9e578840a6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal\" (UID: \"12004e7284b18d57c7b16f9e578840a6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal" Jul 12 19:22:09.372624 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.372552 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12004e7284b18d57c7b16f9e578840a6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal\" (UID: \"12004e7284b18d57c7b16f9e578840a6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal" Jul 12 19:22:09.372624 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.372577 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b2a2874da17abefb7e09b1f75564bde1-config\") pod \"kube-apiserver-proxy-ip-10-0-137-63.ec2.internal\" (UID: \"b2a2874da17abefb7e09b1f75564bde1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-63.ec2.internal" Jul 12 19:22:09.372720 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.372627 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/12004e7284b18d57c7b16f9e578840a6-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal\" (UID: \"12004e7284b18d57c7b16f9e578840a6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal" Jul 12 19:22:09.372720 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.372647 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b2a2874da17abefb7e09b1f75564bde1-config\") pod \"kube-apiserver-proxy-ip-10-0-137-63.ec2.internal\" (UID: \"b2a2874da17abefb7e09b1f75564bde1\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-63.ec2.internal" Jul 12 19:22:09.372720 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.372630 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12004e7284b18d57c7b16f9e578840a6-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal\" (UID: \"12004e7284b18d57c7b16f9e578840a6\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal" Jul 12 19:22:09.444842 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:09.444805 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-63.ec2.internal\" not found" Jul 12 19:22:09.515536 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.515467 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal" Jul 12 19:22:09.520307 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.520289 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-63.ec2.internal" Jul 12 19:22:09.545622 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:09.545596 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-63.ec2.internal\" not found" Jul 12 19:22:09.647548 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:09.647516 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-63.ec2.internal\" not found" Jul 12 19:22:09.749225 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:09.749198 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-63.ec2.internal\" not found" Jul 12 19:22:09.850158 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:09.850090 2576 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-63.ec2.internal\" not found" Jul 12 19:22:09.870406 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.870388 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 12 19:22:09.910031 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.910009 2576 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 12 19:22:09.910539 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.910165 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 12 19:22:09.910539 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.910215 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 12 19:22:09.910539 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.910232 2576 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 12 19:22:09.948337 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.948307 2576 apiserver.go:52] "Watching apiserver" Jul 12 19:22:09.970838 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.970813 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal" Jul 12 19:22:09.970838 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.970836 2576 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 12 19:22:09.971161 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.971143 2576 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 12 19:22:09.971509 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.971486 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-8h25q","openshift-dns/node-resolver-s4snc","openshift-image-registry/node-ca-kfgnm","openshift-multus/multus-56fhk","openshift-multus/multus-additional-cni-plugins-9z5dq","openshift-network-operator/iptables-alerter-74f6p","kube-system/global-pull-secret-syncer-7xr84","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzr2z","openshift-cluster-node-tuning-operator/tuned-jc8b5","openshift-multus/network-metrics-daemon-sv9f6","openshift-network-diagnostics/network-check-target-6fxlg","openshift-ovn-kubernetes/ovnkube-node-mj4zs"] Jul 12 19:22:09.972068 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.972029 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-11 19:17:09 +0000 UTC" deadline="2028-01-15 17:59:05.494935651 +0000 UTC" Jul 12 19:22:09.972155 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.972056 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13246h36m55.522883298s" Jul 12 19:22:09.972746 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.972729 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8h25q" Jul 12 19:22:09.974079 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.974049 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s4snc" Jul 12 19:22:09.974999 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.974961 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 12 19:22:09.975122 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.975099 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kfgnm" Jul 12 19:22:09.975528 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.975505 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 12 19:22:09.975989 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.975841 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4cprc\"" Jul 12 19:22:09.976491 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.976449 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-sf9cw\"" Jul 12 19:22:09.976586 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.976550 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 12 19:22:09.976682 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.976666 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 12 19:22:09.977773 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.977694 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-56fhk" Jul 12 19:22:09.978504 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.978484 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-tgsv7\"" Jul 12 19:22:09.979074 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.979055 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 12 19:22:09.979164 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.979061 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 12 19:22:09.979164 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.979060 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 12 19:22:09.979349 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.979333 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9z5dq" Jul 12 19:22:09.979721 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.979705 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-lv8p7\"" Jul 12 19:22:09.979834 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.979792 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 12 19:22:09.979941 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.979920 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 12 19:22:09.980073 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.980051 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 12 19:22:09.980395 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.980379 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-74f6p" Jul 12 19:22:09.980578 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.980550 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 12 19:22:09.981421 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.981395 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xr84" Jul 12 19:22:09.981528 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:09.981480 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xr84" podUID="c3855f17-6f1a-4a9e-841e-bfda15547d26" Jul 12 19:22:09.981617 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.981548 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-b4d9h\"" Jul 12 19:22:09.981617 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.981556 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 12 19:22:09.981784 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.981767 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 12 19:22:09.982586 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.982564 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 12 19:22:09.982719 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.982632 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzr2z" Jul 12 19:22:09.982915 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.982896 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 12 19:22:09.982994 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.982962 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 12 19:22:09.983170 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.983152 2576 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-63.ec2.internal" Jul 12 19:22:09.983249 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.983158 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-p98w2\"" Jul 12 19:22:09.983305 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.983158 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 12 19:22:09.983762 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.983747 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:09.984643 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.984626 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 12 19:22:09.984740 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.984695 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 12 19:22:09.984980 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.984949 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 12 19:22:09.984980 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.984970 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-cwfpd\"" Jul 12 19:22:09.985147 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.984956 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv9f6" Jul 12 19:22:09.985147 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:09.985071 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sv9f6" podUID="0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52" Jul 12 19:22:09.985299 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.985272 2576 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 12 19:22:09.985807 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.985789 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 12 19:22:09.985985 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.985973 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 12 19:22:09.986192 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.986166 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-g58wf\"" Jul 12 19:22:09.986290 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.986263 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fxlg" Jul 12 19:22:09.986348 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:09.986331 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fxlg" podUID="239fb2a7-5ee3-4efe-8878-7e2f8dd795de" Jul 12 19:22:09.987558 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.987539 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal"] Jul 12 19:22:09.987662 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.987648 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:09.990017 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.989998 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 12 19:22:09.990137 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.990116 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 12 19:22:09.990199 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.990170 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 12 19:22:09.990199 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.990113 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 12 19:22:09.990302 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.990198 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 12 19:22:09.990354 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.990306 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-k296g\"" Jul 12 19:22:09.990354 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.990345 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 12 19:22:09.991619 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.991603 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-137-63.ec2.internal"] Jul 12 19:22:09.991679 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:09.991643 2576 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 12 19:22:10.020315 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.020293 2576 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-l559w" Jul 12 19:22:10.020315 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.020311 2576 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-l559w" Jul 12 19:22:10.022267 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:10.022216 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2a2874da17abefb7e09b1f75564bde1.slice/crio-3bf9363bfce1b3cc33c157d4065d64cce45113b122fae341ccb0cf7156aaa499 WatchSource:0}: Error finding container 3bf9363bfce1b3cc33c157d4065d64cce45113b122fae341ccb0cf7156aaa499: Status 404 returned error can't find the container with id 3bf9363bfce1b3cc33c157d4065d64cce45113b122fae341ccb0cf7156aaa499 Jul 12 19:22:10.022838 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:10.022808 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12004e7284b18d57c7b16f9e578840a6.slice/crio-f48ede1deac8f7a33aed0cef9bc192171e5e027c8a271e0d3ec89d125e9f3b66 WatchSource:0}: Error finding container f48ede1deac8f7a33aed0cef9bc192171e5e027c8a271e0d3ec89d125e9f3b66: Status 404 returned error can't find the container with id f48ede1deac8f7a33aed0cef9bc192171e5e027c8a271e0d3ec89d125e9f3b66 Jul 12 19:22:10.028429 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.028414 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 12 19:22:10.071684 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.071668 2576 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 12 19:22:10.076092 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076075 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8c081df9-b94a-459b-9e88-973863d95019-device-dir\") pod \"aws-ebs-csi-driver-node-kzr2z\" (UID: \"8c081df9-b94a-459b-9e88-973863d95019\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzr2z" Jul 12 19:22:10.076164 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076101 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-var-lib-openvswitch\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.076164 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076121 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-log-socket\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.076164 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076136 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-flzfb\" (UniqueName: \"kubernetes.io/projected/888aafef-f377-46e3-a36b-58cbabc198f8-kube-api-access-flzfb\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.076164 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076160 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97eab1be-059f-4563-ac6c-30b4edf4aa79-cni-binary-copy\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.076293 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076190 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-hostroot\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.076293 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076227 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ls95\" (UniqueName: \"kubernetes.io/projected/12a7f674-5f12-4dfe-a936-75d1fedafaea-kube-api-access-6ls95\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.076293 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076243 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8c081df9-b94a-459b-9e88-973863d95019-sys-fs\") pod \"aws-ebs-csi-driver-node-kzr2z\" (UID: \"8c081df9-b94a-459b-9e88-973863d95019\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzr2z" Jul 12 19:22:10.076293 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076266 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.076293 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076283 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/97eab1be-059f-4563-ac6c-30b4edf4aa79-multus-daemon-config\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.076449 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076298 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c648764a-13c5-4cea-9dbc-dcfdcc308d68-cnibin\") pod \"multus-additional-cni-plugins-9z5dq\" (UID: \"c648764a-13c5-4cea-9dbc-dcfdcc308d68\") " pod="openshift-multus/multus-additional-cni-plugins-9z5dq" Jul 12 19:22:10.076449 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076342 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/12a7f674-5f12-4dfe-a936-75d1fedafaea-run\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.076449 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076362 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-host-kubelet\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.076449 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076378 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-etc-openvswitch\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.076449 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076395 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gfxt\" (UniqueName: \"kubernetes.io/projected/97eab1be-059f-4563-ac6c-30b4edf4aa79-kube-api-access-6gfxt\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.076449 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076420 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8c081df9-b94a-459b-9e88-973863d95019-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kzr2z\" (UID: \"8c081df9-b94a-459b-9e88-973863d95019\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzr2z" Jul 12 19:22:10.076449 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076441 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-host-run-multus-certs\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.076698 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076456 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c648764a-13c5-4cea-9dbc-dcfdcc308d68-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9z5dq\" (UID: \"c648764a-13c5-4cea-9dbc-dcfdcc308d68\") " pod="openshift-multus/multus-additional-cni-plugins-9z5dq" Jul 12 19:22:10.076698 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076471 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8c081df9-b94a-459b-9e88-973863d95019-etc-selinux\") pod \"aws-ebs-csi-driver-node-kzr2z\" (UID: \"8c081df9-b94a-459b-9e88-973863d95019\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzr2z" Jul 12 19:22:10.076698 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076494 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-run-openvswitch\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.076698 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076516 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-host-cni-netd\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.076698 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076533 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/888aafef-f377-46e3-a36b-58cbabc198f8-env-overrides\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.076698 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076549 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/12a7f674-5f12-4dfe-a936-75d1fedafaea-etc-modprobe-d\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.076698 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076563 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-host-cni-bin\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.076698 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076591 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-host-run-k8s-cni-cncf-io\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.076698 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076606 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c648764a-13c5-4cea-9dbc-dcfdcc308d68-system-cni-dir\") pod \"multus-additional-cni-plugins-9z5dq\" (UID: \"c648764a-13c5-4cea-9dbc-dcfdcc308d68\") " pod="openshift-multus/multus-additional-cni-plugins-9z5dq" Jul 12 19:22:10.076698 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076622 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c3855f17-6f1a-4a9e-841e-bfda15547d26-kubelet-config\") pod \"global-pull-secret-syncer-7xr84\" (UID: \"c3855f17-6f1a-4a9e-841e-bfda15547d26\") " pod="kube-system/global-pull-secret-syncer-7xr84" Jul 12 19:22:10.076698 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076636 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3855f17-6f1a-4a9e-841e-bfda15547d26-original-pull-secret\") pod \"global-pull-secret-syncer-7xr84\" (UID: \"c3855f17-6f1a-4a9e-841e-bfda15547d26\") " pod="kube-system/global-pull-secret-syncer-7xr84" Jul 12 19:22:10.076698 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076651 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52-metrics-certs\") pod \"network-metrics-daemon-sv9f6\" (UID: \"0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52\") " pod="openshift-multus/network-metrics-daemon-sv9f6" Jul 12 19:22:10.076698 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076667 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gg9t9\" (UniqueName: \"kubernetes.io/projected/0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52-kube-api-access-gg9t9\") pod \"network-metrics-daemon-sv9f6\" (UID: \"0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52\") " pod="openshift-multus/network-metrics-daemon-sv9f6" Jul 12 19:22:10.077209 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076682 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-446z8\" (UniqueName: \"kubernetes.io/projected/239fb2a7-5ee3-4efe-8878-7e2f8dd795de-kube-api-access-446z8\") pod \"network-check-target-6fxlg\" (UID: \"239fb2a7-5ee3-4efe-8878-7e2f8dd795de\") " pod="openshift-network-diagnostics/network-check-target-6fxlg" Jul 12 19:22:10.077209 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076705 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-run-systemd\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.077209 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076724 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-run-ovn\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.077209 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076741 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-etc-kubernetes\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.077209 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076756 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/12a7f674-5f12-4dfe-a936-75d1fedafaea-host\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.077209 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076788 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-host-slash\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.077209 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076819 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-os-release\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.077209 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076836 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c648764a-13c5-4cea-9dbc-dcfdcc308d68-cni-binary-copy\") pod \"multus-additional-cni-plugins-9z5dq\" (UID: \"c648764a-13c5-4cea-9dbc-dcfdcc308d68\") " pod="openshift-multus/multus-additional-cni-plugins-9z5dq" Jul 12 19:22:10.077209 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076856 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c3855f17-6f1a-4a9e-841e-bfda15547d26-dbus\") pod \"global-pull-secret-syncer-7xr84\" (UID: \"c3855f17-6f1a-4a9e-841e-bfda15547d26\") " pod="kube-system/global-pull-secret-syncer-7xr84" Jul 12 19:22:10.077209 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076874 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/12a7f674-5f12-4dfe-a936-75d1fedafaea-etc-sysctl-d\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.077209 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076889 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/12a7f674-5f12-4dfe-a936-75d1fedafaea-etc-systemd\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.077209 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076904 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrs7q\" (UniqueName: \"kubernetes.io/projected/c147ccfb-342a-4958-b365-f730046bebce-kube-api-access-xrs7q\") pod \"node-ca-kfgnm\" (UID: \"c147ccfb-342a-4958-b365-f730046bebce\") " pod="openshift-image-registry/node-ca-kfgnm" Jul 12 19:22:10.077209 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076919 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6fd77a07-b4ea-4261-b1d9-0bf31aaf270c-iptables-alerter-script\") pod \"iptables-alerter-74f6p\" (UID: \"6fd77a07-b4ea-4261-b1d9-0bf31aaf270c\") " pod="openshift-network-operator/iptables-alerter-74f6p" Jul 12 19:22:10.077209 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076934 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-host-run-netns\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.077611 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076948 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/16f30c9c-72f7-4d93-a0e8-9617958d76dd-agent-certs\") pod \"konnectivity-agent-8h25q\" (UID: \"16f30c9c-72f7-4d93-a0e8-9617958d76dd\") " pod="kube-system/konnectivity-agent-8h25q" Jul 12 19:22:10.077611 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076962 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c147ccfb-342a-4958-b365-f730046bebce-serviceca\") pod \"node-ca-kfgnm\" (UID: \"c147ccfb-342a-4958-b365-f730046bebce\") " pod="openshift-image-registry/node-ca-kfgnm" Jul 12 19:22:10.077611 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076976 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-system-cni-dir\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.077611 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.076991 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wh92k\" (UniqueName: \"kubernetes.io/projected/6fd77a07-b4ea-4261-b1d9-0bf31aaf270c-kube-api-access-wh92k\") pod \"iptables-alerter-74f6p\" (UID: \"6fd77a07-b4ea-4261-b1d9-0bf31aaf270c\") " pod="openshift-network-operator/iptables-alerter-74f6p" Jul 12 19:22:10.077611 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.077044 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8c081df9-b94a-459b-9e88-973863d95019-socket-dir\") pod \"aws-ebs-csi-driver-node-kzr2z\" (UID: \"8c081df9-b94a-459b-9e88-973863d95019\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzr2z" Jul 12 19:22:10.077611 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.077061 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-stlxw\" (UniqueName: \"kubernetes.io/projected/c648764a-13c5-4cea-9dbc-dcfdcc308d68-kube-api-access-stlxw\") pod \"multus-additional-cni-plugins-9z5dq\" (UID: \"c648764a-13c5-4cea-9dbc-dcfdcc308d68\") " pod="openshift-multus/multus-additional-cni-plugins-9z5dq" Jul 12 19:22:10.077611 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.077077 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/12a7f674-5f12-4dfe-a936-75d1fedafaea-etc-sysctl-conf\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.077611 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.077093 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zcc8\" (UniqueName: \"kubernetes.io/projected/8c081df9-b94a-459b-9e88-973863d95019-kube-api-access-7zcc8\") pod \"aws-ebs-csi-driver-node-kzr2z\" (UID: \"8c081df9-b94a-459b-9e88-973863d95019\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzr2z" Jul 12 19:22:10.077611 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.077115 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-systemd-units\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.077611 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.077129 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/888aafef-f377-46e3-a36b-58cbabc198f8-ovnkube-config\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.077611 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.077146 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/16f30c9c-72f7-4d93-a0e8-9617958d76dd-konnectivity-ca\") pod \"konnectivity-agent-8h25q\" (UID: \"16f30c9c-72f7-4d93-a0e8-9617958d76dd\") " pod="kube-system/konnectivity-agent-8h25q" Jul 12 19:22:10.077611 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.077175 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/89fef961-c465-49fc-a683-244057d342fc-hosts-file\") pod \"node-resolver-s4snc\" (UID: \"89fef961-c465-49fc-a683-244057d342fc\") " pod="openshift-dns/node-resolver-s4snc" Jul 12 19:22:10.077611 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.077203 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-multus-cni-dir\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.077611 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.077224 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-host-var-lib-cni-bin\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.078051 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.077240 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12a7f674-5f12-4dfe-a936-75d1fedafaea-sys\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.078051 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.077256 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12a7f674-5f12-4dfe-a936-75d1fedafaea-tmp\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.078051 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.077271 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-host-run-ovn-kubernetes\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.078051 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.077293 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/888aafef-f377-46e3-a36b-58cbabc198f8-ovnkube-script-lib\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.078051 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.077314 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-multus-socket-dir-parent\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.078051 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.077338 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-host-var-lib-kubelet\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.078051 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.077365 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-multus-conf-dir\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.078051 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.077383 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c648764a-13c5-4cea-9dbc-dcfdcc308d68-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9z5dq\" (UID: \"c648764a-13c5-4cea-9dbc-dcfdcc308d68\") " pod="openshift-multus/multus-additional-cni-plugins-9z5dq" Jul 12 19:22:10.078051 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.077408 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/12a7f674-5f12-4dfe-a936-75d1fedafaea-etc-sysconfig\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.078051 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.077423 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/888aafef-f377-46e3-a36b-58cbabc198f8-ovn-node-metrics-cert\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.078051 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.077436 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89fef961-c465-49fc-a683-244057d342fc-tmp-dir\") pod \"node-resolver-s4snc\" (UID: \"89fef961-c465-49fc-a683-244057d342fc\") " pod="openshift-dns/node-resolver-s4snc" Jul 12 19:22:10.078051 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.077453 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c648764a-13c5-4cea-9dbc-dcfdcc308d68-os-release\") pod \"multus-additional-cni-plugins-9z5dq\" (UID: \"c648764a-13c5-4cea-9dbc-dcfdcc308d68\") " pod="openshift-multus/multus-additional-cni-plugins-9z5dq" Jul 12 19:22:10.078051 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.077502 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c648764a-13c5-4cea-9dbc-dcfdcc308d68-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9z5dq\" (UID: \"c648764a-13c5-4cea-9dbc-dcfdcc308d68\") " pod="openshift-multus/multus-additional-cni-plugins-9z5dq" Jul 12 19:22:10.078577 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.077520 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8c081df9-b94a-459b-9e88-973863d95019-registration-dir\") pod \"aws-ebs-csi-driver-node-kzr2z\" (UID: \"8c081df9-b94a-459b-9e88-973863d95019\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzr2z" Jul 12 19:22:10.078577 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.077540 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12a7f674-5f12-4dfe-a936-75d1fedafaea-etc-kubernetes\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.078577 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.077564 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/12a7f674-5f12-4dfe-a936-75d1fedafaea-etc-tuned\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.078577 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.077583 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-node-log\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.078577 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.077604 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-host-run-netns\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.078577 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.077619 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/12a7f674-5f12-4dfe-a936-75d1fedafaea-lib-modules\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.078577 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.077639 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12a7f674-5f12-4dfe-a936-75d1fedafaea-var-lib-kubelet\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.078577 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.077660 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6fd77a07-b4ea-4261-b1d9-0bf31aaf270c-host-slash\") pod \"iptables-alerter-74f6p\" (UID: \"6fd77a07-b4ea-4261-b1d9-0bf31aaf270c\") " pod="openshift-network-operator/iptables-alerter-74f6p" Jul 12 19:22:10.078577 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.077674 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dh5jg\" (UniqueName: \"kubernetes.io/projected/89fef961-c465-49fc-a683-244057d342fc-kube-api-access-dh5jg\") pod \"node-resolver-s4snc\" (UID: \"89fef961-c465-49fc-a683-244057d342fc\") " pod="openshift-dns/node-resolver-s4snc" Jul 12 19:22:10.078577 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.077700 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-cnibin\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.078577 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.077734 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-host-var-lib-cni-multus\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.078577 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.077757 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c147ccfb-342a-4958-b365-f730046bebce-host\") pod \"node-ca-kfgnm\" (UID: \"c147ccfb-342a-4958-b365-f730046bebce\") " pod="openshift-image-registry/node-ca-kfgnm" Jul 12 19:22:10.079896 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.079849 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-63.ec2.internal" event={"ID":"b2a2874da17abefb7e09b1f75564bde1","Type":"ContainerStarted","Data":"3bf9363bfce1b3cc33c157d4065d64cce45113b122fae341ccb0cf7156aaa499"} Jul 12 19:22:10.080923 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.080903 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal" event={"ID":"12004e7284b18d57c7b16f9e578840a6","Type":"ContainerStarted","Data":"f48ede1deac8f7a33aed0cef9bc192171e5e027c8a271e0d3ec89d125e9f3b66"} Jul 12 19:22:10.178097 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178012 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-host-cni-netd\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.178097 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178058 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/888aafef-f377-46e3-a36b-58cbabc198f8-env-overrides\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.178097 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178085 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/12a7f674-5f12-4dfe-a936-75d1fedafaea-etc-modprobe-d\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.178286 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178110 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-host-cni-bin\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.178286 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178133 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-host-cni-netd\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.178286 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178166 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-host-cni-bin\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.178286 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178206 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-host-run-k8s-cni-cncf-io\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.178286 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178236 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c648764a-13c5-4cea-9dbc-dcfdcc308d68-system-cni-dir\") pod \"multus-additional-cni-plugins-9z5dq\" (UID: \"c648764a-13c5-4cea-9dbc-dcfdcc308d68\") " pod="openshift-multus/multus-additional-cni-plugins-9z5dq" Jul 12 19:22:10.178286 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178254 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c3855f17-6f1a-4a9e-841e-bfda15547d26-kubelet-config\") pod \"global-pull-secret-syncer-7xr84\" (UID: \"c3855f17-6f1a-4a9e-841e-bfda15547d26\") " pod="kube-system/global-pull-secret-syncer-7xr84" Jul 12 19:22:10.178286 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178266 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/12a7f674-5f12-4dfe-a936-75d1fedafaea-etc-modprobe-d\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.178286 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178276 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3855f17-6f1a-4a9e-841e-bfda15547d26-original-pull-secret\") pod \"global-pull-secret-syncer-7xr84\" (UID: \"c3855f17-6f1a-4a9e-841e-bfda15547d26\") " pod="kube-system/global-pull-secret-syncer-7xr84" Jul 12 19:22:10.178592 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178284 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-host-run-k8s-cni-cncf-io\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.178592 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178296 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c648764a-13c5-4cea-9dbc-dcfdcc308d68-system-cni-dir\") pod \"multus-additional-cni-plugins-9z5dq\" (UID: \"c648764a-13c5-4cea-9dbc-dcfdcc308d68\") " pod="openshift-multus/multus-additional-cni-plugins-9z5dq" Jul 12 19:22:10.178592 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178317 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52-metrics-certs\") pod \"network-metrics-daemon-sv9f6\" (UID: \"0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52\") " pod="openshift-multus/network-metrics-daemon-sv9f6" Jul 12 19:22:10.178592 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178323 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c3855f17-6f1a-4a9e-841e-bfda15547d26-kubelet-config\") pod \"global-pull-secret-syncer-7xr84\" (UID: \"c3855f17-6f1a-4a9e-841e-bfda15547d26\") " pod="kube-system/global-pull-secret-syncer-7xr84" Jul 12 19:22:10.178592 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178334 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gg9t9\" (UniqueName: \"kubernetes.io/projected/0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52-kube-api-access-gg9t9\") pod \"network-metrics-daemon-sv9f6\" (UID: \"0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52\") " pod="openshift-multus/network-metrics-daemon-sv9f6" Jul 12 19:22:10.178592 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:10.178408 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 19:22:10.178592 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178432 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-446z8\" (UniqueName: \"kubernetes.io/projected/239fb2a7-5ee3-4efe-8878-7e2f8dd795de-kube-api-access-446z8\") pod \"network-check-target-6fxlg\" (UID: \"239fb2a7-5ee3-4efe-8878-7e2f8dd795de\") " pod="openshift-network-diagnostics/network-check-target-6fxlg" Jul 12 19:22:10.178592 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:10.178408 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 19:22:10.178592 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178461 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-run-systemd\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.178592 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:10.178479 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52-metrics-certs podName:0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52 nodeName:}" failed. No retries permitted until 2026-07-12 19:22:10.67845763 +0000 UTC m=+2.133050591 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52-metrics-certs") pod "network-metrics-daemon-sv9f6" (UID: "0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 19:22:10.178592 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178496 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-run-systemd\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.178592 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:10.178514 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3855f17-6f1a-4a9e-841e-bfda15547d26-original-pull-secret podName:c3855f17-6f1a-4a9e-841e-bfda15547d26 nodeName:}" failed. No retries permitted until 2026-07-12 19:22:10.67849492 +0000 UTC m=+2.133087871 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3855f17-6f1a-4a9e-841e-bfda15547d26-original-pull-secret") pod "global-pull-secret-syncer-7xr84" (UID: "c3855f17-6f1a-4a9e-841e-bfda15547d26") : object "kube-system"/"original-pull-secret" not registered Jul 12 19:22:10.178592 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178542 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-run-ovn\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.178592 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178572 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-etc-kubernetes\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.179385 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178573 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/888aafef-f377-46e3-a36b-58cbabc198f8-env-overrides\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.179385 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178581 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-run-ovn\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.179385 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178596 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/12a7f674-5f12-4dfe-a936-75d1fedafaea-host\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.179385 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178630 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-host-slash\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.179385 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178647 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-etc-kubernetes\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.179385 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178653 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-os-release\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.179385 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178660 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/12a7f674-5f12-4dfe-a936-75d1fedafaea-host\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.179385 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178700 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-host-slash\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.179385 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178712 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-os-release\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.179385 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178740 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c648764a-13c5-4cea-9dbc-dcfdcc308d68-cni-binary-copy\") pod \"multus-additional-cni-plugins-9z5dq\" (UID: \"c648764a-13c5-4cea-9dbc-dcfdcc308d68\") " pod="openshift-multus/multus-additional-cni-plugins-9z5dq" Jul 12 19:22:10.179385 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178781 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c3855f17-6f1a-4a9e-841e-bfda15547d26-dbus\") pod \"global-pull-secret-syncer-7xr84\" (UID: \"c3855f17-6f1a-4a9e-841e-bfda15547d26\") " pod="kube-system/global-pull-secret-syncer-7xr84" Jul 12 19:22:10.179385 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178809 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/12a7f674-5f12-4dfe-a936-75d1fedafaea-etc-sysctl-d\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.179385 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178835 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/12a7f674-5f12-4dfe-a936-75d1fedafaea-etc-systemd\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.179385 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178863 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrs7q\" (UniqueName: \"kubernetes.io/projected/c147ccfb-342a-4958-b365-f730046bebce-kube-api-access-xrs7q\") pod \"node-ca-kfgnm\" (UID: \"c147ccfb-342a-4958-b365-f730046bebce\") " pod="openshift-image-registry/node-ca-kfgnm" Jul 12 19:22:10.179385 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178888 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6fd77a07-b4ea-4261-b1d9-0bf31aaf270c-iptables-alerter-script\") pod \"iptables-alerter-74f6p\" (UID: \"6fd77a07-b4ea-4261-b1d9-0bf31aaf270c\") " pod="openshift-network-operator/iptables-alerter-74f6p" Jul 12 19:22:10.180110 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178914 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-host-run-netns\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.180110 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178925 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/12a7f674-5f12-4dfe-a936-75d1fedafaea-etc-sysctl-d\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.180110 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178942 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/12a7f674-5f12-4dfe-a936-75d1fedafaea-etc-systemd\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.180110 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178960 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-host-run-netns\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.180110 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178962 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c3855f17-6f1a-4a9e-841e-bfda15547d26-dbus\") pod \"global-pull-secret-syncer-7xr84\" (UID: \"c3855f17-6f1a-4a9e-841e-bfda15547d26\") " pod="kube-system/global-pull-secret-syncer-7xr84" Jul 12 19:22:10.180110 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.178981 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/16f30c9c-72f7-4d93-a0e8-9617958d76dd-agent-certs\") pod \"konnectivity-agent-8h25q\" (UID: \"16f30c9c-72f7-4d93-a0e8-9617958d76dd\") " pod="kube-system/konnectivity-agent-8h25q" Jul 12 19:22:10.180110 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179028 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c147ccfb-342a-4958-b365-f730046bebce-serviceca\") pod \"node-ca-kfgnm\" (UID: \"c147ccfb-342a-4958-b365-f730046bebce\") " pod="openshift-image-registry/node-ca-kfgnm" Jul 12 19:22:10.180110 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179051 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-system-cni-dir\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.180110 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179068 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wh92k\" (UniqueName: \"kubernetes.io/projected/6fd77a07-b4ea-4261-b1d9-0bf31aaf270c-kube-api-access-wh92k\") pod \"iptables-alerter-74f6p\" (UID: \"6fd77a07-b4ea-4261-b1d9-0bf31aaf270c\") " pod="openshift-network-operator/iptables-alerter-74f6p" Jul 12 19:22:10.180110 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179085 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8c081df9-b94a-459b-9e88-973863d95019-socket-dir\") pod \"aws-ebs-csi-driver-node-kzr2z\" (UID: \"8c081df9-b94a-459b-9e88-973863d95019\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzr2z" Jul 12 19:22:10.180110 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179108 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-stlxw\" (UniqueName: \"kubernetes.io/projected/c648764a-13c5-4cea-9dbc-dcfdcc308d68-kube-api-access-stlxw\") pod \"multus-additional-cni-plugins-9z5dq\" (UID: \"c648764a-13c5-4cea-9dbc-dcfdcc308d68\") " pod="openshift-multus/multus-additional-cni-plugins-9z5dq" Jul 12 19:22:10.180110 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179135 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/12a7f674-5f12-4dfe-a936-75d1fedafaea-etc-sysctl-conf\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.180110 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179146 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-system-cni-dir\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.180110 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179159 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zcc8\" (UniqueName: \"kubernetes.io/projected/8c081df9-b94a-459b-9e88-973863d95019-kube-api-access-7zcc8\") pod \"aws-ebs-csi-driver-node-kzr2z\" (UID: \"8c081df9-b94a-459b-9e88-973863d95019\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzr2z" Jul 12 19:22:10.180839 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179186 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-systemd-units\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.180839 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179206 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c648764a-13c5-4cea-9dbc-dcfdcc308d68-cni-binary-copy\") pod \"multus-additional-cni-plugins-9z5dq\" (UID: \"c648764a-13c5-4cea-9dbc-dcfdcc308d68\") " pod="openshift-multus/multus-additional-cni-plugins-9z5dq" Jul 12 19:22:10.180839 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179276 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8c081df9-b94a-459b-9e88-973863d95019-socket-dir\") pod \"aws-ebs-csi-driver-node-kzr2z\" (UID: \"8c081df9-b94a-459b-9e88-973863d95019\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzr2z" Jul 12 19:22:10.180839 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179387 2576 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 12 19:22:10.180839 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179452 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-systemd-units\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.180839 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179209 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/888aafef-f377-46e3-a36b-58cbabc198f8-ovnkube-config\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.180839 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179495 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/16f30c9c-72f7-4d93-a0e8-9617958d76dd-konnectivity-ca\") pod \"konnectivity-agent-8h25q\" (UID: \"16f30c9c-72f7-4d93-a0e8-9617958d76dd\") " pod="kube-system/konnectivity-agent-8h25q" Jul 12 19:22:10.180839 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179518 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/89fef961-c465-49fc-a683-244057d342fc-hosts-file\") pod \"node-resolver-s4snc\" (UID: \"89fef961-c465-49fc-a683-244057d342fc\") " pod="openshift-dns/node-resolver-s4snc" Jul 12 19:22:10.180839 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179549 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-multus-cni-dir\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.180839 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179563 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/c147ccfb-342a-4958-b365-f730046bebce-serviceca\") pod \"node-ca-kfgnm\" (UID: \"c147ccfb-342a-4958-b365-f730046bebce\") " pod="openshift-image-registry/node-ca-kfgnm" Jul 12 19:22:10.180839 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179576 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-host-var-lib-cni-bin\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.180839 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179563 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/6fd77a07-b4ea-4261-b1d9-0bf31aaf270c-iptables-alerter-script\") pod \"iptables-alerter-74f6p\" (UID: \"6fd77a07-b4ea-4261-b1d9-0bf31aaf270c\") " pod="openshift-network-operator/iptables-alerter-74f6p" Jul 12 19:22:10.180839 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179578 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/12a7f674-5f12-4dfe-a936-75d1fedafaea-etc-sysctl-conf\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.180839 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179614 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12a7f674-5f12-4dfe-a936-75d1fedafaea-sys\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.180839 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179638 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12a7f674-5f12-4dfe-a936-75d1fedafaea-tmp\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.181570 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179658 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-host-run-ovn-kubernetes\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.181570 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179668 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/89fef961-c465-49fc-a683-244057d342fc-hosts-file\") pod \"node-resolver-s4snc\" (UID: \"89fef961-c465-49fc-a683-244057d342fc\") " pod="openshift-dns/node-resolver-s4snc" Jul 12 19:22:10.181570 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179682 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/888aafef-f377-46e3-a36b-58cbabc198f8-ovnkube-script-lib\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.181570 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179686 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/888aafef-f377-46e3-a36b-58cbabc198f8-ovnkube-config\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.181570 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179706 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-multus-socket-dir-parent\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.181570 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179717 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-host-run-ovn-kubernetes\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.181570 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179735 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-host-var-lib-kubelet\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.181570 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179755 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-multus-cni-dir\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.181570 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179761 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-multus-socket-dir-parent\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.181570 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179760 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-multus-conf-dir\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.181570 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179802 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-multus-conf-dir\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.181570 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179814 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-host-var-lib-kubelet\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.181570 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179844 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c648764a-13c5-4cea-9dbc-dcfdcc308d68-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9z5dq\" (UID: \"c648764a-13c5-4cea-9dbc-dcfdcc308d68\") " pod="openshift-multus/multus-additional-cni-plugins-9z5dq" Jul 12 19:22:10.181570 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179848 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/12a7f674-5f12-4dfe-a936-75d1fedafaea-sys\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.181570 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179872 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/12a7f674-5f12-4dfe-a936-75d1fedafaea-etc-sysconfig\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.182429 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179899 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/888aafef-f377-46e3-a36b-58cbabc198f8-ovn-node-metrics-cert\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.182429 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179924 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89fef961-c465-49fc-a683-244057d342fc-tmp-dir\") pod \"node-resolver-s4snc\" (UID: \"89fef961-c465-49fc-a683-244057d342fc\") " pod="openshift-dns/node-resolver-s4snc" Jul 12 19:22:10.182429 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179951 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c648764a-13c5-4cea-9dbc-dcfdcc308d68-os-release\") pod \"multus-additional-cni-plugins-9z5dq\" (UID: \"c648764a-13c5-4cea-9dbc-dcfdcc308d68\") " pod="openshift-multus/multus-additional-cni-plugins-9z5dq" Jul 12 19:22:10.182429 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179964 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/12a7f674-5f12-4dfe-a936-75d1fedafaea-etc-sysconfig\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.182429 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.179980 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c648764a-13c5-4cea-9dbc-dcfdcc308d68-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9z5dq\" (UID: \"c648764a-13c5-4cea-9dbc-dcfdcc308d68\") " pod="openshift-multus/multus-additional-cni-plugins-9z5dq" Jul 12 19:22:10.182429 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180007 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8c081df9-b94a-459b-9e88-973863d95019-registration-dir\") pod \"aws-ebs-csi-driver-node-kzr2z\" (UID: \"8c081df9-b94a-459b-9e88-973863d95019\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzr2z" Jul 12 19:22:10.182429 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180032 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12a7f674-5f12-4dfe-a936-75d1fedafaea-etc-kubernetes\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.182429 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180055 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/12a7f674-5f12-4dfe-a936-75d1fedafaea-etc-tuned\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.182429 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180097 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-node-log\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.182429 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180122 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-host-run-netns\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.182429 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180148 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/12a7f674-5f12-4dfe-a936-75d1fedafaea-lib-modules\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.182429 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180174 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12a7f674-5f12-4dfe-a936-75d1fedafaea-var-lib-kubelet\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.182429 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180198 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6fd77a07-b4ea-4261-b1d9-0bf31aaf270c-host-slash\") pod \"iptables-alerter-74f6p\" (UID: \"6fd77a07-b4ea-4261-b1d9-0bf31aaf270c\") " pod="openshift-network-operator/iptables-alerter-74f6p" Jul 12 19:22:10.182429 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180227 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dh5jg\" (UniqueName: \"kubernetes.io/projected/89fef961-c465-49fc-a683-244057d342fc-kube-api-access-dh5jg\") pod \"node-resolver-s4snc\" (UID: \"89fef961-c465-49fc-a683-244057d342fc\") " pod="openshift-dns/node-resolver-s4snc" Jul 12 19:22:10.183188 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180251 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-cnibin\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.183188 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180276 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-host-var-lib-cni-multus\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.183188 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180284 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/888aafef-f377-46e3-a36b-58cbabc198f8-ovnkube-script-lib\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.183188 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180297 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/16f30c9c-72f7-4d93-a0e8-9617958d76dd-konnectivity-ca\") pod \"konnectivity-agent-8h25q\" (UID: \"16f30c9c-72f7-4d93-a0e8-9617958d76dd\") " pod="kube-system/konnectivity-agent-8h25q" Jul 12 19:22:10.183188 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180297 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-host-run-netns\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.183188 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180302 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c147ccfb-342a-4958-b365-f730046bebce-host\") pod \"node-ca-kfgnm\" (UID: \"c147ccfb-342a-4958-b365-f730046bebce\") " pod="openshift-image-registry/node-ca-kfgnm" Jul 12 19:22:10.183188 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180354 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c147ccfb-342a-4958-b365-f730046bebce-host\") pod \"node-ca-kfgnm\" (UID: \"c147ccfb-342a-4958-b365-f730046bebce\") " pod="openshift-image-registry/node-ca-kfgnm" Jul 12 19:22:10.183188 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180361 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-host-var-lib-cni-multus\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.183188 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180355 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8c081df9-b94a-459b-9e88-973863d95019-device-dir\") pod \"aws-ebs-csi-driver-node-kzr2z\" (UID: \"8c081df9-b94a-459b-9e88-973863d95019\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzr2z" Jul 12 19:22:10.183188 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180394 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8c081df9-b94a-459b-9e88-973863d95019-device-dir\") pod \"aws-ebs-csi-driver-node-kzr2z\" (UID: \"8c081df9-b94a-459b-9e88-973863d95019\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzr2z" Jul 12 19:22:10.183188 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180399 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-var-lib-openvswitch\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.183188 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180411 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-host-var-lib-cni-bin\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.183188 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180436 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-var-lib-openvswitch\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.183188 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180463 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8c081df9-b94a-459b-9e88-973863d95019-registration-dir\") pod \"aws-ebs-csi-driver-node-kzr2z\" (UID: \"8c081df9-b94a-459b-9e88-973863d95019\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzr2z" Jul 12 19:22:10.183188 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180489 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c648764a-13c5-4cea-9dbc-dcfdcc308d68-os-release\") pod \"multus-additional-cni-plugins-9z5dq\" (UID: \"c648764a-13c5-4cea-9dbc-dcfdcc308d68\") " pod="openshift-multus/multus-additional-cni-plugins-9z5dq" Jul 12 19:22:10.183875 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180504 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/12a7f674-5f12-4dfe-a936-75d1fedafaea-lib-modules\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.183875 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180528 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-node-log\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.183875 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180535 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c648764a-13c5-4cea-9dbc-dcfdcc308d68-tuning-conf-dir\") pod \"multus-additional-cni-plugins-9z5dq\" (UID: \"c648764a-13c5-4cea-9dbc-dcfdcc308d68\") " pod="openshift-multus/multus-additional-cni-plugins-9z5dq" Jul 12 19:22:10.183875 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180538 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-log-socket\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.183875 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180570 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-log-socket\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.183875 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180584 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-flzfb\" (UniqueName: \"kubernetes.io/projected/888aafef-f377-46e3-a36b-58cbabc198f8-kube-api-access-flzfb\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.183875 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180614 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97eab1be-059f-4563-ac6c-30b4edf4aa79-cni-binary-copy\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.183875 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180619 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/12a7f674-5f12-4dfe-a936-75d1fedafaea-var-lib-kubelet\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.183875 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180625 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c648764a-13c5-4cea-9dbc-dcfdcc308d68-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-9z5dq\" (UID: \"c648764a-13c5-4cea-9dbc-dcfdcc308d68\") " pod="openshift-multus/multus-additional-cni-plugins-9z5dq" Jul 12 19:22:10.183875 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180642 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-hostroot\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.183875 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180664 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-cnibin\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.183875 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180669 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ls95\" (UniqueName: \"kubernetes.io/projected/12a7f674-5f12-4dfe-a936-75d1fedafaea-kube-api-access-6ls95\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.183875 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180674 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12a7f674-5f12-4dfe-a936-75d1fedafaea-etc-kubernetes\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.183875 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180697 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8c081df9-b94a-459b-9e88-973863d95019-sys-fs\") pod \"aws-ebs-csi-driver-node-kzr2z\" (UID: \"8c081df9-b94a-459b-9e88-973863d95019\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzr2z" Jul 12 19:22:10.183875 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180712 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-hostroot\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.184377 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180725 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.184377 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180755 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/97eab1be-059f-4563-ac6c-30b4edf4aa79-multus-daemon-config\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.184377 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180758 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8c081df9-b94a-459b-9e88-973863d95019-sys-fs\") pod \"aws-ebs-csi-driver-node-kzr2z\" (UID: \"8c081df9-b94a-459b-9e88-973863d95019\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzr2z" Jul 12 19:22:10.184377 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180780 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c648764a-13c5-4cea-9dbc-dcfdcc308d68-cnibin\") pod \"multus-additional-cni-plugins-9z5dq\" (UID: \"c648764a-13c5-4cea-9dbc-dcfdcc308d68\") " pod="openshift-multus/multus-additional-cni-plugins-9z5dq" Jul 12 19:22:10.184377 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180806 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/12a7f674-5f12-4dfe-a936-75d1fedafaea-run\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.184377 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180829 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-host-kubelet\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.184377 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180860 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-etc-openvswitch\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.184377 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180886 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gfxt\" (UniqueName: \"kubernetes.io/projected/97eab1be-059f-4563-ac6c-30b4edf4aa79-kube-api-access-6gfxt\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.184377 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180911 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8c081df9-b94a-459b-9e88-973863d95019-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kzr2z\" (UID: \"8c081df9-b94a-459b-9e88-973863d95019\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzr2z" Jul 12 19:22:10.184377 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180935 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-host-run-multus-certs\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.184377 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180963 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c648764a-13c5-4cea-9dbc-dcfdcc308d68-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9z5dq\" (UID: \"c648764a-13c5-4cea-9dbc-dcfdcc308d68\") " pod="openshift-multus/multus-additional-cni-plugins-9z5dq" Jul 12 19:22:10.184377 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180981 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-host-kubelet\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.184377 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.180991 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8c081df9-b94a-459b-9e88-973863d95019-etc-selinux\") pod \"aws-ebs-csi-driver-node-kzr2z\" (UID: \"8c081df9-b94a-459b-9e88-973863d95019\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzr2z" Jul 12 19:22:10.184377 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.181018 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-run-openvswitch\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.184826 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.181023 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c648764a-13c5-4cea-9dbc-dcfdcc308d68-cnibin\") pod \"multus-additional-cni-plugins-9z5dq\" (UID: \"c648764a-13c5-4cea-9dbc-dcfdcc308d68\") " pod="openshift-multus/multus-additional-cni-plugins-9z5dq" Jul 12 19:22:10.184826 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.181119 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/97eab1be-059f-4563-ac6c-30b4edf4aa79-host-run-multus-certs\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.184826 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.181161 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/97eab1be-059f-4563-ac6c-30b4edf4aa79-cni-binary-copy\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.184826 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.181233 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.184826 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.181276 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/6fd77a07-b4ea-4261-b1d9-0bf31aaf270c-host-slash\") pod \"iptables-alerter-74f6p\" (UID: \"6fd77a07-b4ea-4261-b1d9-0bf31aaf270c\") " pod="openshift-network-operator/iptables-alerter-74f6p" Jul 12 19:22:10.184826 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.181317 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-run-openvswitch\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.184826 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.181319 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/97eab1be-059f-4563-ac6c-30b4edf4aa79-multus-daemon-config\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.184826 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.181358 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/12a7f674-5f12-4dfe-a936-75d1fedafaea-run\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.184826 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.181401 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8c081df9-b94a-459b-9e88-973863d95019-kubelet-dir\") pod \"aws-ebs-csi-driver-node-kzr2z\" (UID: \"8c081df9-b94a-459b-9e88-973863d95019\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzr2z" Jul 12 19:22:10.184826 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.181414 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8c081df9-b94a-459b-9e88-973863d95019-etc-selinux\") pod \"aws-ebs-csi-driver-node-kzr2z\" (UID: \"8c081df9-b94a-459b-9e88-973863d95019\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzr2z" Jul 12 19:22:10.184826 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.181454 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/888aafef-f377-46e3-a36b-58cbabc198f8-etc-openvswitch\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.184826 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.181546 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c648764a-13c5-4cea-9dbc-dcfdcc308d68-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-9z5dq\" (UID: \"c648764a-13c5-4cea-9dbc-dcfdcc308d68\") " pod="openshift-multus/multus-additional-cni-plugins-9z5dq" Jul 12 19:22:10.184826 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.181687 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/89fef961-c465-49fc-a683-244057d342fc-tmp-dir\") pod \"node-resolver-s4snc\" (UID: \"89fef961-c465-49fc-a683-244057d342fc\") " pod="openshift-dns/node-resolver-s4snc" Jul 12 19:22:10.184826 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.183621 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/12a7f674-5f12-4dfe-a936-75d1fedafaea-etc-tuned\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.184826 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.183657 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/888aafef-f377-46e3-a36b-58cbabc198f8-ovn-node-metrics-cert\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.185326 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.183683 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/12a7f674-5f12-4dfe-a936-75d1fedafaea-tmp\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.185326 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.183770 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/16f30c9c-72f7-4d93-a0e8-9617958d76dd-agent-certs\") pod \"konnectivity-agent-8h25q\" (UID: \"16f30c9c-72f7-4d93-a0e8-9617958d76dd\") " pod="kube-system/konnectivity-agent-8h25q" Jul 12 19:22:10.186923 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.186882 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gg9t9\" (UniqueName: \"kubernetes.io/projected/0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52-kube-api-access-gg9t9\") pod \"network-metrics-daemon-sv9f6\" (UID: \"0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52\") " pod="openshift-multus/network-metrics-daemon-sv9f6" Jul 12 19:22:10.193026 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:10.192984 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 19:22:10.193026 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:10.193023 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 19:22:10.193330 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:10.193037 2576 projected.go:196] Error preparing data for projected volume kube-api-access-446z8 for pod openshift-network-diagnostics/network-check-target-6fxlg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 19:22:10.193330 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:10.193150 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/239fb2a7-5ee3-4efe-8878-7e2f8dd795de-kube-api-access-446z8 podName:239fb2a7-5ee3-4efe-8878-7e2f8dd795de nodeName:}" failed. No retries permitted until 2026-07-12 19:22:10.693130925 +0000 UTC m=+2.147723886 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-446z8" (UniqueName: "kubernetes.io/projected/239fb2a7-5ee3-4efe-8878-7e2f8dd795de-kube-api-access-446z8") pod "network-check-target-6fxlg" (UID: "239fb2a7-5ee3-4efe-8878-7e2f8dd795de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 19:22:10.194732 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.194680 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-stlxw\" (UniqueName: \"kubernetes.io/projected/c648764a-13c5-4cea-9dbc-dcfdcc308d68-kube-api-access-stlxw\") pod \"multus-additional-cni-plugins-9z5dq\" (UID: \"c648764a-13c5-4cea-9dbc-dcfdcc308d68\") " pod="openshift-multus/multus-additional-cni-plugins-9z5dq" Jul 12 19:22:10.194886 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.194816 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gfxt\" (UniqueName: \"kubernetes.io/projected/97eab1be-059f-4563-ac6c-30b4edf4aa79-kube-api-access-6gfxt\") pod \"multus-56fhk\" (UID: \"97eab1be-059f-4563-ac6c-30b4edf4aa79\") " pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.195033 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.194977 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wh92k\" (UniqueName: \"kubernetes.io/projected/6fd77a07-b4ea-4261-b1d9-0bf31aaf270c-kube-api-access-wh92k\") pod \"iptables-alerter-74f6p\" (UID: \"6fd77a07-b4ea-4261-b1d9-0bf31aaf270c\") " pod="openshift-network-operator/iptables-alerter-74f6p" Jul 12 19:22:10.195033 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.194975 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dh5jg\" (UniqueName: \"kubernetes.io/projected/89fef961-c465-49fc-a683-244057d342fc-kube-api-access-dh5jg\") pod \"node-resolver-s4snc\" (UID: \"89fef961-c465-49fc-a683-244057d342fc\") " pod="openshift-dns/node-resolver-s4snc" Jul 12 19:22:10.195328 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.195140 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ls95\" (UniqueName: \"kubernetes.io/projected/12a7f674-5f12-4dfe-a936-75d1fedafaea-kube-api-access-6ls95\") pod \"tuned-jc8b5\" (UID: \"12a7f674-5f12-4dfe-a936-75d1fedafaea\") " pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.195451 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.195431 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrs7q\" (UniqueName: \"kubernetes.io/projected/c147ccfb-342a-4958-b365-f730046bebce-kube-api-access-xrs7q\") pod \"node-ca-kfgnm\" (UID: \"c147ccfb-342a-4958-b365-f730046bebce\") " pod="openshift-image-registry/node-ca-kfgnm" Jul 12 19:22:10.195810 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.195788 2576 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 12 19:22:10.196041 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.196023 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zcc8\" (UniqueName: \"kubernetes.io/projected/8c081df9-b94a-459b-9e88-973863d95019-kube-api-access-7zcc8\") pod \"aws-ebs-csi-driver-node-kzr2z\" (UID: \"8c081df9-b94a-459b-9e88-973863d95019\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzr2z" Jul 12 19:22:10.196543 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.196521 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-flzfb\" (UniqueName: \"kubernetes.io/projected/888aafef-f377-46e3-a36b-58cbabc198f8-kube-api-access-flzfb\") pod \"ovnkube-node-mj4zs\" (UID: \"888aafef-f377-46e3-a36b-58cbabc198f8\") " pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.289997 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.289974 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8h25q" Jul 12 19:22:10.298135 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:10.298112 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16f30c9c_72f7_4d93_a0e8_9617958d76dd.slice/crio-e9f0326deb360fddbc0b3f9193bc2b7093bf1276876087768a8be68201737dba WatchSource:0}: Error finding container e9f0326deb360fddbc0b3f9193bc2b7093bf1276876087768a8be68201737dba: Status 404 returned error can't find the container with id e9f0326deb360fddbc0b3f9193bc2b7093bf1276876087768a8be68201737dba Jul 12 19:22:10.326334 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.326298 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-s4snc" Jul 12 19:22:10.333498 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:10.333472 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89fef961_c465_49fc_a683_244057d342fc.slice/crio-b4c696794faa083a1952667781e454bc75ec9b4b34969954075e46dd72fe7a81 WatchSource:0}: Error finding container b4c696794faa083a1952667781e454bc75ec9b4b34969954075e46dd72fe7a81: Status 404 returned error can't find the container with id b4c696794faa083a1952667781e454bc75ec9b4b34969954075e46dd72fe7a81 Jul 12 19:22:10.337643 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.337627 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-kfgnm" Jul 12 19:22:10.341504 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.341488 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-56fhk" Jul 12 19:22:10.346225 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:10.346200 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc147ccfb_342a_4958_b365_f730046bebce.slice/crio-7fa0acbe6b6d1589d4e34889e952b1269d5693138972fe968f01bc13bd71b5e4 WatchSource:0}: Error finding container 7fa0acbe6b6d1589d4e34889e952b1269d5693138972fe968f01bc13bd71b5e4: Status 404 returned error can't find the container with id 7fa0acbe6b6d1589d4e34889e952b1269d5693138972fe968f01bc13bd71b5e4 Jul 12 19:22:10.347444 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.347428 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-9z5dq" Jul 12 19:22:10.352610 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:10.352589 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97eab1be_059f_4563_ac6c_30b4edf4aa79.slice/crio-7014d4d33386422b209059c1b3b5ff78d207faeedc1557c50765f9aae97fff10 WatchSource:0}: Error finding container 7014d4d33386422b209059c1b3b5ff78d207faeedc1557c50765f9aae97fff10: Status 404 returned error can't find the container with id 7014d4d33386422b209059c1b3b5ff78d207faeedc1557c50765f9aae97fff10 Jul 12 19:22:10.354999 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.354940 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-74f6p" Jul 12 19:22:10.356247 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:10.356199 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc648764a_13c5_4cea_9dbc_dcfdcc308d68.slice/crio-f58547917d8ef07131986debac8f073da37ebd16e52ac320e7991731c663b9cf WatchSource:0}: Error finding container f58547917d8ef07131986debac8f073da37ebd16e52ac320e7991731c663b9cf: Status 404 returned error can't find the container with id f58547917d8ef07131986debac8f073da37ebd16e52ac320e7991731c663b9cf Jul 12 19:22:10.360717 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.360695 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzr2z" Jul 12 19:22:10.365594 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.365577 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" Jul 12 19:22:10.367719 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:10.367701 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c081df9_b94a_459b_9e88_973863d95019.slice/crio-2597cdaf56957b20a90978e587843a54585415a06bfbc44713c3fa4712110b25 WatchSource:0}: Error finding container 2597cdaf56957b20a90978e587843a54585415a06bfbc44713c3fa4712110b25: Status 404 returned error can't find the container with id 2597cdaf56957b20a90978e587843a54585415a06bfbc44713c3fa4712110b25 Jul 12 19:22:10.371490 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.371435 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:10.372863 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:10.372844 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12a7f674_5f12_4dfe_a936_75d1fedafaea.slice/crio-d5832d5d4119e1fedc6e58a8904541e2e73067e4c4312f73a47093f3e1979681 WatchSource:0}: Error finding container d5832d5d4119e1fedc6e58a8904541e2e73067e4c4312f73a47093f3e1979681: Status 404 returned error can't find the container with id d5832d5d4119e1fedc6e58a8904541e2e73067e4c4312f73a47093f3e1979681 Jul 12 19:22:10.378496 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:22:10.378473 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod888aafef_f377_46e3_a36b_58cbabc198f8.slice/crio-52c950022fc419a770a60a18817e373f2cdfb53bf6e86bc8bcbb116b92d711e0 WatchSource:0}: Error finding container 52c950022fc419a770a60a18817e373f2cdfb53bf6e86bc8bcbb116b92d711e0: Status 404 returned error can't find the container with id 52c950022fc419a770a60a18817e373f2cdfb53bf6e86bc8bcbb116b92d711e0 Jul 12 19:22:10.684517 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.684485 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3855f17-6f1a-4a9e-841e-bfda15547d26-original-pull-secret\") pod \"global-pull-secret-syncer-7xr84\" (UID: \"c3855f17-6f1a-4a9e-841e-bfda15547d26\") " pod="kube-system/global-pull-secret-syncer-7xr84" Jul 12 19:22:10.684710 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.684531 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52-metrics-certs\") pod \"network-metrics-daemon-sv9f6\" (UID: \"0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52\") " pod="openshift-multus/network-metrics-daemon-sv9f6" Jul 12 19:22:10.684710 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:10.684657 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 19:22:10.684710 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:10.684660 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 19:22:10.684885 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:10.684725 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52-metrics-certs podName:0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52 nodeName:}" failed. No retries permitted until 2026-07-12 19:22:11.684704837 +0000 UTC m=+3.139297787 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52-metrics-certs") pod "network-metrics-daemon-sv9f6" (UID: "0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 19:22:10.684885 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:10.684745 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3855f17-6f1a-4a9e-841e-bfda15547d26-original-pull-secret podName:c3855f17-6f1a-4a9e-841e-bfda15547d26 nodeName:}" failed. No retries permitted until 2026-07-12 19:22:11.684734843 +0000 UTC m=+3.139327786 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3855f17-6f1a-4a9e-841e-bfda15547d26-original-pull-secret") pod "global-pull-secret-syncer-7xr84" (UID: "c3855f17-6f1a-4a9e-841e-bfda15547d26") : object "kube-system"/"original-pull-secret" not registered Jul 12 19:22:10.785883 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:10.785846 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-446z8\" (UniqueName: \"kubernetes.io/projected/239fb2a7-5ee3-4efe-8878-7e2f8dd795de-kube-api-access-446z8\") pod \"network-check-target-6fxlg\" (UID: \"239fb2a7-5ee3-4efe-8878-7e2f8dd795de\") " pod="openshift-network-diagnostics/network-check-target-6fxlg" Jul 12 19:22:10.786096 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:10.786034 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 19:22:10.786096 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:10.786053 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 19:22:10.786096 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:10.786067 2576 projected.go:196] Error preparing data for projected volume kube-api-access-446z8 for pod openshift-network-diagnostics/network-check-target-6fxlg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 19:22:10.786267 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:10.786135 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/239fb2a7-5ee3-4efe-8878-7e2f8dd795de-kube-api-access-446z8 podName:239fb2a7-5ee3-4efe-8878-7e2f8dd795de nodeName:}" failed. No retries permitted until 2026-07-12 19:22:11.786116519 +0000 UTC m=+3.240709465 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-446z8" (UniqueName: "kubernetes.io/projected/239fb2a7-5ee3-4efe-8878-7e2f8dd795de-kube-api-access-446z8") pod "network-check-target-6fxlg" (UID: "239fb2a7-5ee3-4efe-8878-7e2f8dd795de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 19:22:11.022884 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:11.022772 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-11 19:17:10 +0000 UTC" deadline="2027-12-08 08:20:19.124884447 +0000 UTC" Jul 12 19:22:11.022884 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:11.022834 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12324h58m8.102054681s" Jul 12 19:22:11.079817 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:11.079782 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv9f6" Jul 12 19:22:11.079982 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:11.079935 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sv9f6" podUID="0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52" Jul 12 19:22:11.080392 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:11.080367 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fxlg" Jul 12 19:22:11.080502 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:11.080478 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fxlg" podUID="239fb2a7-5ee3-4efe-8878-7e2f8dd795de" Jul 12 19:22:11.104534 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:11.104029 2576 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 12 19:22:11.107864 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:11.107767 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzr2z" event={"ID":"8c081df9-b94a-459b-9e88-973863d95019","Type":"ContainerStarted","Data":"2597cdaf56957b20a90978e587843a54585415a06bfbc44713c3fa4712110b25"} Jul 12 19:22:11.123150 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:11.123121 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-74f6p" event={"ID":"6fd77a07-b4ea-4261-b1d9-0bf31aaf270c","Type":"ContainerStarted","Data":"5116e39db839c3f23db2a655984735f4e90793e588a5db26715ed762565564e5"} Jul 12 19:22:11.149394 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:11.149316 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9z5dq" event={"ID":"c648764a-13c5-4cea-9dbc-dcfdcc308d68","Type":"ContainerStarted","Data":"f58547917d8ef07131986debac8f073da37ebd16e52ac320e7991731c663b9cf"} Jul 12 19:22:11.154213 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:11.154185 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-56fhk" event={"ID":"97eab1be-059f-4563-ac6c-30b4edf4aa79","Type":"ContainerStarted","Data":"7014d4d33386422b209059c1b3b5ff78d207faeedc1557c50765f9aae97fff10"} Jul 12 19:22:11.160845 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:11.160759 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kfgnm" event={"ID":"c147ccfb-342a-4958-b365-f730046bebce","Type":"ContainerStarted","Data":"7fa0acbe6b6d1589d4e34889e952b1269d5693138972fe968f01bc13bd71b5e4"} Jul 12 19:22:11.174087 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:11.174047 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s4snc" event={"ID":"89fef961-c465-49fc-a683-244057d342fc","Type":"ContainerStarted","Data":"b4c696794faa083a1952667781e454bc75ec9b4b34969954075e46dd72fe7a81"} Jul 12 19:22:11.195383 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:11.195294 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" event={"ID":"888aafef-f377-46e3-a36b-58cbabc198f8","Type":"ContainerStarted","Data":"52c950022fc419a770a60a18817e373f2cdfb53bf6e86bc8bcbb116b92d711e0"} Jul 12 19:22:11.200798 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:11.200761 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" event={"ID":"12a7f674-5f12-4dfe-a936-75d1fedafaea","Type":"ContainerStarted","Data":"d5832d5d4119e1fedc6e58a8904541e2e73067e4c4312f73a47093f3e1979681"} Jul 12 19:22:11.211706 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:11.211676 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8h25q" event={"ID":"16f30c9c-72f7-4d93-a0e8-9617958d76dd","Type":"ContainerStarted","Data":"e9f0326deb360fddbc0b3f9193bc2b7093bf1276876087768a8be68201737dba"} Jul 12 19:22:11.410720 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:11.410577 2576 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 12 19:22:11.693734 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:11.693649 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3855f17-6f1a-4a9e-841e-bfda15547d26-original-pull-secret\") pod \"global-pull-secret-syncer-7xr84\" (UID: \"c3855f17-6f1a-4a9e-841e-bfda15547d26\") " pod="kube-system/global-pull-secret-syncer-7xr84" Jul 12 19:22:11.693734 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:11.693700 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52-metrics-certs\") pod \"network-metrics-daemon-sv9f6\" (UID: \"0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52\") " pod="openshift-multus/network-metrics-daemon-sv9f6" Jul 12 19:22:11.694103 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:11.693846 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 19:22:11.694103 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:11.693865 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 19:22:11.694103 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:11.693921 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3855f17-6f1a-4a9e-841e-bfda15547d26-original-pull-secret podName:c3855f17-6f1a-4a9e-841e-bfda15547d26 nodeName:}" failed. No retries permitted until 2026-07-12 19:22:13.693898933 +0000 UTC m=+5.148491876 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3855f17-6f1a-4a9e-841e-bfda15547d26-original-pull-secret") pod "global-pull-secret-syncer-7xr84" (UID: "c3855f17-6f1a-4a9e-841e-bfda15547d26") : object "kube-system"/"original-pull-secret" not registered Jul 12 19:22:11.694103 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:11.693944 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52-metrics-certs podName:0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52 nodeName:}" failed. No retries permitted until 2026-07-12 19:22:13.693932807 +0000 UTC m=+5.148525755 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52-metrics-certs") pod "network-metrics-daemon-sv9f6" (UID: "0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 19:22:11.794457 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:11.794421 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-446z8\" (UniqueName: \"kubernetes.io/projected/239fb2a7-5ee3-4efe-8878-7e2f8dd795de-kube-api-access-446z8\") pod \"network-check-target-6fxlg\" (UID: \"239fb2a7-5ee3-4efe-8878-7e2f8dd795de\") " pod="openshift-network-diagnostics/network-check-target-6fxlg" Jul 12 19:22:11.794628 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:11.794591 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 19:22:11.794628 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:11.794612 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 19:22:11.794628 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:11.794624 2576 projected.go:196] Error preparing data for projected volume kube-api-access-446z8 for pod openshift-network-diagnostics/network-check-target-6fxlg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 19:22:11.794814 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:11.794689 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/239fb2a7-5ee3-4efe-8878-7e2f8dd795de-kube-api-access-446z8 podName:239fb2a7-5ee3-4efe-8878-7e2f8dd795de nodeName:}" failed. No retries permitted until 2026-07-12 19:22:13.794673753 +0000 UTC m=+5.249266696 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-446z8" (UniqueName: "kubernetes.io/projected/239fb2a7-5ee3-4efe-8878-7e2f8dd795de-kube-api-access-446z8") pod "network-check-target-6fxlg" (UID: "239fb2a7-5ee3-4efe-8878-7e2f8dd795de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 19:22:12.023128 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:12.022981 2576 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-11 19:17:10 +0000 UTC" deadline="2027-12-19 11:38:53.001979013 +0000 UTC" Jul 12 19:22:12.023128 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:12.023062 2576 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12592h16m40.978921588s" Jul 12 19:22:12.077647 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:12.077610 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xr84" Jul 12 19:22:12.077835 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:12.077757 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xr84" podUID="c3855f17-6f1a-4a9e-841e-bfda15547d26" Jul 12 19:22:12.955364 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:12.955100 2576 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 12 19:22:13.080220 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:13.079543 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv9f6" Jul 12 19:22:13.080220 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:13.079688 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sv9f6" podUID="0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52" Jul 12 19:22:13.080220 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:13.080023 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fxlg" Jul 12 19:22:13.080220 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:13.080153 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fxlg" podUID="239fb2a7-5ee3-4efe-8878-7e2f8dd795de" Jul 12 19:22:13.715402 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:13.715364 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3855f17-6f1a-4a9e-841e-bfda15547d26-original-pull-secret\") pod \"global-pull-secret-syncer-7xr84\" (UID: \"c3855f17-6f1a-4a9e-841e-bfda15547d26\") " pod="kube-system/global-pull-secret-syncer-7xr84" Jul 12 19:22:13.715607 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:13.715416 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52-metrics-certs\") pod \"network-metrics-daemon-sv9f6\" (UID: \"0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52\") " pod="openshift-multus/network-metrics-daemon-sv9f6" Jul 12 19:22:13.715607 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:13.715566 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 19:22:13.715738 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:13.715628 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52-metrics-certs podName:0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52 nodeName:}" failed. No retries permitted until 2026-07-12 19:22:17.715607274 +0000 UTC m=+9.170200221 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52-metrics-certs") pod "network-metrics-daemon-sv9f6" (UID: "0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 19:22:13.716173 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:13.716085 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 19:22:13.716173 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:13.716149 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3855f17-6f1a-4a9e-841e-bfda15547d26-original-pull-secret podName:c3855f17-6f1a-4a9e-841e-bfda15547d26 nodeName:}" failed. No retries permitted until 2026-07-12 19:22:17.716128893 +0000 UTC m=+9.170721855 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3855f17-6f1a-4a9e-841e-bfda15547d26-original-pull-secret") pod "global-pull-secret-syncer-7xr84" (UID: "c3855f17-6f1a-4a9e-841e-bfda15547d26") : object "kube-system"/"original-pull-secret" not registered Jul 12 19:22:13.816384 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:13.816348 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-446z8\" (UniqueName: \"kubernetes.io/projected/239fb2a7-5ee3-4efe-8878-7e2f8dd795de-kube-api-access-446z8\") pod \"network-check-target-6fxlg\" (UID: \"239fb2a7-5ee3-4efe-8878-7e2f8dd795de\") " pod="openshift-network-diagnostics/network-check-target-6fxlg" Jul 12 19:22:13.816546 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:13.816497 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 19:22:13.816546 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:13.816517 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 19:22:13.816546 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:13.816531 2576 projected.go:196] Error preparing data for projected volume kube-api-access-446z8 for pod openshift-network-diagnostics/network-check-target-6fxlg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 19:22:13.816717 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:13.816587 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/239fb2a7-5ee3-4efe-8878-7e2f8dd795de-kube-api-access-446z8 podName:239fb2a7-5ee3-4efe-8878-7e2f8dd795de nodeName:}" failed. No retries permitted until 2026-07-12 19:22:17.816568421 +0000 UTC m=+9.271161383 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-446z8" (UniqueName: "kubernetes.io/projected/239fb2a7-5ee3-4efe-8878-7e2f8dd795de-kube-api-access-446z8") pod "network-check-target-6fxlg" (UID: "239fb2a7-5ee3-4efe-8878-7e2f8dd795de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 19:22:14.077867 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:14.077283 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xr84" Jul 12 19:22:14.077867 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:14.077416 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xr84" podUID="c3855f17-6f1a-4a9e-841e-bfda15547d26" Jul 12 19:22:15.077516 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:15.077484 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv9f6" Jul 12 19:22:15.078152 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:15.077484 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fxlg" Jul 12 19:22:15.078152 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:15.077644 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sv9f6" podUID="0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52" Jul 12 19:22:15.078152 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:15.077704 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fxlg" podUID="239fb2a7-5ee3-4efe-8878-7e2f8dd795de" Jul 12 19:22:16.078001 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:16.077939 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xr84" Jul 12 19:22:16.078523 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:16.078098 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xr84" podUID="c3855f17-6f1a-4a9e-841e-bfda15547d26" Jul 12 19:22:17.078023 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:17.077462 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fxlg" Jul 12 19:22:17.078023 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:17.077580 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fxlg" podUID="239fb2a7-5ee3-4efe-8878-7e2f8dd795de" Jul 12 19:22:17.078023 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:17.077954 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv9f6" Jul 12 19:22:17.078740 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:17.078694 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sv9f6" podUID="0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52" Jul 12 19:22:17.750997 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:17.750208 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3855f17-6f1a-4a9e-841e-bfda15547d26-original-pull-secret\") pod \"global-pull-secret-syncer-7xr84\" (UID: \"c3855f17-6f1a-4a9e-841e-bfda15547d26\") " pod="kube-system/global-pull-secret-syncer-7xr84" Jul 12 19:22:17.750997 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:17.750296 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52-metrics-certs\") pod \"network-metrics-daemon-sv9f6\" (UID: \"0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52\") " pod="openshift-multus/network-metrics-daemon-sv9f6" Jul 12 19:22:17.750997 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:17.750433 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 19:22:17.750997 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:17.750546 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52-metrics-certs podName:0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52 nodeName:}" failed. No retries permitted until 2026-07-12 19:22:25.750523477 +0000 UTC m=+17.205116435 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52-metrics-certs") pod "network-metrics-daemon-sv9f6" (UID: "0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 19:22:17.750997 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:17.750601 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 19:22:17.750997 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:17.750684 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3855f17-6f1a-4a9e-841e-bfda15547d26-original-pull-secret podName:c3855f17-6f1a-4a9e-841e-bfda15547d26 nodeName:}" failed. No retries permitted until 2026-07-12 19:22:25.750664988 +0000 UTC m=+17.205257935 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3855f17-6f1a-4a9e-841e-bfda15547d26-original-pull-secret") pod "global-pull-secret-syncer-7xr84" (UID: "c3855f17-6f1a-4a9e-841e-bfda15547d26") : object "kube-system"/"original-pull-secret" not registered Jul 12 19:22:17.851028 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:17.850974 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-446z8\" (UniqueName: \"kubernetes.io/projected/239fb2a7-5ee3-4efe-8878-7e2f8dd795de-kube-api-access-446z8\") pod \"network-check-target-6fxlg\" (UID: \"239fb2a7-5ee3-4efe-8878-7e2f8dd795de\") " pod="openshift-network-diagnostics/network-check-target-6fxlg" Jul 12 19:22:17.851203 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:17.851141 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 19:22:17.851203 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:17.851171 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 19:22:17.851203 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:17.851185 2576 projected.go:196] Error preparing data for projected volume kube-api-access-446z8 for pod openshift-network-diagnostics/network-check-target-6fxlg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 19:22:17.851447 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:17.851240 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/239fb2a7-5ee3-4efe-8878-7e2f8dd795de-kube-api-access-446z8 podName:239fb2a7-5ee3-4efe-8878-7e2f8dd795de nodeName:}" failed. No retries permitted until 2026-07-12 19:22:25.851221472 +0000 UTC m=+17.305814419 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-446z8" (UniqueName: "kubernetes.io/projected/239fb2a7-5ee3-4efe-8878-7e2f8dd795de-kube-api-access-446z8") pod "network-check-target-6fxlg" (UID: "239fb2a7-5ee3-4efe-8878-7e2f8dd795de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 19:22:18.078759 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:18.078161 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xr84" Jul 12 19:22:18.078759 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:18.078298 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xr84" podUID="c3855f17-6f1a-4a9e-841e-bfda15547d26" Jul 12 19:22:19.078179 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:19.078146 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv9f6" Jul 12 19:22:19.078179 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:19.078177 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fxlg" Jul 12 19:22:19.078454 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:19.078278 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sv9f6" podUID="0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52" Jul 12 19:22:19.078454 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:19.078403 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fxlg" podUID="239fb2a7-5ee3-4efe-8878-7e2f8dd795de" Jul 12 19:22:20.077507 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:20.077468 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xr84" Jul 12 19:22:20.077958 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:20.077614 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xr84" podUID="c3855f17-6f1a-4a9e-841e-bfda15547d26" Jul 12 19:22:21.077515 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:21.077484 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv9f6" Jul 12 19:22:21.077974 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:21.077602 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sv9f6" podUID="0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52" Jul 12 19:22:21.077974 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:21.077618 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fxlg" Jul 12 19:22:21.077974 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:21.077735 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fxlg" podUID="239fb2a7-5ee3-4efe-8878-7e2f8dd795de" Jul 12 19:22:22.078007 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:22.077967 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xr84" Jul 12 19:22:22.078445 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:22.078097 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xr84" podUID="c3855f17-6f1a-4a9e-841e-bfda15547d26" Jul 12 19:22:23.077538 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:23.077496 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv9f6" Jul 12 19:22:23.077721 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:23.077496 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fxlg" Jul 12 19:22:23.077721 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:23.077623 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sv9f6" podUID="0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52" Jul 12 19:22:23.077721 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:23.077665 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fxlg" podUID="239fb2a7-5ee3-4efe-8878-7e2f8dd795de" Jul 12 19:22:24.077616 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:24.077580 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xr84" Jul 12 19:22:24.078054 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:24.077692 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xr84" podUID="c3855f17-6f1a-4a9e-841e-bfda15547d26" Jul 12 19:22:25.077971 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:25.077936 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv9f6" Jul 12 19:22:25.078392 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:25.077945 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fxlg" Jul 12 19:22:25.078392 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:25.078105 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sv9f6" podUID="0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52" Jul 12 19:22:25.078392 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:25.078130 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fxlg" podUID="239fb2a7-5ee3-4efe-8878-7e2f8dd795de" Jul 12 19:22:25.807755 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:25.807714 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3855f17-6f1a-4a9e-841e-bfda15547d26-original-pull-secret\") pod \"global-pull-secret-syncer-7xr84\" (UID: \"c3855f17-6f1a-4a9e-841e-bfda15547d26\") " pod="kube-system/global-pull-secret-syncer-7xr84" Jul 12 19:22:25.807976 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:25.807767 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52-metrics-certs\") pod \"network-metrics-daemon-sv9f6\" (UID: \"0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52\") " pod="openshift-multus/network-metrics-daemon-sv9f6" Jul 12 19:22:25.807976 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:25.807881 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 19:22:25.807976 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:25.807923 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 19:22:25.807976 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:25.807970 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3855f17-6f1a-4a9e-841e-bfda15547d26-original-pull-secret podName:c3855f17-6f1a-4a9e-841e-bfda15547d26 nodeName:}" failed. No retries permitted until 2026-07-12 19:22:41.807948591 +0000 UTC m=+33.262541532 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3855f17-6f1a-4a9e-841e-bfda15547d26-original-pull-secret") pod "global-pull-secret-syncer-7xr84" (UID: "c3855f17-6f1a-4a9e-841e-bfda15547d26") : object "kube-system"/"original-pull-secret" not registered Jul 12 19:22:25.808208 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:25.808008 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52-metrics-certs podName:0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52 nodeName:}" failed. No retries permitted until 2026-07-12 19:22:41.807994992 +0000 UTC m=+33.262587948 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52-metrics-certs") pod "network-metrics-daemon-sv9f6" (UID: "0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 19:22:25.908875 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:25.908841 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-446z8\" (UniqueName: \"kubernetes.io/projected/239fb2a7-5ee3-4efe-8878-7e2f8dd795de-kube-api-access-446z8\") pod \"network-check-target-6fxlg\" (UID: \"239fb2a7-5ee3-4efe-8878-7e2f8dd795de\") " pod="openshift-network-diagnostics/network-check-target-6fxlg" Jul 12 19:22:25.909061 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:25.908997 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 19:22:25.909061 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:25.909017 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 19:22:25.909061 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:25.909026 2576 projected.go:196] Error preparing data for projected volume kube-api-access-446z8 for pod openshift-network-diagnostics/network-check-target-6fxlg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 19:22:25.909201 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:25.909081 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/239fb2a7-5ee3-4efe-8878-7e2f8dd795de-kube-api-access-446z8 podName:239fb2a7-5ee3-4efe-8878-7e2f8dd795de nodeName:}" failed. No retries permitted until 2026-07-12 19:22:41.909066774 +0000 UTC m=+33.363659716 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-446z8" (UniqueName: "kubernetes.io/projected/239fb2a7-5ee3-4efe-8878-7e2f8dd795de-kube-api-access-446z8") pod "network-check-target-6fxlg" (UID: "239fb2a7-5ee3-4efe-8878-7e2f8dd795de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 19:22:26.077726 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:26.077646 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xr84" Jul 12 19:22:26.077875 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:26.077771 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xr84" podUID="c3855f17-6f1a-4a9e-841e-bfda15547d26" Jul 12 19:22:27.077880 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:27.077848 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv9f6" Jul 12 19:22:27.078313 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:27.078005 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sv9f6" podUID="0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52" Jul 12 19:22:27.078313 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:27.078045 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fxlg" Jul 12 19:22:27.078313 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:27.078160 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fxlg" podUID="239fb2a7-5ee3-4efe-8878-7e2f8dd795de" Jul 12 19:22:28.077610 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:28.077577 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xr84" Jul 12 19:22:28.077765 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:28.077702 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xr84" podUID="c3855f17-6f1a-4a9e-841e-bfda15547d26" Jul 12 19:22:29.078923 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:29.078883 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv9f6" Jul 12 19:22:29.079340 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:29.079004 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sv9f6" podUID="0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52" Jul 12 19:22:29.079340 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:29.079039 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fxlg" Jul 12 19:22:29.079340 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:29.079145 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fxlg" podUID="239fb2a7-5ee3-4efe-8878-7e2f8dd795de" Jul 12 19:22:30.078211 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:30.078181 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xr84" Jul 12 19:22:30.078369 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:30.078289 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xr84" podUID="c3855f17-6f1a-4a9e-841e-bfda15547d26" Jul 12 19:22:31.077831 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:31.077556 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fxlg" Jul 12 19:22:31.078453 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:31.077603 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv9f6" Jul 12 19:22:31.078453 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:31.077909 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fxlg" podUID="239fb2a7-5ee3-4efe-8878-7e2f8dd795de" Jul 12 19:22:31.078453 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:31.078047 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sv9f6" podUID="0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52" Jul 12 19:22:31.255259 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:31.255226 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-63.ec2.internal" event={"ID":"b2a2874da17abefb7e09b1f75564bde1","Type":"ContainerStarted","Data":"42fd6744dc5ac6776faaf21553cf217d97071d558cfa70539b58f95efa9210b6"} Jul 12 19:22:31.256698 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:31.256674 2576 generic.go:356] "Generic (PLEG): container finished" podID="12004e7284b18d57c7b16f9e578840a6" containerID="72c91c697d78d634ab4be5e01761ce82b5baab5d6efe862f8ebcced81e3558a1" exitCode=0 Jul 12 19:22:31.256827 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:31.256740 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal" event={"ID":"12004e7284b18d57c7b16f9e578840a6","Type":"ContainerDied","Data":"72c91c697d78d634ab4be5e01761ce82b5baab5d6efe862f8ebcced81e3558a1"} Jul 12 19:22:31.258215 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:31.258180 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzr2z" event={"ID":"8c081df9-b94a-459b-9e88-973863d95019","Type":"ContainerStarted","Data":"d6112ab93861c3d5fc07156379a2763cb41415566c09c028ec160b7df02a5553"} Jul 12 19:22:31.259708 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:31.259687 2576 generic.go:356] "Generic (PLEG): container finished" podID="c648764a-13c5-4cea-9dbc-dcfdcc308d68" containerID="90ca3f29f7f2a0599db0a37d306302efa7d6d0da66389065899f8dcb6a160972" exitCode=0 Jul 12 19:22:31.259791 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:31.259757 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9z5dq" event={"ID":"c648764a-13c5-4cea-9dbc-dcfdcc308d68","Type":"ContainerDied","Data":"90ca3f29f7f2a0599db0a37d306302efa7d6d0da66389065899f8dcb6a160972"} Jul 12 19:22:31.261282 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:31.261262 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-56fhk" event={"ID":"97eab1be-059f-4563-ac6c-30b4edf4aa79","Type":"ContainerStarted","Data":"93c6a035d5bdfe3be3f8eaf35c27a54d5d37b917b9ed472d7b6b2d8c92163693"} Jul 12 19:22:31.262705 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:31.262684 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-kfgnm" event={"ID":"c147ccfb-342a-4958-b365-f730046bebce","Type":"ContainerStarted","Data":"84a9abf96ff9332e5c25418df637c984859501baab5eda5d7b7575413acc558a"} Jul 12 19:22:31.264030 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:31.264006 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-s4snc" event={"ID":"89fef961-c465-49fc-a683-244057d342fc","Type":"ContainerStarted","Data":"0b9041ca908e178f29b7f404f2b4ed6d008f8ba58396970f308f753bd9b03c82"} Jul 12 19:22:31.266709 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:31.266691 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mj4zs_888aafef-f377-46e3-a36b-58cbabc198f8/ovn-acl-logging/0.log" Jul 12 19:22:31.267092 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:31.267074 2576 generic.go:356] "Generic (PLEG): container finished" podID="888aafef-f377-46e3-a36b-58cbabc198f8" containerID="cc93e984485a3ca8cb004ceeef3eece9b41c3edc40ff07bf16bba8096d40bd86" exitCode=1 Jul 12 19:22:31.267144 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:31.267132 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" event={"ID":"888aafef-f377-46e3-a36b-58cbabc198f8","Type":"ContainerStarted","Data":"13857aa1d04d017904d9979983ea087d882f63d4931d5ccf55fe2302d37189da"} Jul 12 19:22:31.267195 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:31.267182 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" event={"ID":"888aafef-f377-46e3-a36b-58cbabc198f8","Type":"ContainerStarted","Data":"bf00572e165ed9f016adf2fc7dc3fba5ca5aba767bc2c9e3ebbd786d722a3b26"} Jul 12 19:22:31.267242 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:31.267229 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" event={"ID":"888aafef-f377-46e3-a36b-58cbabc198f8","Type":"ContainerStarted","Data":"fcf7c8a58e603a3bafe2f8215966213dec07182bece282fa343c7d9f65fdcffc"} Jul 12 19:22:31.267288 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:31.267276 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" event={"ID":"888aafef-f377-46e3-a36b-58cbabc198f8","Type":"ContainerStarted","Data":"011b68862f2fa6750a4897ccce8472e366b614a5ea2e751f151f9b98f93cc974"} Jul 12 19:22:31.267334 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:31.267322 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" event={"ID":"888aafef-f377-46e3-a36b-58cbabc198f8","Type":"ContainerDied","Data":"cc93e984485a3ca8cb004ceeef3eece9b41c3edc40ff07bf16bba8096d40bd86"} Jul 12 19:22:31.267382 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:31.267362 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" event={"ID":"888aafef-f377-46e3-a36b-58cbabc198f8","Type":"ContainerStarted","Data":"1b20a4c630affb6fc520757ec53853d7e138ce49d4dd4b825f56569c7e1d916d"} Jul 12 19:22:31.267505 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:31.267457 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-63.ec2.internal" podStartSLOduration=21.267442055 podStartE2EDuration="21.267442055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 19:22:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:22:31.266876253 +0000 UTC m=+22.721469217" watchObservedRunningTime="2026-07-12 19:22:31.267442055 +0000 UTC m=+22.722035018" Jul 12 19:22:31.268561 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:31.268540 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" event={"ID":"12a7f674-5f12-4dfe-a936-75d1fedafaea","Type":"ContainerStarted","Data":"7b916e386ee154ba3b091f634c63310f370ba2fab3780275402b0b2963b81764"} Jul 12 19:22:31.269843 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:31.269824 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8h25q" event={"ID":"16f30c9c-72f7-4d93-a0e8-9617958d76dd","Type":"ContainerStarted","Data":"9bb75469b2ee4c5773e5e592bfd559beace8c2bacdfc5394129769ee7676f13b"} Jul 12 19:22:31.303386 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:31.303349 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-s4snc" podStartSLOduration=2.454611444 podStartE2EDuration="22.303335005s" totalImagesPullingTime="19.848723561s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 19:22:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:22:31.291151319 +0000 UTC m=+22.745744282" watchObservedRunningTime="2026-07-12 19:22:31.303335005 +0000 UTC m=+22.757927970" Jul 12 19:22:31.303496 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:31.303434 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-kfgnm" podStartSLOduration=2.366168592 podStartE2EDuration="22.3034268s" totalImagesPullingTime="19.937258208s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 19:22:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:22:31.303055267 +0000 UTC m=+22.757648245" watchObservedRunningTime="2026-07-12 19:22:31.3034268 +0000 UTC m=+22.758019764" Jul 12 19:22:31.317978 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:31.317937 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-56fhk" podStartSLOduration=2.316376955 podStartE2EDuration="22.317901288s" totalImagesPullingTime="20.001524333s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 19:22:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:22:31.317392844 +0000 UTC m=+22.771985808" watchObservedRunningTime="2026-07-12 19:22:31.317901288 +0000 UTC m=+22.772494253" Jul 12 19:22:31.351581 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:31.351510 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8h25q" podStartSLOduration=2.365471806 podStartE2EDuration="22.351493804s" totalImagesPullingTime="19.986021998s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:22:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:22:31.351280337 +0000 UTC m=+22.805873301" watchObservedRunningTime="2026-07-12 19:22:31.351493804 +0000 UTC m=+22.806086768" Jul 12 19:22:31.458419 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:31.458381 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h25q_16f30c9c-72f7-4d93-a0e8-9617958d76dd/konnectivity-agent/0.log" limit=1024 Jul 12 19:22:31.508276 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:31.508246 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h25q_16f30c9c-72f7-4d93-a0e8-9617958d76dd/konnectivity-agent/0.log" limit=1024 Jul 12 19:22:32.078043 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:32.077981 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xr84" Jul 12 19:22:32.078502 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:32.078166 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xr84" podUID="c3855f17-6f1a-4a9e-841e-bfda15547d26" Jul 12 19:22:32.160476 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:32.160451 2576 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 12 19:22:32.274455 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:32.274375 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal" event={"ID":"12004e7284b18d57c7b16f9e578840a6","Type":"ContainerStarted","Data":"f4e338a72026c0980473000d07b16c96be03accbc433d5939dec26ad974b35aa"} Jul 12 19:22:32.276484 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:32.276458 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzr2z" event={"ID":"8c081df9-b94a-459b-9e88-973863d95019","Type":"ContainerStarted","Data":"b41375f8f1adeea85ce9bfc8065c5d913143ad575a9ad8e9fed21ea61b17d0d7"} Jul 12 19:22:32.278154 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:32.278127 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-74f6p" event={"ID":"6fd77a07-b4ea-4261-b1d9-0bf31aaf270c","Type":"ContainerStarted","Data":"f70c05abce61c9f8161f6c918763b461e41e20d7b39140689e60d965ca51ff2e"} Jul 12 19:22:32.288118 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:32.288074 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-jc8b5" podStartSLOduration=3.358838847 podStartE2EDuration="23.288057895s" totalImagesPullingTime="19.929219048s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 19:22:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:22:31.366864302 +0000 UTC m=+22.821457264" watchObservedRunningTime="2026-07-12 19:22:32.288057895 +0000 UTC m=+23.742650858" Jul 12 19:22:32.288455 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:32.288426 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-63.ec2.internal" podStartSLOduration=22.288413864 podStartE2EDuration="22.288413864s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 19:22:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:22:32.288175745 +0000 UTC m=+23.742768693" watchObservedRunningTime="2026-07-12 19:22:32.288413864 +0000 UTC m=+23.743006854" Jul 12 19:22:32.301393 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:32.301354 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-74f6p" podStartSLOduration=3.38003326 podStartE2EDuration="23.301340226s" totalImagesPullingTime="19.921306966s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 19:22:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:22:32.301134837 +0000 UTC m=+23.755727799" watchObservedRunningTime="2026-07-12 19:22:32.301340226 +0000 UTC m=+23.755933188" Jul 12 19:22:32.355266 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:32.355248 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8h25q" Jul 12 19:22:32.355765 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:32.355747 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8h25q" Jul 12 19:22:32.374525 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:32.374498 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h25q_16f30c9c-72f7-4d93-a0e8-9617958d76dd/konnectivity-agent/0.log" limit=1024 Jul 12 19:22:32.428370 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:32.428341 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h25q_16f30c9c-72f7-4d93-a0e8-9617958d76dd/konnectivity-agent/0.log" limit=1024 Jul 12 19:22:32.528889 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:32.528827 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h25q_16f30c9c-72f7-4d93-a0e8-9617958d76dd/konnectivity-agent/0.log" limit=1024 Jul 12 19:22:32.921857 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:32.921779 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h25q_16f30c9c-72f7-4d93-a0e8-9617958d76dd/konnectivity-agent/0.log" limit=1024 Jul 12 19:22:33.021902 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:33.021871 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h25q_16f30c9c-72f7-4d93-a0e8-9617958d76dd/konnectivity-agent/0.log" limit=1024 Jul 12 19:22:33.028743 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:33.028635 2576 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-12T19:22:32.160470909Z","UUID":"65668ad7-2f3f-4484-bb40-febe73a6ea20","Handler":null,"Name":"","Endpoint":""} Jul 12 19:22:33.030562 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:33.030315 2576 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 12 19:22:33.030562 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:33.030368 2576 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 12 19:22:33.078214 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:33.078190 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv9f6" Jul 12 19:22:33.078657 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:33.078188 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fxlg" Jul 12 19:22:33.078657 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:33.078309 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sv9f6" podUID="0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52" Jul 12 19:22:33.078657 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:33.078384 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fxlg" podUID="239fb2a7-5ee3-4efe-8878-7e2f8dd795de" Jul 12 19:22:34.077444 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:34.077414 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xr84" Jul 12 19:22:34.077606 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:34.077540 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xr84" podUID="c3855f17-6f1a-4a9e-841e-bfda15547d26" Jul 12 19:22:34.179390 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:34.179358 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h25q_16f30c9c-72f7-4d93-a0e8-9617958d76dd/konnectivity-agent/0.log" limit=1024 Jul 12 19:22:34.280745 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:34.280711 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h25q_16f30c9c-72f7-4d93-a0e8-9617958d76dd/konnectivity-agent/0.log" limit=1024 Jul 12 19:22:34.283602 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:34.283576 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzr2z" event={"ID":"8c081df9-b94a-459b-9e88-973863d95019","Type":"ContainerStarted","Data":"047cbfecfb86fb49c93f31bbca07d151e18a9d5f3c394a92f60faa98465de0aa"} Jul 12 19:22:34.286349 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:34.286330 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mj4zs_888aafef-f377-46e3-a36b-58cbabc198f8/ovn-acl-logging/0.log" Jul 12 19:22:34.286691 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:34.286672 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" event={"ID":"888aafef-f377-46e3-a36b-58cbabc198f8","Type":"ContainerStarted","Data":"696f1b98260a8141a8807c6372174c1b6b8647cc156ea68066965affa16c9ebe"} Jul 12 19:22:34.286745 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:34.286698 2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 12 19:22:34.302248 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:34.302211 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-kzr2z" podStartSLOduration=2.974170146 podStartE2EDuration="25.302199662s" totalImagesPullingTime="22.328029516s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 19:22:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:22:34.301840813 +0000 UTC m=+25.756433775" watchObservedRunningTime="2026-07-12 19:22:34.302199662 +0000 UTC m=+25.756792624" Jul 12 19:22:35.078069 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:35.077866 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv9f6" Jul 12 19:22:35.078263 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:35.077931 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fxlg" Jul 12 19:22:35.078263 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:35.078190 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sv9f6" podUID="0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52" Jul 12 19:22:35.078263 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:35.078235 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fxlg" podUID="239fb2a7-5ee3-4efe-8878-7e2f8dd795de" Jul 12 19:22:36.078510 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:36.078302 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xr84" Jul 12 19:22:36.078510 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:36.078410 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xr84" podUID="c3855f17-6f1a-4a9e-841e-bfda15547d26" Jul 12 19:22:36.294384 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:36.294248 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mj4zs_888aafef-f377-46e3-a36b-58cbabc198f8/ovn-acl-logging/0.log" Jul 12 19:22:36.294739 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:36.294715 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" event={"ID":"888aafef-f377-46e3-a36b-58cbabc198f8","Type":"ContainerStarted","Data":"8a905f5068b71a77ef08aad79ff750c9291ace72e039f71d333b79045d5b59fd"} Jul 12 19:22:36.295068 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:36.295046 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:36.295211 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:36.295196 2576 scope.go:117] "RemoveContainer" containerID="cc93e984485a3ca8cb004ceeef3eece9b41c3edc40ff07bf16bba8096d40bd86" Jul 12 19:22:36.310000 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:36.309973 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:36.656011 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:36.655891 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h25q_16f30c9c-72f7-4d93-a0e8-9617958d76dd/konnectivity-agent/0.log" limit=1024 Jul 12 19:22:36.707683 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:36.707656 2576 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8h25q_16f30c9c-72f7-4d93-a0e8-9617958d76dd/konnectivity-agent/0.log" limit=1024 Jul 12 19:22:37.077484 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:37.077446 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fxlg" Jul 12 19:22:37.077663 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:37.077556 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fxlg" podUID="239fb2a7-5ee3-4efe-8878-7e2f8dd795de" Jul 12 19:22:37.077663 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:37.077611 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv9f6" Jul 12 19:22:37.077767 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:37.077704 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sv9f6" podUID="0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52" Jul 12 19:22:37.303844 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:37.303745 2576 generic.go:356] "Generic (PLEG): container finished" podID="c648764a-13c5-4cea-9dbc-dcfdcc308d68" containerID="947dea7ae8fff3e96a4779d89200e93c0d641700508bfa3a055dff79b444f336" exitCode=0 Jul 12 19:22:37.304568 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:37.303949 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9z5dq" event={"ID":"c648764a-13c5-4cea-9dbc-dcfdcc308d68","Type":"ContainerDied","Data":"947dea7ae8fff3e96a4779d89200e93c0d641700508bfa3a055dff79b444f336"} Jul 12 19:22:37.313786 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:37.313759 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mj4zs_888aafef-f377-46e3-a36b-58cbabc198f8/ovn-acl-logging/0.log" Jul 12 19:22:37.315149 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:37.314230 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" event={"ID":"888aafef-f377-46e3-a36b-58cbabc198f8","Type":"ContainerStarted","Data":"1d729420d581020745256a63900acd1740f75030effd620f0faa834895cf747b"} Jul 12 19:22:37.315149 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:37.314917 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:37.315149 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:37.315050 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:37.337090 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:37.337062 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:22:37.355250 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:37.355206 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" podStartSLOduration=8.42912808 podStartE2EDuration="28.355194112s" totalImagesPullingTime="19.926066032s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 19:22:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:22:37.354042455 +0000 UTC m=+28.808635441" watchObservedRunningTime="2026-07-12 19:22:37.355194112 +0000 UTC m=+28.809787075" Jul 12 19:22:38.077558 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:38.077527 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xr84" Jul 12 19:22:38.077773 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:38.077666 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xr84" podUID="c3855f17-6f1a-4a9e-841e-bfda15547d26" Jul 12 19:22:38.320826 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:38.320797 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9z5dq" event={"ID":"c648764a-13c5-4cea-9dbc-dcfdcc308d68","Type":"ContainerStarted","Data":"dfe1e358be7306bfdb590a1862244309bec2330e2251730ba2ee5a3b4855135f"} Jul 12 19:22:38.321182 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:38.320855 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6fxlg"] Jul 12 19:22:38.321343 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:38.321314 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fxlg" Jul 12 19:22:38.321436 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:38.321414 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fxlg" podUID="239fb2a7-5ee3-4efe-8878-7e2f8dd795de" Jul 12 19:22:38.323556 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:38.323534 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sv9f6"] Jul 12 19:22:38.323654 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:38.323625 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv9f6" Jul 12 19:22:38.323735 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:38.323715 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sv9f6" podUID="0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52" Jul 12 19:22:38.324370 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:38.324346 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7xr84"] Jul 12 19:22:38.324447 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:38.324430 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xr84" Jul 12 19:22:38.324532 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:38.324515 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xr84" podUID="c3855f17-6f1a-4a9e-841e-bfda15547d26" Jul 12 19:22:39.324550 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:39.324514 2576 generic.go:356] "Generic (PLEG): container finished" podID="c648764a-13c5-4cea-9dbc-dcfdcc308d68" containerID="dfe1e358be7306bfdb590a1862244309bec2330e2251730ba2ee5a3b4855135f" exitCode=0 Jul 12 19:22:39.324921 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:39.324593 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9z5dq" event={"ID":"c648764a-13c5-4cea-9dbc-dcfdcc308d68","Type":"ContainerDied","Data":"dfe1e358be7306bfdb590a1862244309bec2330e2251730ba2ee5a3b4855135f"} Jul 12 19:22:39.544366 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:39.544332 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8h25q" Jul 12 19:22:39.544519 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:39.544486 2576 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 12 19:22:39.545021 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:39.545000 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8h25q" Jul 12 19:22:40.077796 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:40.077598 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xr84" Jul 12 19:22:40.077938 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:40.077598 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv9f6" Jul 12 19:22:40.077938 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:40.077831 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xr84" podUID="c3855f17-6f1a-4a9e-841e-bfda15547d26" Jul 12 19:22:40.077938 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:40.077598 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fxlg" Jul 12 19:22:40.078087 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:40.077935 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sv9f6" podUID="0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52" Jul 12 19:22:40.078087 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:40.077961 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fxlg" podUID="239fb2a7-5ee3-4efe-8878-7e2f8dd795de" Jul 12 19:22:40.329556 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:40.329489 2576 generic.go:356] "Generic (PLEG): container finished" podID="c648764a-13c5-4cea-9dbc-dcfdcc308d68" containerID="c7185f0f9f3fa6c163845a02ca07724004d241643bce36a4883ed379efb1a96c" exitCode=0 Jul 12 19:22:40.329903 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:40.329578 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9z5dq" event={"ID":"c648764a-13c5-4cea-9dbc-dcfdcc308d68","Type":"ContainerDied","Data":"c7185f0f9f3fa6c163845a02ca07724004d241643bce36a4883ed379efb1a96c"} Jul 12 19:22:41.824542 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:41.824505 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3855f17-6f1a-4a9e-841e-bfda15547d26-original-pull-secret\") pod \"global-pull-secret-syncer-7xr84\" (UID: \"c3855f17-6f1a-4a9e-841e-bfda15547d26\") " pod="kube-system/global-pull-secret-syncer-7xr84" Jul 12 19:22:41.824542 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:41.824548 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52-metrics-certs\") pod \"network-metrics-daemon-sv9f6\" (UID: \"0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52\") " pod="openshift-multus/network-metrics-daemon-sv9f6" Jul 12 19:22:41.825115 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:41.824683 2576 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 19:22:41.825115 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:41.824736 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52-metrics-certs podName:0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52 nodeName:}" failed. No retries permitted until 2026-07-12 19:23:13.82472194 +0000 UTC m=+65.279314880 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52-metrics-certs") pod "network-metrics-daemon-sv9f6" (UID: "0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 12 19:22:41.825115 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:41.824680 2576 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 12 19:22:41.825115 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:41.824824 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c3855f17-6f1a-4a9e-841e-bfda15547d26-original-pull-secret podName:c3855f17-6f1a-4a9e-841e-bfda15547d26 nodeName:}" failed. No retries permitted until 2026-07-12 19:23:13.824804703 +0000 UTC m=+65.279397650 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c3855f17-6f1a-4a9e-841e-bfda15547d26-original-pull-secret") pod "global-pull-secret-syncer-7xr84" (UID: "c3855f17-6f1a-4a9e-841e-bfda15547d26") : object "kube-system"/"original-pull-secret" not registered Jul 12 19:22:41.925414 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:41.925372 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-446z8\" (UniqueName: \"kubernetes.io/projected/239fb2a7-5ee3-4efe-8878-7e2f8dd795de-kube-api-access-446z8\") pod \"network-check-target-6fxlg\" (UID: \"239fb2a7-5ee3-4efe-8878-7e2f8dd795de\") " pod="openshift-network-diagnostics/network-check-target-6fxlg" Jul 12 19:22:41.925589 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:41.925523 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 12 19:22:41.925589 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:41.925548 2576 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 12 19:22:41.925589 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:41.925560 2576 projected.go:196] Error preparing data for projected volume kube-api-access-446z8 for pod openshift-network-diagnostics/network-check-target-6fxlg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 19:22:41.925748 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:41.925616 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/239fb2a7-5ee3-4efe-8878-7e2f8dd795de-kube-api-access-446z8 podName:239fb2a7-5ee3-4efe-8878-7e2f8dd795de nodeName:}" failed. No retries permitted until 2026-07-12 19:23:13.925598636 +0000 UTC m=+65.380191586 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-446z8" (UniqueName: "kubernetes.io/projected/239fb2a7-5ee3-4efe-8878-7e2f8dd795de-kube-api-access-446z8") pod "network-check-target-6fxlg" (UID: "239fb2a7-5ee3-4efe-8878-7e2f8dd795de") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 12 19:22:41.935248 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:41.935229 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s4snc_89fef961-c465-49fc-a683-244057d342fc/dns-node-resolver/0.log" Jul 12 19:22:42.078385 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:42.078312 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fxlg" Jul 12 19:22:42.078537 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:42.078422 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xr84" Jul 12 19:22:42.078537 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:42.078459 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv9f6" Jul 12 19:22:42.078537 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:42.078453 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6fxlg" podUID="239fb2a7-5ee3-4efe-8878-7e2f8dd795de" Jul 12 19:22:42.078701 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:42.078563 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7xr84" podUID="c3855f17-6f1a-4a9e-841e-bfda15547d26" Jul 12 19:22:42.078701 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:22:42.078662 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-sv9f6" podUID="0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52" Jul 12 19:22:42.733955 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:42.733925 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kfgnm_c147ccfb-342a-4958-b365-f730046bebce/node-ca/0.log" Jul 12 19:22:43.277773 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:43.277739 2576 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-63.ec2.internal" event="NodeReady" Jul 12 19:22:43.278297 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:43.277883 2576 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 12 19:22:44.077946 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:44.077913 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xr84" Jul 12 19:22:44.077946 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:44.077950 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv9f6" Jul 12 19:22:44.078166 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:44.077914 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fxlg" Jul 12 19:22:44.081358 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:44.081330 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 12 19:22:44.081479 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:44.081424 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 12 19:22:44.081479 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:44.081440 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cl9vq\"" Jul 12 19:22:44.081479 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:44.081454 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 12 19:22:44.081479 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:44.081457 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dcr6j\"" Jul 12 19:22:44.081688 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:44.081538 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 12 19:22:45.343014 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:45.342970 2576 generic.go:356] "Generic (PLEG): container finished" podID="c648764a-13c5-4cea-9dbc-dcfdcc308d68" containerID="9371dd99939aee4472d9ff5100d03e7472d62198e348c8d1020a14289eed9bd1" exitCode=0 Jul 12 19:22:45.343458 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:45.343014 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9z5dq" event={"ID":"c648764a-13c5-4cea-9dbc-dcfdcc308d68","Type":"ContainerDied","Data":"9371dd99939aee4472d9ff5100d03e7472d62198e348c8d1020a14289eed9bd1"} Jul 12 19:22:46.348080 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:46.348047 2576 generic.go:356] "Generic (PLEG): container finished" podID="c648764a-13c5-4cea-9dbc-dcfdcc308d68" containerID="a586c0d223d8db0a1c984ec6c4b8d7d92b7901b29e95053e8aed6f580297217d" exitCode=0 Jul 12 19:22:46.348472 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:46.348078 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9z5dq" event={"ID":"c648764a-13c5-4cea-9dbc-dcfdcc308d68","Type":"ContainerDied","Data":"a586c0d223d8db0a1c984ec6c4b8d7d92b7901b29e95053e8aed6f580297217d"} Jul 12 19:22:47.353376 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:47.353341 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-9z5dq" event={"ID":"c648764a-13c5-4cea-9dbc-dcfdcc308d68","Type":"ContainerStarted","Data":"805aa914c61973b66b3d0e14ffdb9b912bfa905678792e2470c29bc831ab5cd1"} Jul 12 19:22:47.379696 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:22:47.379645 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-9z5dq" podStartSLOduration=7.541369578 podStartE2EDuration="38.379630401s" totalImagesPullingTime="30.838260823s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 19:22:09 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:22:47.378238546 +0000 UTC m=+38.832831508" watchObservedRunningTime="2026-07-12 19:22:47.379630401 +0000 UTC m=+38.834223383" Jul 12 19:23:01.496205 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.496013 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7bc858f9f4-7lc6n"] Jul 12 19:23:01.510386 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.510363 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bc858f9f4-7lc6n" Jul 12 19:23:01.515606 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.515580 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 12 19:23:01.515874 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.515697 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 12 19:23:01.516436 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.516408 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 12 19:23:01.517463 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.517442 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-dx58x\"" Jul 12 19:23:01.522454 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.522436 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 12 19:23:01.525068 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.525047 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bc858f9f4-7lc6n"] Jul 12 19:23:01.533019 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.532979 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vr57n"] Jul 12 19:23:01.554199 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.554179 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vr57n" Jul 12 19:23:01.554199 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.554185 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xdbcq"] Jul 12 19:23:01.559824 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.559808 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 12 19:23:01.560096 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.560073 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 12 19:23:01.560194 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.560116 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 12 19:23:01.560194 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.560116 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vfn6k\"" Jul 12 19:23:01.572454 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.572434 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vr57n"] Jul 12 19:23:01.572534 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.572465 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xdbcq"] Jul 12 19:23:01.572534 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.572515 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xdbcq" Jul 12 19:23:01.574762 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.574699 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 12 19:23:01.574889 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.574876 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 12 19:23:01.575044 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.575027 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-kfwdz\"" Jul 12 19:23:01.575879 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.575863 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xrmdv"] Jul 12 19:23:01.592407 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.592390 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xrmdv"] Jul 12 19:23:01.592490 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.592471 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xrmdv" Jul 12 19:23:01.595829 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.595811 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gnkpn\"" Jul 12 19:23:01.595897 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.595843 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 12 19:23:01.596113 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.596101 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 12 19:23:01.596175 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.596148 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 12 19:23:01.596253 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.596234 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 12 19:23:01.660420 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.660394 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d9954f0-f92c-419a-bdc8-e2acb31c980b-registry-tls\") pod \"image-registry-7bc858f9f4-7lc6n\" (UID: \"1d9954f0-f92c-419a-bdc8-e2acb31c980b\") " pod="openshift-image-registry/image-registry-7bc858f9f4-7lc6n" Jul 12 19:23:01.660527 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.660425 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d9954f0-f92c-419a-bdc8-e2acb31c980b-image-registry-private-configuration\") pod \"image-registry-7bc858f9f4-7lc6n\" (UID: \"1d9954f0-f92c-419a-bdc8-e2acb31c980b\") " pod="openshift-image-registry/image-registry-7bc858f9f4-7lc6n" Jul 12 19:23:01.660527 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.660443 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d9954f0-f92c-419a-bdc8-e2acb31c980b-installation-pull-secrets\") pod \"image-registry-7bc858f9f4-7lc6n\" (UID: \"1d9954f0-f92c-419a-bdc8-e2acb31c980b\") " pod="openshift-image-registry/image-registry-7bc858f9f4-7lc6n" Jul 12 19:23:01.660527 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.660464 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d9954f0-f92c-419a-bdc8-e2acb31c980b-bound-sa-token\") pod \"image-registry-7bc858f9f4-7lc6n\" (UID: \"1d9954f0-f92c-419a-bdc8-e2acb31c980b\") " pod="openshift-image-registry/image-registry-7bc858f9f4-7lc6n" Jul 12 19:23:01.660527 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.660489 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81cb7278-de78-4af0-89c2-34b2cf08adf5-cert\") pod \"ingress-canary-vr57n\" (UID: \"81cb7278-de78-4af0-89c2-34b2cf08adf5\") " pod="openshift-ingress-canary/ingress-canary-vr57n" Jul 12 19:23:01.660734 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.660556 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d9954f0-f92c-419a-bdc8-e2acb31c980b-registry-certificates\") pod \"image-registry-7bc858f9f4-7lc6n\" (UID: \"1d9954f0-f92c-419a-bdc8-e2acb31c980b\") " pod="openshift-image-registry/image-registry-7bc858f9f4-7lc6n" Jul 12 19:23:01.660734 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.660587 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce955d98-9d74-42d7-8bc1-0080c6e11730-metrics-tls\") pod \"dns-default-xdbcq\" (UID: \"ce955d98-9d74-42d7-8bc1-0080c6e11730\") " pod="openshift-dns/dns-default-xdbcq" Jul 12 19:23:01.660734 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.660613 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxjms\" (UniqueName: \"kubernetes.io/projected/ce955d98-9d74-42d7-8bc1-0080c6e11730-kube-api-access-dxjms\") pod \"dns-default-xdbcq\" (UID: \"ce955d98-9d74-42d7-8bc1-0080c6e11730\") " pod="openshift-dns/dns-default-xdbcq" Jul 12 19:23:01.660734 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.660702 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d9954f0-f92c-419a-bdc8-e2acb31c980b-trusted-ca\") pod \"image-registry-7bc858f9f4-7lc6n\" (UID: \"1d9954f0-f92c-419a-bdc8-e2acb31c980b\") " pod="openshift-image-registry/image-registry-7bc858f9f4-7lc6n" Jul 12 19:23:01.660915 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.660739 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d9954f0-f92c-419a-bdc8-e2acb31c980b-ca-trust-extracted\") pod \"image-registry-7bc858f9f4-7lc6n\" (UID: \"1d9954f0-f92c-419a-bdc8-e2acb31c980b\") " pod="openshift-image-registry/image-registry-7bc858f9f4-7lc6n" Jul 12 19:23:01.660915 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.660762 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4swkj\" (UniqueName: \"kubernetes.io/projected/81cb7278-de78-4af0-89c2-34b2cf08adf5-kube-api-access-4swkj\") pod \"ingress-canary-vr57n\" (UID: \"81cb7278-de78-4af0-89c2-34b2cf08adf5\") " pod="openshift-ingress-canary/ingress-canary-vr57n" Jul 12 19:23:01.660915 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.660819 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ce955d98-9d74-42d7-8bc1-0080c6e11730-config-volume\") pod \"dns-default-xdbcq\" (UID: \"ce955d98-9d74-42d7-8bc1-0080c6e11730\") " pod="openshift-dns/dns-default-xdbcq" Jul 12 19:23:01.660915 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.660841 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce955d98-9d74-42d7-8bc1-0080c6e11730-tmp-dir\") pod \"dns-default-xdbcq\" (UID: \"ce955d98-9d74-42d7-8bc1-0080c6e11730\") " pod="openshift-dns/dns-default-xdbcq" Jul 12 19:23:01.660915 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.660862 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xczw4\" (UniqueName: \"kubernetes.io/projected/1d9954f0-f92c-419a-bdc8-e2acb31c980b-kube-api-access-xczw4\") pod \"image-registry-7bc858f9f4-7lc6n\" (UID: \"1d9954f0-f92c-419a-bdc8-e2acb31c980b\") " pod="openshift-image-registry/image-registry-7bc858f9f4-7lc6n" Jul 12 19:23:01.761735 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.761684 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d9954f0-f92c-419a-bdc8-e2acb31c980b-registry-tls\") pod \"image-registry-7bc858f9f4-7lc6n\" (UID: \"1d9954f0-f92c-419a-bdc8-e2acb31c980b\") " pod="openshift-image-registry/image-registry-7bc858f9f4-7lc6n" Jul 12 19:23:01.761735 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.761712 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d9954f0-f92c-419a-bdc8-e2acb31c980b-image-registry-private-configuration\") pod \"image-registry-7bc858f9f4-7lc6n\" (UID: \"1d9954f0-f92c-419a-bdc8-e2acb31c980b\") " pod="openshift-image-registry/image-registry-7bc858f9f4-7lc6n" Jul 12 19:23:01.761735 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.761732 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d9954f0-f92c-419a-bdc8-e2acb31c980b-installation-pull-secrets\") pod \"image-registry-7bc858f9f4-7lc6n\" (UID: \"1d9954f0-f92c-419a-bdc8-e2acb31c980b\") " pod="openshift-image-registry/image-registry-7bc858f9f4-7lc6n" Jul 12 19:23:01.761929 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.761748 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d9954f0-f92c-419a-bdc8-e2acb31c980b-bound-sa-token\") pod \"image-registry-7bc858f9f4-7lc6n\" (UID: \"1d9954f0-f92c-419a-bdc8-e2acb31c980b\") " pod="openshift-image-registry/image-registry-7bc858f9f4-7lc6n" Jul 12 19:23:01.761929 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.761765 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81cb7278-de78-4af0-89c2-34b2cf08adf5-cert\") pod \"ingress-canary-vr57n\" (UID: \"81cb7278-de78-4af0-89c2-34b2cf08adf5\") " pod="openshift-ingress-canary/ingress-canary-vr57n" Jul 12 19:23:01.761929 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.761782 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4c24f04-e3f4-4b10-9af1-1ccb3d30b0cd-data-volume\") pod \"insights-runtime-extractor-xrmdv\" (UID: \"a4c24f04-e3f4-4b10-9af1-1ccb3d30b0cd\") " pod="openshift-insights/insights-runtime-extractor-xrmdv" Jul 12 19:23:01.761929 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.761902 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d9954f0-f92c-419a-bdc8-e2acb31c980b-registry-certificates\") pod \"image-registry-7bc858f9f4-7lc6n\" (UID: \"1d9954f0-f92c-419a-bdc8-e2acb31c980b\") " pod="openshift-image-registry/image-registry-7bc858f9f4-7lc6n" Jul 12 19:23:01.762147 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.761932 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce955d98-9d74-42d7-8bc1-0080c6e11730-metrics-tls\") pod \"dns-default-xdbcq\" (UID: \"ce955d98-9d74-42d7-8bc1-0080c6e11730\") " pod="openshift-dns/dns-default-xdbcq" Jul 12 19:23:01.762147 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.761957 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxjms\" (UniqueName: \"kubernetes.io/projected/ce955d98-9d74-42d7-8bc1-0080c6e11730-kube-api-access-dxjms\") pod \"dns-default-xdbcq\" (UID: \"ce955d98-9d74-42d7-8bc1-0080c6e11730\") " pod="openshift-dns/dns-default-xdbcq" Jul 12 19:23:01.762147 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.762009 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2dcl\" (UniqueName: \"kubernetes.io/projected/a4c24f04-e3f4-4b10-9af1-1ccb3d30b0cd-kube-api-access-t2dcl\") pod \"insights-runtime-extractor-xrmdv\" (UID: \"a4c24f04-e3f4-4b10-9af1-1ccb3d30b0cd\") " pod="openshift-insights/insights-runtime-extractor-xrmdv" Jul 12 19:23:01.762291 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.762163 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d9954f0-f92c-419a-bdc8-e2acb31c980b-trusted-ca\") pod \"image-registry-7bc858f9f4-7lc6n\" (UID: \"1d9954f0-f92c-419a-bdc8-e2acb31c980b\") " pod="openshift-image-registry/image-registry-7bc858f9f4-7lc6n" Jul 12 19:23:01.762291 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.762199 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d9954f0-f92c-419a-bdc8-e2acb31c980b-ca-trust-extracted\") pod \"image-registry-7bc858f9f4-7lc6n\" (UID: \"1d9954f0-f92c-419a-bdc8-e2acb31c980b\") " pod="openshift-image-registry/image-registry-7bc858f9f4-7lc6n" Jul 12 19:23:01.762291 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.762219 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4swkj\" (UniqueName: \"kubernetes.io/projected/81cb7278-de78-4af0-89c2-34b2cf08adf5-kube-api-access-4swkj\") pod \"ingress-canary-vr57n\" (UID: \"81cb7278-de78-4af0-89c2-34b2cf08adf5\") " pod="openshift-ingress-canary/ingress-canary-vr57n" Jul 12 19:23:01.763298 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.762536 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ce955d98-9d74-42d7-8bc1-0080c6e11730-config-volume\") pod \"dns-default-xdbcq\" (UID: \"ce955d98-9d74-42d7-8bc1-0080c6e11730\") " pod="openshift-dns/dns-default-xdbcq" Jul 12 19:23:01.763298 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.762585 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce955d98-9d74-42d7-8bc1-0080c6e11730-tmp-dir\") pod \"dns-default-xdbcq\" (UID: \"ce955d98-9d74-42d7-8bc1-0080c6e11730\") " pod="openshift-dns/dns-default-xdbcq" Jul 12 19:23:01.763298 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.762590 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/1d9954f0-f92c-419a-bdc8-e2acb31c980b-ca-trust-extracted\") pod \"image-registry-7bc858f9f4-7lc6n\" (UID: \"1d9954f0-f92c-419a-bdc8-e2acb31c980b\") " pod="openshift-image-registry/image-registry-7bc858f9f4-7lc6n" Jul 12 19:23:01.763298 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.762616 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a4c24f04-e3f4-4b10-9af1-1ccb3d30b0cd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xrmdv\" (UID: \"a4c24f04-e3f4-4b10-9af1-1ccb3d30b0cd\") " pod="openshift-insights/insights-runtime-extractor-xrmdv" Jul 12 19:23:01.763298 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.762649 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xczw4\" (UniqueName: \"kubernetes.io/projected/1d9954f0-f92c-419a-bdc8-e2acb31c980b-kube-api-access-xczw4\") pod \"image-registry-7bc858f9f4-7lc6n\" (UID: \"1d9954f0-f92c-419a-bdc8-e2acb31c980b\") " pod="openshift-image-registry/image-registry-7bc858f9f4-7lc6n" Jul 12 19:23:01.763298 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.762676 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a4c24f04-e3f4-4b10-9af1-1ccb3d30b0cd-crio-socket\") pod \"insights-runtime-extractor-xrmdv\" (UID: \"a4c24f04-e3f4-4b10-9af1-1ccb3d30b0cd\") " pod="openshift-insights/insights-runtime-extractor-xrmdv" Jul 12 19:23:01.763298 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.762700 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a4c24f04-e3f4-4b10-9af1-1ccb3d30b0cd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xrmdv\" (UID: \"a4c24f04-e3f4-4b10-9af1-1ccb3d30b0cd\") " pod="openshift-insights/insights-runtime-extractor-xrmdv" Jul 12 19:23:01.763298 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.763097 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/1d9954f0-f92c-419a-bdc8-e2acb31c980b-registry-certificates\") pod \"image-registry-7bc858f9f4-7lc6n\" (UID: \"1d9954f0-f92c-419a-bdc8-e2acb31c980b\") " pod="openshift-image-registry/image-registry-7bc858f9f4-7lc6n" Jul 12 19:23:01.763298 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.763128 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ce955d98-9d74-42d7-8bc1-0080c6e11730-config-volume\") pod \"dns-default-xdbcq\" (UID: \"ce955d98-9d74-42d7-8bc1-0080c6e11730\") " pod="openshift-dns/dns-default-xdbcq" Jul 12 19:23:01.763298 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.763255 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ce955d98-9d74-42d7-8bc1-0080c6e11730-tmp-dir\") pod \"dns-default-xdbcq\" (UID: \"ce955d98-9d74-42d7-8bc1-0080c6e11730\") " pod="openshift-dns/dns-default-xdbcq" Jul 12 19:23:01.763851 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.763354 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/1d9954f0-f92c-419a-bdc8-e2acb31c980b-trusted-ca\") pod \"image-registry-7bc858f9f4-7lc6n\" (UID: \"1d9954f0-f92c-419a-bdc8-e2acb31c980b\") " pod="openshift-image-registry/image-registry-7bc858f9f4-7lc6n" Jul 12 19:23:01.765999 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.765964 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/1d9954f0-f92c-419a-bdc8-e2acb31c980b-installation-pull-secrets\") pod \"image-registry-7bc858f9f4-7lc6n\" (UID: \"1d9954f0-f92c-419a-bdc8-e2acb31c980b\") " pod="openshift-image-registry/image-registry-7bc858f9f4-7lc6n" Jul 12 19:23:01.766244 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.766225 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/1d9954f0-f92c-419a-bdc8-e2acb31c980b-registry-tls\") pod \"image-registry-7bc858f9f4-7lc6n\" (UID: \"1d9954f0-f92c-419a-bdc8-e2acb31c980b\") " pod="openshift-image-registry/image-registry-7bc858f9f4-7lc6n" Jul 12 19:23:01.766292 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.766240 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/1d9954f0-f92c-419a-bdc8-e2acb31c980b-image-registry-private-configuration\") pod \"image-registry-7bc858f9f4-7lc6n\" (UID: \"1d9954f0-f92c-419a-bdc8-e2acb31c980b\") " pod="openshift-image-registry/image-registry-7bc858f9f4-7lc6n" Jul 12 19:23:01.766292 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.766225 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/81cb7278-de78-4af0-89c2-34b2cf08adf5-cert\") pod \"ingress-canary-vr57n\" (UID: \"81cb7278-de78-4af0-89c2-34b2cf08adf5\") " pod="openshift-ingress-canary/ingress-canary-vr57n" Jul 12 19:23:01.766472 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.766459 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ce955d98-9d74-42d7-8bc1-0080c6e11730-metrics-tls\") pod \"dns-default-xdbcq\" (UID: \"ce955d98-9d74-42d7-8bc1-0080c6e11730\") " pod="openshift-dns/dns-default-xdbcq" Jul 12 19:23:01.771512 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.771484 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1d9954f0-f92c-419a-bdc8-e2acb31c980b-bound-sa-token\") pod \"image-registry-7bc858f9f4-7lc6n\" (UID: \"1d9954f0-f92c-419a-bdc8-e2acb31c980b\") " pod="openshift-image-registry/image-registry-7bc858f9f4-7lc6n" Jul 12 19:23:01.771788 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.771768 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xczw4\" (UniqueName: \"kubernetes.io/projected/1d9954f0-f92c-419a-bdc8-e2acb31c980b-kube-api-access-xczw4\") pod \"image-registry-7bc858f9f4-7lc6n\" (UID: \"1d9954f0-f92c-419a-bdc8-e2acb31c980b\") " pod="openshift-image-registry/image-registry-7bc858f9f4-7lc6n" Jul 12 19:23:01.771844 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.771805 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4swkj\" (UniqueName: \"kubernetes.io/projected/81cb7278-de78-4af0-89c2-34b2cf08adf5-kube-api-access-4swkj\") pod \"ingress-canary-vr57n\" (UID: \"81cb7278-de78-4af0-89c2-34b2cf08adf5\") " pod="openshift-ingress-canary/ingress-canary-vr57n" Jul 12 19:23:01.772109 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.772073 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxjms\" (UniqueName: \"kubernetes.io/projected/ce955d98-9d74-42d7-8bc1-0080c6e11730-kube-api-access-dxjms\") pod \"dns-default-xdbcq\" (UID: \"ce955d98-9d74-42d7-8bc1-0080c6e11730\") " pod="openshift-dns/dns-default-xdbcq" Jul 12 19:23:01.820902 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.820880 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7bc858f9f4-7lc6n" Jul 12 19:23:01.863833 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.863809 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vr57n" Jul 12 19:23:01.867745 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.864396 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a4c24f04-e3f4-4b10-9af1-1ccb3d30b0cd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xrmdv\" (UID: \"a4c24f04-e3f4-4b10-9af1-1ccb3d30b0cd\") " pod="openshift-insights/insights-runtime-extractor-xrmdv" Jul 12 19:23:01.867745 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.864451 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a4c24f04-e3f4-4b10-9af1-1ccb3d30b0cd-crio-socket\") pod \"insights-runtime-extractor-xrmdv\" (UID: \"a4c24f04-e3f4-4b10-9af1-1ccb3d30b0cd\") " pod="openshift-insights/insights-runtime-extractor-xrmdv" Jul 12 19:23:01.867745 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.864484 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a4c24f04-e3f4-4b10-9af1-1ccb3d30b0cd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xrmdv\" (UID: \"a4c24f04-e3f4-4b10-9af1-1ccb3d30b0cd\") " pod="openshift-insights/insights-runtime-extractor-xrmdv" Jul 12 19:23:01.867745 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.864568 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4c24f04-e3f4-4b10-9af1-1ccb3d30b0cd-data-volume\") pod \"insights-runtime-extractor-xrmdv\" (UID: \"a4c24f04-e3f4-4b10-9af1-1ccb3d30b0cd\") " pod="openshift-insights/insights-runtime-extractor-xrmdv" Jul 12 19:23:01.867745 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.864629 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2dcl\" (UniqueName: \"kubernetes.io/projected/a4c24f04-e3f4-4b10-9af1-1ccb3d30b0cd-kube-api-access-t2dcl\") pod \"insights-runtime-extractor-xrmdv\" (UID: \"a4c24f04-e3f4-4b10-9af1-1ccb3d30b0cd\") " pod="openshift-insights/insights-runtime-extractor-xrmdv" Jul 12 19:23:01.867745 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.864677 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a4c24f04-e3f4-4b10-9af1-1ccb3d30b0cd-crio-socket\") pod \"insights-runtime-extractor-xrmdv\" (UID: \"a4c24f04-e3f4-4b10-9af1-1ccb3d30b0cd\") " pod="openshift-insights/insights-runtime-extractor-xrmdv" Jul 12 19:23:01.867745 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.865204 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a4c24f04-e3f4-4b10-9af1-1ccb3d30b0cd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xrmdv\" (UID: \"a4c24f04-e3f4-4b10-9af1-1ccb3d30b0cd\") " pod="openshift-insights/insights-runtime-extractor-xrmdv" Jul 12 19:23:01.867745 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.865314 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a4c24f04-e3f4-4b10-9af1-1ccb3d30b0cd-data-volume\") pod \"insights-runtime-extractor-xrmdv\" (UID: \"a4c24f04-e3f4-4b10-9af1-1ccb3d30b0cd\") " pod="openshift-insights/insights-runtime-extractor-xrmdv" Jul 12 19:23:01.869603 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.869574 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a4c24f04-e3f4-4b10-9af1-1ccb3d30b0cd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xrmdv\" (UID: \"a4c24f04-e3f4-4b10-9af1-1ccb3d30b0cd\") " pod="openshift-insights/insights-runtime-extractor-xrmdv" Jul 12 19:23:01.874854 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.874827 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2dcl\" (UniqueName: \"kubernetes.io/projected/a4c24f04-e3f4-4b10-9af1-1ccb3d30b0cd-kube-api-access-t2dcl\") pod \"insights-runtime-extractor-xrmdv\" (UID: \"a4c24f04-e3f4-4b10-9af1-1ccb3d30b0cd\") " pod="openshift-insights/insights-runtime-extractor-xrmdv" Jul 12 19:23:01.880748 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.880727 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xdbcq" Jul 12 19:23:01.900382 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:01.900359 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xrmdv" Jul 12 19:23:02.069731 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:02.069700 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vr57n"] Jul 12 19:23:02.073549 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:02.073487 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7bc858f9f4-7lc6n"] Jul 12 19:23:02.079242 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:23:02.079203 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d9954f0_f92c_419a_bdc8_e2acb31c980b.slice/crio-0e54abaa5fc07b9386fb4c289caae9b8e501bbd76c7554edd7f19a1cda3be5f5 WatchSource:0}: Error finding container 0e54abaa5fc07b9386fb4c289caae9b8e501bbd76c7554edd7f19a1cda3be5f5: Status 404 returned error can't find the container with id 0e54abaa5fc07b9386fb4c289caae9b8e501bbd76c7554edd7f19a1cda3be5f5 Jul 12 19:23:02.085894 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:02.085842 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xdbcq"] Jul 12 19:23:02.089687 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:23:02.089667 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce955d98_9d74_42d7_8bc1_0080c6e11730.slice/crio-1d26b88f1ea45970991cd38e4f99b242d37aafe798c7883eebeb786b6be217fb WatchSource:0}: Error finding container 1d26b88f1ea45970991cd38e4f99b242d37aafe798c7883eebeb786b6be217fb: Status 404 returned error can't find the container with id 1d26b88f1ea45970991cd38e4f99b242d37aafe798c7883eebeb786b6be217fb Jul 12 19:23:02.116511 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:02.116490 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xrmdv"] Jul 12 19:23:02.120519 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:23:02.120496 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda4c24f04_e3f4_4b10_9af1_1ccb3d30b0cd.slice/crio-5057e7d728649535cb15a494d9731a547e979adb1daa2633cb1c817c7940bf25 WatchSource:0}: Error finding container 5057e7d728649535cb15a494d9731a547e979adb1daa2633cb1c817c7940bf25: Status 404 returned error can't find the container with id 5057e7d728649535cb15a494d9731a547e979adb1daa2633cb1c817c7940bf25 Jul 12 19:23:02.387857 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:02.387786 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bc858f9f4-7lc6n" event={"ID":"1d9954f0-f92c-419a-bdc8-e2acb31c980b","Type":"ContainerStarted","Data":"c198a9b9f6842657600bbc92809d10be9e304cbef9af85a6c7881a6cb5274fca"} Jul 12 19:23:02.387857 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:02.387844 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7bc858f9f4-7lc6n" event={"ID":"1d9954f0-f92c-419a-bdc8-e2acb31c980b","Type":"ContainerStarted","Data":"0e54abaa5fc07b9386fb4c289caae9b8e501bbd76c7554edd7f19a1cda3be5f5"} Jul 12 19:23:02.388074 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:02.387911 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7bc858f9f4-7lc6n" Jul 12 19:23:02.389018 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:02.388969 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xdbcq" event={"ID":"ce955d98-9d74-42d7-8bc1-0080c6e11730","Type":"ContainerStarted","Data":"1d26b88f1ea45970991cd38e4f99b242d37aafe798c7883eebeb786b6be217fb"} Jul 12 19:23:02.390026 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:02.390003 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vr57n" event={"ID":"81cb7278-de78-4af0-89c2-34b2cf08adf5","Type":"ContainerStarted","Data":"b8add982c28e635cafad56bd0277f4d728b6362ad8b6d865ae4e9f2a615384e1"} Jul 12 19:23:02.391101 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:02.391081 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xrmdv" event={"ID":"a4c24f04-e3f4-4b10-9af1-1ccb3d30b0cd","Type":"ContainerStarted","Data":"5057e7d728649535cb15a494d9731a547e979adb1daa2633cb1c817c7940bf25"} Jul 12 19:23:02.407717 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:02.407661 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7bc858f9f4-7lc6n" podStartSLOduration=1.407644598 podStartE2EDuration="1.407644598s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:23:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:23:02.406618354 +0000 UTC m=+53.861211317" watchObservedRunningTime="2026-07-12 19:23:02.407644598 +0000 UTC m=+53.862237561" Jul 12 19:23:07.410589 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:07.410496 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xrmdv" event={"ID":"a4c24f04-e3f4-4b10-9af1-1ccb3d30b0cd","Type":"ContainerStarted","Data":"1ca14a68626a6481af5e88350b33df37c8ce64897a4512a954391e29d3ed4d7f"} Jul 12 19:23:07.412304 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:07.412276 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xdbcq" event={"ID":"ce955d98-9d74-42d7-8bc1-0080c6e11730","Type":"ContainerStarted","Data":"d0bbf313aaa8aea57e530bb0c2d1fc97cb0370a4946ac552787f88ac861aa35b"} Jul 12 19:23:07.412445 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:07.412328 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xdbcq" event={"ID":"ce955d98-9d74-42d7-8bc1-0080c6e11730","Type":"ContainerStarted","Data":"d2d82b66c96b8a286aeb508f0ea49eee15e8ccecfdc6d8793a1f829081e37dd0"} Jul 12 19:23:07.412445 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:07.412387 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xdbcq" Jul 12 19:23:07.413631 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:07.413609 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vr57n" event={"ID":"81cb7278-de78-4af0-89c2-34b2cf08adf5","Type":"ContainerStarted","Data":"95ac764b4f247d9c45dee7d0edfd2ac25af3785456bcc96df1974b25c962521d"} Jul 12 19:23:07.433032 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:07.432968 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xdbcq" podStartSLOduration=1.452428688 podStartE2EDuration="6.432955691s" totalImagesPullingTime="4.980527003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:23:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:23:07.431459707 +0000 UTC m=+58.886052669" watchObservedRunningTime="2026-07-12 19:23:07.432955691 +0000 UTC m=+58.887548631" Jul 12 19:23:07.452720 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:07.452675 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vr57n" podStartSLOduration=1.436810344 podStartE2EDuration="6.452664524s" totalImagesPullingTime="5.01585418s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:23:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:23:07.451950808 +0000 UTC m=+58.906543765" watchObservedRunningTime="2026-07-12 19:23:07.452664524 +0000 UTC m=+58.907257487" Jul 12 19:23:08.419931 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:08.419882 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xrmdv" event={"ID":"a4c24f04-e3f4-4b10-9af1-1ccb3d30b0cd","Type":"ContainerStarted","Data":"55713221e338571ab5ce0575f3699b49d8bfd586f0e4aa090dbea7ca1eedfa57"} Jul 12 19:23:09.336222 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:09.336193 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mj4zs" Jul 12 19:23:11.430180 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:11.430145 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xrmdv" event={"ID":"a4c24f04-e3f4-4b10-9af1-1ccb3d30b0cd","Type":"ContainerStarted","Data":"6004d603b9c368777441d0d53b722fc03043f12e7e8683fdbdcfb5d93658cde9"} Jul 12 19:23:11.446124 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:11.446072 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xrmdv" podStartSLOduration=1.989818337 podStartE2EDuration="10.446052813s" totalImagesPullingTime="8.456234476s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 19:23:01 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:23:11.444747798 +0000 UTC m=+62.899340760" watchObservedRunningTime="2026-07-12 19:23:11.446052813 +0000 UTC m=+62.900645776" Jul 12 19:23:13.865390 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:13.865340 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3855f17-6f1a-4a9e-841e-bfda15547d26-original-pull-secret\") pod \"global-pull-secret-syncer-7xr84\" (UID: \"c3855f17-6f1a-4a9e-841e-bfda15547d26\") " pod="kube-system/global-pull-secret-syncer-7xr84" Jul 12 19:23:13.865390 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:13.865392 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52-metrics-certs\") pod \"network-metrics-daemon-sv9f6\" (UID: \"0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52\") " pod="openshift-multus/network-metrics-daemon-sv9f6" Jul 12 19:23:13.867707 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:13.867690 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 12 19:23:13.867760 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:13.867728 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 12 19:23:13.877864 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:13.877842 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52-metrics-certs\") pod \"network-metrics-daemon-sv9f6\" (UID: \"0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52\") " pod="openshift-multus/network-metrics-daemon-sv9f6" Jul 12 19:23:13.878008 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:13.877848 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c3855f17-6f1a-4a9e-841e-bfda15547d26-original-pull-secret\") pod \"global-pull-secret-syncer-7xr84\" (UID: \"c3855f17-6f1a-4a9e-841e-bfda15547d26\") " pod="kube-system/global-pull-secret-syncer-7xr84" Jul 12 19:23:13.966528 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:13.966490 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-446z8\" (UniqueName: \"kubernetes.io/projected/239fb2a7-5ee3-4efe-8878-7e2f8dd795de-kube-api-access-446z8\") pod \"network-check-target-6fxlg\" (UID: \"239fb2a7-5ee3-4efe-8878-7e2f8dd795de\") " pod="openshift-network-diagnostics/network-check-target-6fxlg" Jul 12 19:23:13.968774 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:13.968757 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 12 19:23:13.979349 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:13.979331 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 12 19:23:13.990350 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:13.990330 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-446z8\" (UniqueName: \"kubernetes.io/projected/239fb2a7-5ee3-4efe-8878-7e2f8dd795de-kube-api-access-446z8\") pod \"network-check-target-6fxlg\" (UID: \"239fb2a7-5ee3-4efe-8878-7e2f8dd795de\") " pod="openshift-network-diagnostics/network-check-target-6fxlg" Jul 12 19:23:14.090567 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:14.090542 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7xr84" Jul 12 19:23:14.100269 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:14.100242 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cl9vq\"" Jul 12 19:23:14.105013 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:14.104973 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dcr6j\"" Jul 12 19:23:14.107538 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:14.107517 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6fxlg" Jul 12 19:23:14.113279 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:14.113260 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-sv9f6" Jul 12 19:23:14.224156 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:14.224132 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7xr84"] Jul 12 19:23:14.228006 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:23:14.227963 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3855f17_6f1a_4a9e_841e_bfda15547d26.slice/crio-ebe16e48cc34391f73dc98df6ae122b3aa824891f162fe3d6a61908c641165f2 WatchSource:0}: Error finding container ebe16e48cc34391f73dc98df6ae122b3aa824891f162fe3d6a61908c641165f2: Status 404 returned error can't find the container with id ebe16e48cc34391f73dc98df6ae122b3aa824891f162fe3d6a61908c641165f2 Jul 12 19:23:14.244080 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:14.244052 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6fxlg"] Jul 12 19:23:14.247299 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:23:14.247271 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod239fb2a7_5ee3_4efe_8878_7e2f8dd795de.slice/crio-09d5a6596e32cac9b963724e8a3152554a65d0926142c6caf290f2e2a606aa00 WatchSource:0}: Error finding container 09d5a6596e32cac9b963724e8a3152554a65d0926142c6caf290f2e2a606aa00: Status 404 returned error can't find the container with id 09d5a6596e32cac9b963724e8a3152554a65d0926142c6caf290f2e2a606aa00 Jul 12 19:23:14.258560 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:14.258539 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-sv9f6"] Jul 12 19:23:14.261435 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:23:14.261403 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a72ff7f_1bbf_4a3a_8dcc_29ed99e89f52.slice/crio-fe1bb03df109d4878ba23eb08ea82a6dc63ffd6f6c39ffce4e3d3de4deed1383 WatchSource:0}: Error finding container fe1bb03df109d4878ba23eb08ea82a6dc63ffd6f6c39ffce4e3d3de4deed1383: Status 404 returned error can't find the container with id fe1bb03df109d4878ba23eb08ea82a6dc63ffd6f6c39ffce4e3d3de4deed1383 Jul 12 19:23:14.440390 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:14.440357 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6fxlg" event={"ID":"239fb2a7-5ee3-4efe-8878-7e2f8dd795de","Type":"ContainerStarted","Data":"09d5a6596e32cac9b963724e8a3152554a65d0926142c6caf290f2e2a606aa00"} Jul 12 19:23:14.441449 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:14.441422 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7xr84" event={"ID":"c3855f17-6f1a-4a9e-841e-bfda15547d26","Type":"ContainerStarted","Data":"ebe16e48cc34391f73dc98df6ae122b3aa824891f162fe3d6a61908c641165f2"} Jul 12 19:23:14.442543 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:14.442522 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sv9f6" event={"ID":"0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52","Type":"ContainerStarted","Data":"fe1bb03df109d4878ba23eb08ea82a6dc63ffd6f6c39ffce4e3d3de4deed1383"} Jul 12 19:23:14.665488 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:14.665456 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-tdz9h"] Jul 12 19:23:14.667688 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:14.667674 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-tdz9h" Jul 12 19:23:14.671946 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:14.671924 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 12 19:23:14.672080 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:14.671949 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-jpjjj\"" Jul 12 19:23:14.677567 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:14.677547 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-tdz9h"] Jul 12 19:23:14.771197 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:14.771122 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ad12b74e-7a61-45ff-b163-7146fcb1cde2-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-tdz9h\" (UID: \"ad12b74e-7a61-45ff-b163-7146fcb1cde2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-tdz9h" Jul 12 19:23:14.872269 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:14.872235 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ad12b74e-7a61-45ff-b163-7146fcb1cde2-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-tdz9h\" (UID: \"ad12b74e-7a61-45ff-b163-7146fcb1cde2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-tdz9h" Jul 12 19:23:14.872708 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:23:14.872386 2576 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 12 19:23:14.872708 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:23:14.872450 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ad12b74e-7a61-45ff-b163-7146fcb1cde2-tls-certificates podName:ad12b74e-7a61-45ff-b163-7146fcb1cde2 nodeName:}" failed. No retries permitted until 2026-07-12 19:23:15.372429028 +0000 UTC m=+66.827021975 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/ad12b74e-7a61-45ff-b163-7146fcb1cde2-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-tdz9h" (UID: "ad12b74e-7a61-45ff-b163-7146fcb1cde2") : secret "prometheus-operator-admission-webhook-tls" not found Jul 12 19:23:15.376701 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:15.376649 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ad12b74e-7a61-45ff-b163-7146fcb1cde2-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-tdz9h\" (UID: \"ad12b74e-7a61-45ff-b163-7146fcb1cde2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-tdz9h" Jul 12 19:23:15.379756 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:15.379730 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/ad12b74e-7a61-45ff-b163-7146fcb1cde2-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-tdz9h\" (UID: \"ad12b74e-7a61-45ff-b163-7146fcb1cde2\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-tdz9h" Jul 12 19:23:15.448566 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:15.448480 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sv9f6" event={"ID":"0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52","Type":"ContainerStarted","Data":"5fdaabe35db6b66e8a7912931e21c741727b6e9d58cc8e05e754b12f69e4bda4"} Jul 12 19:23:15.577141 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:15.577038 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-tdz9h" Jul 12 19:23:15.723101 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:15.723066 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-tdz9h"] Jul 12 19:23:15.726577 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:23:15.726546 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad12b74e_7a61_45ff_b163_7146fcb1cde2.slice/crio-01b9a36437d081bd828cfe99f174154bd7e37cb7f719da61edaee68a062d11fc WatchSource:0}: Error finding container 01b9a36437d081bd828cfe99f174154bd7e37cb7f719da61edaee68a062d11fc: Status 404 returned error can't find the container with id 01b9a36437d081bd828cfe99f174154bd7e37cb7f719da61edaee68a062d11fc Jul 12 19:23:16.454924 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:16.454838 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-tdz9h" event={"ID":"ad12b74e-7a61-45ff-b163-7146fcb1cde2","Type":"ContainerStarted","Data":"01b9a36437d081bd828cfe99f174154bd7e37cb7f719da61edaee68a062d11fc"} Jul 12 19:23:16.457338 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:16.457282 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-sv9f6" event={"ID":"0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52","Type":"ContainerStarted","Data":"68059de39d6355d19fe00e9054018a433e98ec1be85dd36181344a6f3840e9d4"} Jul 12 19:23:16.474279 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:16.474226 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-sv9f6" podStartSLOduration=66.470308535 podStartE2EDuration="1m7.474207659s" totalImagesPullingTime="1.003899124s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:22:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:23:16.473854991 +0000 UTC m=+67.928447955" watchObservedRunningTime="2026-07-12 19:23:16.474207659 +0000 UTC m=+67.928800629" Jul 12 19:23:17.422537 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:17.422508 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xdbcq" Jul 12 19:23:19.469333 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:19.469256 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6fxlg" event={"ID":"239fb2a7-5ee3-4efe-8878-7e2f8dd795de","Type":"ContainerStarted","Data":"492c0a69b9d07913f5d125861a533cd767ab26272774db3b171caf6287492209"} Jul 12 19:23:19.469762 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:19.469350 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6fxlg" Jul 12 19:23:19.470782 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:19.470760 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7xr84" event={"ID":"c3855f17-6f1a-4a9e-841e-bfda15547d26","Type":"ContainerStarted","Data":"ea55514c628affd18c91c6947f7b9e53eaeccef1746263df5c1e24731ee2f50f"} Jul 12 19:23:19.472248 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:19.472221 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-tdz9h" event={"ID":"ad12b74e-7a61-45ff-b163-7146fcb1cde2","Type":"ContainerStarted","Data":"c120e9e34a8b0f2fda460a9c942efb848c62959225cab5fee64ddb0bb33b017a"} Jul 12 19:23:19.472430 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:19.472414 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-tdz9h" Jul 12 19:23:19.476846 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:19.476825 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-tdz9h" Jul 12 19:23:19.483720 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:19.483682 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6fxlg" podStartSLOduration=65.516483462 podStartE2EDuration="1m10.483668469s" totalImagesPullingTime="4.967185007s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:22:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:23:19.4825061 +0000 UTC m=+70.937099063" watchObservedRunningTime="2026-07-12 19:23:19.483668469 +0000 UTC m=+70.938261434" Jul 12 19:23:19.508768 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:19.508699 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-tdz9h" podStartSLOduration=2.021482761 podStartE2EDuration="5.508680291s" totalImagesPullingTime="3.48719753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:23:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:23:19.495835129 +0000 UTC m=+70.950428093" watchObservedRunningTime="2026-07-12 19:23:19.508680291 +0000 UTC m=+70.963273255" Jul 12 19:23:19.509566 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:19.509525 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7xr84" podStartSLOduration=65.508091624 podStartE2EDuration="1m10.509512052s" totalImagesPullingTime="5.001420428s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 19:22:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:23:19.507923719 +0000 UTC m=+70.962516686" watchObservedRunningTime="2026-07-12 19:23:19.509512052 +0000 UTC m=+70.964105018" Jul 12 19:23:21.825630 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:21.825591 2576 patch_prober.go:28] interesting pod/image-registry-7bc858f9f4-7lc6n container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 12 19:23:21.826012 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:21.825650 2576 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-7bc858f9f4-7lc6n" podUID="1d9954f0-f92c-419a-bdc8-e2acb31c980b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 12 19:23:23.400999 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:23.400956 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7bc858f9f4-7lc6n" Jul 12 19:23:27.840200 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:27.840166 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-97zpp"] Jul 12 19:23:27.843464 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:27.843439 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-97zpp" Jul 12 19:23:27.846102 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:27.846077 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 12 19:23:27.846270 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:27.846111 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 12 19:23:27.846270 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:27.846152 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 12 19:23:27.847098 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:27.847069 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-g9lwx\"" Jul 12 19:23:27.847098 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:27.847098 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 12 19:23:27.847251 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:27.847138 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 12 19:23:27.852663 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:27.852632 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-97zpp"] Jul 12 19:23:27.869657 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:27.869634 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-2pbhs"] Jul 12 19:23:27.871819 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:27.871793 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2pbhs" Jul 12 19:23:27.873784 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:27.873765 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 12 19:23:27.873881 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:27.873866 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 12 19:23:27.873948 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:27.873895 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hchhq\"" Jul 12 19:23:27.874029 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:27.874004 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 12 19:23:27.956052 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:27.956029 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d62616d9-c564-4448-a42c-b691305621e8-node-exporter-tls\") pod \"node-exporter-2pbhs\" (UID: \"d62616d9-c564-4448-a42c-b691305621e8\") " pod="openshift-monitoring/node-exporter-2pbhs" Jul 12 19:23:27.956149 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:27.956055 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d62616d9-c564-4448-a42c-b691305621e8-sys\") pod \"node-exporter-2pbhs\" (UID: \"d62616d9-c564-4448-a42c-b691305621e8\") " pod="openshift-monitoring/node-exporter-2pbhs" Jul 12 19:23:27.956149 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:27.956073 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c154687e-b9d9-4311-8a9c-d785b21b7440-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-97zpp\" (UID: \"c154687e-b9d9-4311-8a9c-d785b21b7440\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-97zpp" Jul 12 19:23:27.956149 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:27.956095 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d62616d9-c564-4448-a42c-b691305621e8-node-exporter-accelerators-collector-config\") pod \"node-exporter-2pbhs\" (UID: \"d62616d9-c564-4448-a42c-b691305621e8\") " pod="openshift-monitoring/node-exporter-2pbhs" Jul 12 19:23:27.956149 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:27.956136 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqxlf\" (UniqueName: \"kubernetes.io/projected/c154687e-b9d9-4311-8a9c-d785b21b7440-kube-api-access-hqxlf\") pod \"openshift-state-metrics-84bd68b896-97zpp\" (UID: \"c154687e-b9d9-4311-8a9c-d785b21b7440\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-97zpp" Jul 12 19:23:27.956278 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:27.956169 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d62616d9-c564-4448-a42c-b691305621e8-node-exporter-textfile\") pod \"node-exporter-2pbhs\" (UID: \"d62616d9-c564-4448-a42c-b691305621e8\") " pod="openshift-monitoring/node-exporter-2pbhs" Jul 12 19:23:27.956278 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:27.956192 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c154687e-b9d9-4311-8a9c-d785b21b7440-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-97zpp\" (UID: \"c154687e-b9d9-4311-8a9c-d785b21b7440\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-97zpp" Jul 12 19:23:27.956278 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:27.956232 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c154687e-b9d9-4311-8a9c-d785b21b7440-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-97zpp\" (UID: \"c154687e-b9d9-4311-8a9c-d785b21b7440\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-97zpp" Jul 12 19:23:27.956278 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:27.956275 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qkdb\" (UniqueName: \"kubernetes.io/projected/d62616d9-c564-4448-a42c-b691305621e8-kube-api-access-6qkdb\") pod \"node-exporter-2pbhs\" (UID: \"d62616d9-c564-4448-a42c-b691305621e8\") " pod="openshift-monitoring/node-exporter-2pbhs" Jul 12 19:23:27.956394 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:27.956299 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d62616d9-c564-4448-a42c-b691305621e8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2pbhs\" (UID: \"d62616d9-c564-4448-a42c-b691305621e8\") " pod="openshift-monitoring/node-exporter-2pbhs" Jul 12 19:23:27.956394 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:27.956318 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d62616d9-c564-4448-a42c-b691305621e8-metrics-client-ca\") pod \"node-exporter-2pbhs\" (UID: \"d62616d9-c564-4448-a42c-b691305621e8\") " pod="openshift-monitoring/node-exporter-2pbhs" Jul 12 19:23:27.956394 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:27.956336 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d62616d9-c564-4448-a42c-b691305621e8-node-exporter-wtmp\") pod \"node-exporter-2pbhs\" (UID: \"d62616d9-c564-4448-a42c-b691305621e8\") " pod="openshift-monitoring/node-exporter-2pbhs" Jul 12 19:23:27.956394 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:27.956353 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d62616d9-c564-4448-a42c-b691305621e8-root\") pod \"node-exporter-2pbhs\" (UID: \"d62616d9-c564-4448-a42c-b691305621e8\") " pod="openshift-monitoring/node-exporter-2pbhs" Jul 12 19:23:28.057385 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.057360 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c154687e-b9d9-4311-8a9c-d785b21b7440-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-97zpp\" (UID: \"c154687e-b9d9-4311-8a9c-d785b21b7440\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-97zpp" Jul 12 19:23:28.057477 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.057388 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qkdb\" (UniqueName: \"kubernetes.io/projected/d62616d9-c564-4448-a42c-b691305621e8-kube-api-access-6qkdb\") pod \"node-exporter-2pbhs\" (UID: \"d62616d9-c564-4448-a42c-b691305621e8\") " pod="openshift-monitoring/node-exporter-2pbhs" Jul 12 19:23:28.057477 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.057416 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d62616d9-c564-4448-a42c-b691305621e8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2pbhs\" (UID: \"d62616d9-c564-4448-a42c-b691305621e8\") " pod="openshift-monitoring/node-exporter-2pbhs" Jul 12 19:23:28.057561 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.057529 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d62616d9-c564-4448-a42c-b691305621e8-metrics-client-ca\") pod \"node-exporter-2pbhs\" (UID: \"d62616d9-c564-4448-a42c-b691305621e8\") " pod="openshift-monitoring/node-exporter-2pbhs" Jul 12 19:23:28.057594 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.057574 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d62616d9-c564-4448-a42c-b691305621e8-node-exporter-wtmp\") pod \"node-exporter-2pbhs\" (UID: \"d62616d9-c564-4448-a42c-b691305621e8\") " pod="openshift-monitoring/node-exporter-2pbhs" Jul 12 19:23:28.057626 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.057604 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d62616d9-c564-4448-a42c-b691305621e8-root\") pod \"node-exporter-2pbhs\" (UID: \"d62616d9-c564-4448-a42c-b691305621e8\") " pod="openshift-monitoring/node-exporter-2pbhs" Jul 12 19:23:28.057664 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.057626 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d62616d9-c564-4448-a42c-b691305621e8-node-exporter-tls\") pod \"node-exporter-2pbhs\" (UID: \"d62616d9-c564-4448-a42c-b691305621e8\") " pod="openshift-monitoring/node-exporter-2pbhs" Jul 12 19:23:28.057664 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.057642 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d62616d9-c564-4448-a42c-b691305621e8-sys\") pod \"node-exporter-2pbhs\" (UID: \"d62616d9-c564-4448-a42c-b691305621e8\") " pod="openshift-monitoring/node-exporter-2pbhs" Jul 12 19:23:28.057759 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.057663 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c154687e-b9d9-4311-8a9c-d785b21b7440-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-97zpp\" (UID: \"c154687e-b9d9-4311-8a9c-d785b21b7440\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-97zpp" Jul 12 19:23:28.057759 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.057697 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/d62616d9-c564-4448-a42c-b691305621e8-root\") pod \"node-exporter-2pbhs\" (UID: \"d62616d9-c564-4448-a42c-b691305621e8\") " pod="openshift-monitoring/node-exporter-2pbhs" Jul 12 19:23:28.057759 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.057697 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d62616d9-c564-4448-a42c-b691305621e8-node-exporter-accelerators-collector-config\") pod \"node-exporter-2pbhs\" (UID: \"d62616d9-c564-4448-a42c-b691305621e8\") " pod="openshift-monitoring/node-exporter-2pbhs" Jul 12 19:23:28.057759 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.057743 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqxlf\" (UniqueName: \"kubernetes.io/projected/c154687e-b9d9-4311-8a9c-d785b21b7440-kube-api-access-hqxlf\") pod \"openshift-state-metrics-84bd68b896-97zpp\" (UID: \"c154687e-b9d9-4311-8a9c-d785b21b7440\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-97zpp" Jul 12 19:23:28.057759 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:23:28.057754 2576 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 12 19:23:28.058000 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.057757 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d62616d9-c564-4448-a42c-b691305621e8-sys\") pod \"node-exporter-2pbhs\" (UID: \"d62616d9-c564-4448-a42c-b691305621e8\") " pod="openshift-monitoring/node-exporter-2pbhs" Jul 12 19:23:28.058000 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.057778 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d62616d9-c564-4448-a42c-b691305621e8-node-exporter-textfile\") pod \"node-exporter-2pbhs\" (UID: \"d62616d9-c564-4448-a42c-b691305621e8\") " pod="openshift-monitoring/node-exporter-2pbhs" Jul 12 19:23:28.058000 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.057812 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c154687e-b9d9-4311-8a9c-d785b21b7440-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-97zpp\" (UID: \"c154687e-b9d9-4311-8a9c-d785b21b7440\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-97zpp" Jul 12 19:23:28.058000 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:23:28.057870 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d62616d9-c564-4448-a42c-b691305621e8-node-exporter-tls podName:d62616d9-c564-4448-a42c-b691305621e8 nodeName:}" failed. No retries permitted until 2026-07-12 19:23:28.557849145 +0000 UTC m=+80.012442085 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/d62616d9-c564-4448-a42c-b691305621e8-node-exporter-tls") pod "node-exporter-2pbhs" (UID: "d62616d9-c564-4448-a42c-b691305621e8") : secret "node-exporter-tls" not found Jul 12 19:23:28.058000 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.057892 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/d62616d9-c564-4448-a42c-b691305621e8-node-exporter-wtmp\") pod \"node-exporter-2pbhs\" (UID: \"d62616d9-c564-4448-a42c-b691305621e8\") " pod="openshift-monitoring/node-exporter-2pbhs" Jul 12 19:23:28.058260 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.058194 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d62616d9-c564-4448-a42c-b691305621e8-metrics-client-ca\") pod \"node-exporter-2pbhs\" (UID: \"d62616d9-c564-4448-a42c-b691305621e8\") " pod="openshift-monitoring/node-exporter-2pbhs" Jul 12 19:23:28.058260 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.058212 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c154687e-b9d9-4311-8a9c-d785b21b7440-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-97zpp\" (UID: \"c154687e-b9d9-4311-8a9c-d785b21b7440\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-97zpp" Jul 12 19:23:28.058260 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.058229 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/d62616d9-c564-4448-a42c-b691305621e8-node-exporter-textfile\") pod \"node-exporter-2pbhs\" (UID: \"d62616d9-c564-4448-a42c-b691305621e8\") " pod="openshift-monitoring/node-exporter-2pbhs" Jul 12 19:23:28.058389 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.058291 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/d62616d9-c564-4448-a42c-b691305621e8-node-exporter-accelerators-collector-config\") pod \"node-exporter-2pbhs\" (UID: \"d62616d9-c564-4448-a42c-b691305621e8\") " pod="openshift-monitoring/node-exporter-2pbhs" Jul 12 19:23:28.059836 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.059806 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/d62616d9-c564-4448-a42c-b691305621e8-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-2pbhs\" (UID: \"d62616d9-c564-4448-a42c-b691305621e8\") " pod="openshift-monitoring/node-exporter-2pbhs" Jul 12 19:23:28.060273 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.060242 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/c154687e-b9d9-4311-8a9c-d785b21b7440-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-97zpp\" (UID: \"c154687e-b9d9-4311-8a9c-d785b21b7440\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-97zpp" Jul 12 19:23:28.060355 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.060345 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/c154687e-b9d9-4311-8a9c-d785b21b7440-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-97zpp\" (UID: \"c154687e-b9d9-4311-8a9c-d785b21b7440\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-97zpp" Jul 12 19:23:28.068159 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.068141 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qkdb\" (UniqueName: \"kubernetes.io/projected/d62616d9-c564-4448-a42c-b691305621e8-kube-api-access-6qkdb\") pod \"node-exporter-2pbhs\" (UID: \"d62616d9-c564-4448-a42c-b691305621e8\") " pod="openshift-monitoring/node-exporter-2pbhs" Jul 12 19:23:28.068461 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.068438 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqxlf\" (UniqueName: \"kubernetes.io/projected/c154687e-b9d9-4311-8a9c-d785b21b7440-kube-api-access-hqxlf\") pod \"openshift-state-metrics-84bd68b896-97zpp\" (UID: \"c154687e-b9d9-4311-8a9c-d785b21b7440\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-97zpp" Jul 12 19:23:28.153859 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.153809 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-97zpp" Jul 12 19:23:28.278815 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.278786 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-97zpp"] Jul 12 19:23:28.281893 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:23:28.281866 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc154687e_b9d9_4311_8a9c_d785b21b7440.slice/crio-9f55a8d117ee3a16331a8e83a91e6742896a7a8eb188519ee194b75be5f83863 WatchSource:0}: Error finding container 9f55a8d117ee3a16331a8e83a91e6742896a7a8eb188519ee194b75be5f83863: Status 404 returned error can't find the container with id 9f55a8d117ee3a16331a8e83a91e6742896a7a8eb188519ee194b75be5f83863 Jul 12 19:23:28.502850 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.502814 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-97zpp" event={"ID":"c154687e-b9d9-4311-8a9c-d785b21b7440","Type":"ContainerStarted","Data":"d594ceef205bc8cb9e394e34333b2654275d6a8956e9bc86e62af01e681df6cd"} Jul 12 19:23:28.503014 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.502881 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-97zpp" event={"ID":"c154687e-b9d9-4311-8a9c-d785b21b7440","Type":"ContainerStarted","Data":"8b3d67b8fcafc39af679fd4ced0d1ff261274671c9d469abcc505492f7a47e33"} Jul 12 19:23:28.503014 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.502908 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-97zpp" event={"ID":"c154687e-b9d9-4311-8a9c-d785b21b7440","Type":"ContainerStarted","Data":"9f55a8d117ee3a16331a8e83a91e6742896a7a8eb188519ee194b75be5f83863"} Jul 12 19:23:28.561241 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.561208 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d62616d9-c564-4448-a42c-b691305621e8-node-exporter-tls\") pod \"node-exporter-2pbhs\" (UID: \"d62616d9-c564-4448-a42c-b691305621e8\") " pod="openshift-monitoring/node-exporter-2pbhs" Jul 12 19:23:28.563580 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.563562 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/d62616d9-c564-4448-a42c-b691305621e8-node-exporter-tls\") pod \"node-exporter-2pbhs\" (UID: \"d62616d9-c564-4448-a42c-b691305621e8\") " pod="openshift-monitoring/node-exporter-2pbhs" Jul 12 19:23:28.780155 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.780081 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-2pbhs" Jul 12 19:23:28.789565 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:23:28.789526 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd62616d9_c564_4448_a42c_b691305621e8.slice/crio-b3c083708f368237da0a8716287c7723ce8dd5fbe22be01082b542cc3d603f0a WatchSource:0}: Error finding container b3c083708f368237da0a8716287c7723ce8dd5fbe22be01082b542cc3d603f0a: Status 404 returned error can't find the container with id b3c083708f368237da0a8716287c7723ce8dd5fbe22be01082b542cc3d603f0a Jul 12 19:23:28.918517 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.918478 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 12 19:23:28.921941 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.921918 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:28.924532 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.924466 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 12 19:23:28.924532 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.924516 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 12 19:23:28.924785 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.924660 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 12 19:23:28.924785 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.924686 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-jhrnp\"" Jul 12 19:23:28.924923 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.924863 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 12 19:23:28.924923 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.924868 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 12 19:23:28.925150 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.925063 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 12 19:23:28.925414 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.925245 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 12 19:23:28.925524 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.925449 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 12 19:23:28.925579 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.925540 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 12 19:23:28.936460 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.936436 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 12 19:23:28.963468 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.963443 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/54c4642f-003c-49f5-bc47-f47334ec1bf1-config-volume\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:28.963599 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.963478 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54c4642f-003c-49f5-bc47-f47334ec1bf1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:28.963599 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.963504 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54c4642f-003c-49f5-bc47-f47334ec1bf1-config-out\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:28.963599 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.963525 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/54c4642f-003c-49f5-bc47-f47334ec1bf1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:28.963599 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.963570 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54c4642f-003c-49f5-bc47-f47334ec1bf1-web-config\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:28.963791 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.963632 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54c4642f-003c-49f5-bc47-f47334ec1bf1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:28.963791 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.963656 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/54c4642f-003c-49f5-bc47-f47334ec1bf1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:28.963791 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.963686 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/54c4642f-003c-49f5-bc47-f47334ec1bf1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:28.963791 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.963707 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54c4642f-003c-49f5-bc47-f47334ec1bf1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:28.963791 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.963725 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54c4642f-003c-49f5-bc47-f47334ec1bf1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:28.963791 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.963749 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/54c4642f-003c-49f5-bc47-f47334ec1bf1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:28.963791 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.963777 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2mz8\" (UniqueName: \"kubernetes.io/projected/54c4642f-003c-49f5-bc47-f47334ec1bf1-kube-api-access-v2mz8\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:28.964056 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:28.963807 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54c4642f-003c-49f5-bc47-f47334ec1bf1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:29.065008 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.064913 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/54c4642f-003c-49f5-bc47-f47334ec1bf1-config-volume\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:29.065008 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.064955 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54c4642f-003c-49f5-bc47-f47334ec1bf1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:29.065240 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.065112 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54c4642f-003c-49f5-bc47-f47334ec1bf1-config-out\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:29.065240 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.065158 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/54c4642f-003c-49f5-bc47-f47334ec1bf1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:29.065240 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.065188 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54c4642f-003c-49f5-bc47-f47334ec1bf1-web-config\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:29.065240 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.065222 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54c4642f-003c-49f5-bc47-f47334ec1bf1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:29.065443 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.065261 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/54c4642f-003c-49f5-bc47-f47334ec1bf1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:29.065443 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.065291 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/54c4642f-003c-49f5-bc47-f47334ec1bf1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:29.065443 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.065318 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54c4642f-003c-49f5-bc47-f47334ec1bf1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:29.065443 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.065341 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54c4642f-003c-49f5-bc47-f47334ec1bf1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:29.065443 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.065366 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/54c4642f-003c-49f5-bc47-f47334ec1bf1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:29.065443 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.065415 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2mz8\" (UniqueName: \"kubernetes.io/projected/54c4642f-003c-49f5-bc47-f47334ec1bf1-kube-api-access-v2mz8\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:29.065744 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.065451 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54c4642f-003c-49f5-bc47-f47334ec1bf1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:29.065797 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.065743 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54c4642f-003c-49f5-bc47-f47334ec1bf1-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:29.066244 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:23:29.065978 2576 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 12 19:23:29.066244 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:23:29.066060 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/54c4642f-003c-49f5-bc47-f47334ec1bf1-secret-alertmanager-main-tls podName:54c4642f-003c-49f5-bc47-f47334ec1bf1 nodeName:}" failed. No retries permitted until 2026-07-12 19:23:29.566041209 +0000 UTC m=+81.020634161 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/54c4642f-003c-49f5-bc47-f47334ec1bf1-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "54c4642f-003c-49f5-bc47-f47334ec1bf1") : secret "alertmanager-main-tls" not found Jul 12 19:23:29.066434 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.066281 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/54c4642f-003c-49f5-bc47-f47334ec1bf1-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:29.066860 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.066828 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/54c4642f-003c-49f5-bc47-f47334ec1bf1-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:29.068425 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.068375 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/54c4642f-003c-49f5-bc47-f47334ec1bf1-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:29.068969 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.068928 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/54c4642f-003c-49f5-bc47-f47334ec1bf1-web-config\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:29.069326 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.069297 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/54c4642f-003c-49f5-bc47-f47334ec1bf1-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:29.069403 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.069357 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/54c4642f-003c-49f5-bc47-f47334ec1bf1-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:29.069883 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.069858 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/54c4642f-003c-49f5-bc47-f47334ec1bf1-config-volume\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:29.070064 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.070018 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/54c4642f-003c-49f5-bc47-f47334ec1bf1-tls-assets\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:29.070186 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.070168 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/54c4642f-003c-49f5-bc47-f47334ec1bf1-config-out\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:29.071958 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.071920 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/54c4642f-003c-49f5-bc47-f47334ec1bf1-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:29.074144 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.074124 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2mz8\" (UniqueName: \"kubernetes.io/projected/54c4642f-003c-49f5-bc47-f47334ec1bf1-kube-api-access-v2mz8\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:29.509822 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.509781 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-97zpp" event={"ID":"c154687e-b9d9-4311-8a9c-d785b21b7440","Type":"ContainerStarted","Data":"7e31f867cdcdcfd401906b1c433ffe26dd2a02742375e786850c255747813d0d"} Jul 12 19:23:29.511473 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.511442 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2pbhs" event={"ID":"d62616d9-c564-4448-a42c-b691305621e8","Type":"ContainerStarted","Data":"b3c083708f368237da0a8716287c7723ce8dd5fbe22be01082b542cc3d603f0a"} Jul 12 19:23:29.526781 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.526737 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-97zpp" podStartSLOduration=1.5174415140000002 podStartE2EDuration="2.526723838s" totalImagesPullingTime="1.009282324s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:23:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:23:29.525723609 +0000 UTC m=+80.980316571" watchObservedRunningTime="2026-07-12 19:23:29.526723838 +0000 UTC m=+80.981316801" Jul 12 19:23:29.569614 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.569589 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/54c4642f-003c-49f5-bc47-f47334ec1bf1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:29.572486 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.572462 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/54c4642f-003c-49f5-bc47-f47334ec1bf1-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"54c4642f-003c-49f5-bc47-f47334ec1bf1\") " pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:29.832960 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.832929 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 12 19:23:29.836904 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.836881 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7466cd84d8-gm9qb"] Jul 12 19:23:29.840385 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.840368 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7466cd84d8-gm9qb" Jul 12 19:23:29.842880 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.842733 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 12 19:23:29.842880 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.842747 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 12 19:23:29.842880 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.842758 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 12 19:23:29.842880 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.842803 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-8j17chv0bbtge\"" Jul 12 19:23:29.842880 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.842879 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-89m5r\"" Jul 12 19:23:29.843278 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.842892 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 12 19:23:29.843278 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.843178 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 12 19:23:29.851106 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.851084 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7466cd84d8-gm9qb"] Jul 12 19:23:29.872762 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.872372 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c8ddf87-5eb7-4d46-8581-7c9d014924f5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7466cd84d8-gm9qb\" (UID: \"5c8ddf87-5eb7-4d46-8581-7c9d014924f5\") " pod="openshift-monitoring/thanos-querier-7466cd84d8-gm9qb" Jul 12 19:23:29.872762 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.872421 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5c8ddf87-5eb7-4d46-8581-7c9d014924f5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7466cd84d8-gm9qb\" (UID: \"5c8ddf87-5eb7-4d46-8581-7c9d014924f5\") " pod="openshift-monitoring/thanos-querier-7466cd84d8-gm9qb" Jul 12 19:23:29.872762 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.872455 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hzxc\" (UniqueName: \"kubernetes.io/projected/5c8ddf87-5eb7-4d46-8581-7c9d014924f5-kube-api-access-4hzxc\") pod \"thanos-querier-7466cd84d8-gm9qb\" (UID: \"5c8ddf87-5eb7-4d46-8581-7c9d014924f5\") " pod="openshift-monitoring/thanos-querier-7466cd84d8-gm9qb" Jul 12 19:23:29.872762 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.872485 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c8ddf87-5eb7-4d46-8581-7c9d014924f5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7466cd84d8-gm9qb\" (UID: \"5c8ddf87-5eb7-4d46-8581-7c9d014924f5\") " pod="openshift-monitoring/thanos-querier-7466cd84d8-gm9qb" Jul 12 19:23:29.872762 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.872518 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5c8ddf87-5eb7-4d46-8581-7c9d014924f5-secret-grpc-tls\") pod \"thanos-querier-7466cd84d8-gm9qb\" (UID: \"5c8ddf87-5eb7-4d46-8581-7c9d014924f5\") " pod="openshift-monitoring/thanos-querier-7466cd84d8-gm9qb" Jul 12 19:23:29.872762 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.872548 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c8ddf87-5eb7-4d46-8581-7c9d014924f5-metrics-client-ca\") pod \"thanos-querier-7466cd84d8-gm9qb\" (UID: \"5c8ddf87-5eb7-4d46-8581-7c9d014924f5\") " pod="openshift-monitoring/thanos-querier-7466cd84d8-gm9qb" Jul 12 19:23:29.872762 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.872576 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5c8ddf87-5eb7-4d46-8581-7c9d014924f5-secret-thanos-querier-tls\") pod \"thanos-querier-7466cd84d8-gm9qb\" (UID: \"5c8ddf87-5eb7-4d46-8581-7c9d014924f5\") " pod="openshift-monitoring/thanos-querier-7466cd84d8-gm9qb" Jul 12 19:23:29.872762 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.872617 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5c8ddf87-5eb7-4d46-8581-7c9d014924f5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7466cd84d8-gm9qb\" (UID: \"5c8ddf87-5eb7-4d46-8581-7c9d014924f5\") " pod="openshift-monitoring/thanos-querier-7466cd84d8-gm9qb" Jul 12 19:23:29.965711 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.965136 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 12 19:23:29.969276 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:23:29.969253 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54c4642f_003c_49f5_bc47_f47334ec1bf1.slice/crio-013530ef71c3e71213380eaaff0d4d4f52b2392386bde7f96c8f7467500c5ef0 WatchSource:0}: Error finding container 013530ef71c3e71213380eaaff0d4d4f52b2392386bde7f96c8f7467500c5ef0: Status 404 returned error can't find the container with id 013530ef71c3e71213380eaaff0d4d4f52b2392386bde7f96c8f7467500c5ef0 Jul 12 19:23:29.973914 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.973896 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c8ddf87-5eb7-4d46-8581-7c9d014924f5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7466cd84d8-gm9qb\" (UID: \"5c8ddf87-5eb7-4d46-8581-7c9d014924f5\") " pod="openshift-monitoring/thanos-querier-7466cd84d8-gm9qb" Jul 12 19:23:29.973972 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.973927 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5c8ddf87-5eb7-4d46-8581-7c9d014924f5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7466cd84d8-gm9qb\" (UID: \"5c8ddf87-5eb7-4d46-8581-7c9d014924f5\") " pod="openshift-monitoring/thanos-querier-7466cd84d8-gm9qb" Jul 12 19:23:29.973972 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.973948 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hzxc\" (UniqueName: \"kubernetes.io/projected/5c8ddf87-5eb7-4d46-8581-7c9d014924f5-kube-api-access-4hzxc\") pod \"thanos-querier-7466cd84d8-gm9qb\" (UID: \"5c8ddf87-5eb7-4d46-8581-7c9d014924f5\") " pod="openshift-monitoring/thanos-querier-7466cd84d8-gm9qb" Jul 12 19:23:29.974071 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.974019 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c8ddf87-5eb7-4d46-8581-7c9d014924f5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7466cd84d8-gm9qb\" (UID: \"5c8ddf87-5eb7-4d46-8581-7c9d014924f5\") " pod="openshift-monitoring/thanos-querier-7466cd84d8-gm9qb" Jul 12 19:23:29.974071 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.974056 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5c8ddf87-5eb7-4d46-8581-7c9d014924f5-secret-grpc-tls\") pod \"thanos-querier-7466cd84d8-gm9qb\" (UID: \"5c8ddf87-5eb7-4d46-8581-7c9d014924f5\") " pod="openshift-monitoring/thanos-querier-7466cd84d8-gm9qb" Jul 12 19:23:29.974165 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.974090 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c8ddf87-5eb7-4d46-8581-7c9d014924f5-metrics-client-ca\") pod \"thanos-querier-7466cd84d8-gm9qb\" (UID: \"5c8ddf87-5eb7-4d46-8581-7c9d014924f5\") " pod="openshift-monitoring/thanos-querier-7466cd84d8-gm9qb" Jul 12 19:23:29.974165 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.974125 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5c8ddf87-5eb7-4d46-8581-7c9d014924f5-secret-thanos-querier-tls\") pod \"thanos-querier-7466cd84d8-gm9qb\" (UID: \"5c8ddf87-5eb7-4d46-8581-7c9d014924f5\") " pod="openshift-monitoring/thanos-querier-7466cd84d8-gm9qb" Jul 12 19:23:29.974261 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.974171 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5c8ddf87-5eb7-4d46-8581-7c9d014924f5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7466cd84d8-gm9qb\" (UID: \"5c8ddf87-5eb7-4d46-8581-7c9d014924f5\") " pod="openshift-monitoring/thanos-querier-7466cd84d8-gm9qb" Jul 12 19:23:29.975142 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.974845 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5c8ddf87-5eb7-4d46-8581-7c9d014924f5-metrics-client-ca\") pod \"thanos-querier-7466cd84d8-gm9qb\" (UID: \"5c8ddf87-5eb7-4d46-8581-7c9d014924f5\") " pod="openshift-monitoring/thanos-querier-7466cd84d8-gm9qb" Jul 12 19:23:29.976772 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.976747 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5c8ddf87-5eb7-4d46-8581-7c9d014924f5-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7466cd84d8-gm9qb\" (UID: \"5c8ddf87-5eb7-4d46-8581-7c9d014924f5\") " pod="openshift-monitoring/thanos-querier-7466cd84d8-gm9qb" Jul 12 19:23:29.977114 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.977085 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/5c8ddf87-5eb7-4d46-8581-7c9d014924f5-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7466cd84d8-gm9qb\" (UID: \"5c8ddf87-5eb7-4d46-8581-7c9d014924f5\") " pod="openshift-monitoring/thanos-querier-7466cd84d8-gm9qb" Jul 12 19:23:29.977591 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.977555 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/5c8ddf87-5eb7-4d46-8581-7c9d014924f5-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7466cd84d8-gm9qb\" (UID: \"5c8ddf87-5eb7-4d46-8581-7c9d014924f5\") " pod="openshift-monitoring/thanos-querier-7466cd84d8-gm9qb" Jul 12 19:23:29.977709 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.977689 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/5c8ddf87-5eb7-4d46-8581-7c9d014924f5-secret-thanos-querier-tls\") pod \"thanos-querier-7466cd84d8-gm9qb\" (UID: \"5c8ddf87-5eb7-4d46-8581-7c9d014924f5\") " pod="openshift-monitoring/thanos-querier-7466cd84d8-gm9qb" Jul 12 19:23:29.977764 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.977697 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5c8ddf87-5eb7-4d46-8581-7c9d014924f5-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7466cd84d8-gm9qb\" (UID: \"5c8ddf87-5eb7-4d46-8581-7c9d014924f5\") " pod="openshift-monitoring/thanos-querier-7466cd84d8-gm9qb" Jul 12 19:23:29.978001 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.977970 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5c8ddf87-5eb7-4d46-8581-7c9d014924f5-secret-grpc-tls\") pod \"thanos-querier-7466cd84d8-gm9qb\" (UID: \"5c8ddf87-5eb7-4d46-8581-7c9d014924f5\") " pod="openshift-monitoring/thanos-querier-7466cd84d8-gm9qb" Jul 12 19:23:29.980318 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:29.980296 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hzxc\" (UniqueName: \"kubernetes.io/projected/5c8ddf87-5eb7-4d46-8581-7c9d014924f5-kube-api-access-4hzxc\") pod \"thanos-querier-7466cd84d8-gm9qb\" (UID: \"5c8ddf87-5eb7-4d46-8581-7c9d014924f5\") " pod="openshift-monitoring/thanos-querier-7466cd84d8-gm9qb" Jul 12 19:23:30.152498 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:30.152401 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7466cd84d8-gm9qb" Jul 12 19:23:30.278028 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:30.277887 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7466cd84d8-gm9qb"] Jul 12 19:23:30.280760 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:23:30.280731 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c8ddf87_5eb7_4d46_8581_7c9d014924f5.slice/crio-6f31a96446dcb305a7768e47aaadc9258f4d6253b0d76cee32292cb6c1ae4aeb WatchSource:0}: Error finding container 6f31a96446dcb305a7768e47aaadc9258f4d6253b0d76cee32292cb6c1ae4aeb: Status 404 returned error can't find the container with id 6f31a96446dcb305a7768e47aaadc9258f4d6253b0d76cee32292cb6c1ae4aeb Jul 12 19:23:30.515574 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:30.515548 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7466cd84d8-gm9qb" event={"ID":"5c8ddf87-5eb7-4d46-8581-7c9d014924f5","Type":"ContainerStarted","Data":"6f31a96446dcb305a7768e47aaadc9258f4d6253b0d76cee32292cb6c1ae4aeb"} Jul 12 19:23:30.517023 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:30.517001 2576 generic.go:356] "Generic (PLEG): container finished" podID="d62616d9-c564-4448-a42c-b691305621e8" containerID="f510ec6cfd078547b5b943d0ae1c3263c693a3e7e0bcaf25705dfc4b2749d50c" exitCode=0 Jul 12 19:23:30.517096 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:30.517067 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2pbhs" event={"ID":"d62616d9-c564-4448-a42c-b691305621e8","Type":"ContainerDied","Data":"f510ec6cfd078547b5b943d0ae1c3263c693a3e7e0bcaf25705dfc4b2749d50c"} Jul 12 19:23:30.518320 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:30.518300 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54c4642f-003c-49f5-bc47-f47334ec1bf1","Type":"ContainerStarted","Data":"013530ef71c3e71213380eaaff0d4d4f52b2392386bde7f96c8f7467500c5ef0"} Jul 12 19:23:31.524319 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:31.524280 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2pbhs" event={"ID":"d62616d9-c564-4448-a42c-b691305621e8","Type":"ContainerStarted","Data":"b82e3a861be7d2f44eff793152d5fc72dc5b390f102b5f401a1df1f3faa3e7fa"} Jul 12 19:23:31.524776 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:31.524352 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-2pbhs" event={"ID":"d62616d9-c564-4448-a42c-b691305621e8","Type":"ContainerStarted","Data":"e0927264462adb44904670e5e530bd36cfd521be7426868412a2a478d29331fe"} Jul 12 19:23:31.525845 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:31.525820 2576 generic.go:356] "Generic (PLEG): container finished" podID="54c4642f-003c-49f5-bc47-f47334ec1bf1" containerID="b4aa63aecdad8dece87bae8ad968b48cb0184724386c14063e4ef71927aaa742" exitCode=0 Jul 12 19:23:31.525946 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:31.525855 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54c4642f-003c-49f5-bc47-f47334ec1bf1","Type":"ContainerDied","Data":"b4aa63aecdad8dece87bae8ad968b48cb0184724386c14063e4ef71927aaa742"} Jul 12 19:23:31.541838 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:31.541800 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-2pbhs" podStartSLOduration=3.38972628 podStartE2EDuration="4.541786442s" totalImagesPullingTime="1.085014697s" totalInitContainerRuntime="67.045465ms" isStatefulPod=true podCreationTimestamp="2026-07-12 19:23:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:23:31.541279864 +0000 UTC m=+82.995872818" watchObservedRunningTime="2026-07-12 19:23:31.541786442 +0000 UTC m=+82.996379405" Jul 12 19:23:32.531975 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:32.531887 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7466cd84d8-gm9qb" event={"ID":"5c8ddf87-5eb7-4d46-8581-7c9d014924f5","Type":"ContainerStarted","Data":"289cf7f5d8d185a6d54d54b38ac4dfce5f7542636622a5b1cb0c2d70ebd5bda9"} Jul 12 19:23:32.532395 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:32.531977 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7466cd84d8-gm9qb" event={"ID":"5c8ddf87-5eb7-4d46-8581-7c9d014924f5","Type":"ContainerStarted","Data":"40762dca37bc6a40cbdb21cb46ffbaa75b031859383e8cec2a68a7afe143b1e3"} Jul 12 19:23:32.532395 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:32.532049 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7466cd84d8-gm9qb" event={"ID":"5c8ddf87-5eb7-4d46-8581-7c9d014924f5","Type":"ContainerStarted","Data":"00affaeb3ed27797f75ad9a2f182edf0856343a1b4138e2e792858fff46002ff"} Jul 12 19:23:33.538944 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:33.538916 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7466cd84d8-gm9qb" event={"ID":"5c8ddf87-5eb7-4d46-8581-7c9d014924f5","Type":"ContainerStarted","Data":"4b0e154b8d8a48a5dd65e4ec05d7fef78e24b32b8dcf334d58f7788ed10cd691"} Jul 12 19:23:33.541041 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:33.541020 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54c4642f-003c-49f5-bc47-f47334ec1bf1","Type":"ContainerStarted","Data":"969c84e9dd6663f6e89662553dfa9d2440f317eac8d1ab66fc2c6b4c0e2d4794"} Jul 12 19:23:34.548542 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:34.548512 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7466cd84d8-gm9qb" event={"ID":"5c8ddf87-5eb7-4d46-8581-7c9d014924f5","Type":"ContainerStarted","Data":"f0b2d5ccb547354d93432ef73a4a08be433e60f01707737f38e92292d22be231"} Jul 12 19:23:34.548947 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:34.548625 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7466cd84d8-gm9qb" event={"ID":"5c8ddf87-5eb7-4d46-8581-7c9d014924f5","Type":"ContainerStarted","Data":"83067bbc4063b824ca0616451786324bd88cd6500a2d22a0d9854b2dfdc933a9"} Jul 12 19:23:34.548947 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:34.548682 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7466cd84d8-gm9qb" Jul 12 19:23:34.551972 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:34.551937 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54c4642f-003c-49f5-bc47-f47334ec1bf1","Type":"ContainerStarted","Data":"5e90d5e67885b5db135d4266a6ec7003ba08fe806fd25bbf5cea9b7e75b20ce1"} Jul 12 19:23:34.552118 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:34.552026 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54c4642f-003c-49f5-bc47-f47334ec1bf1","Type":"ContainerStarted","Data":"b0b27f77cdc799f044bd2abc9fb2207558bb675a15fff6faf721ce1da6e15ff7"} Jul 12 19:23:34.552118 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:34.552075 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54c4642f-003c-49f5-bc47-f47334ec1bf1","Type":"ContainerStarted","Data":"f67e41814c2ee92dc94f880aedc670f0ab99f62522bda30b0fdb97233b99a106"} Jul 12 19:23:34.552118 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:34.552115 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54c4642f-003c-49f5-bc47-f47334ec1bf1","Type":"ContainerStarted","Data":"77d7617376baf08a2a89275b2e4072484559fd2b10172e620555e19ab80fbc7c"} Jul 12 19:23:34.552257 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:34.552155 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"54c4642f-003c-49f5-bc47-f47334ec1bf1","Type":"ContainerStarted","Data":"636e8dead95bf6d218d2134e8e171bf65c80fee93bfbc27e6631e1537a567135"} Jul 12 19:23:34.568695 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:34.568653 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7466cd84d8-gm9qb" podStartSLOduration=2.5619384849999998 podStartE2EDuration="5.568640582s" totalImagesPullingTime="3.006702097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:23:29 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:23:34.566880126 +0000 UTC m=+86.021473089" watchObservedRunningTime="2026-07-12 19:23:34.568640582 +0000 UTC m=+86.023233548" Jul 12 19:23:34.590091 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:34.590039 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.461337188 podStartE2EDuration="6.590025135s" totalImagesPullingTime="3.111379987s" totalInitContainerRuntime="17.30796ms" isStatefulPod=false podCreationTimestamp="2026-07-12 19:23:28 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:23:34.588189709 +0000 UTC m=+86.042782673" watchObservedRunningTime="2026-07-12 19:23:34.590025135 +0000 UTC m=+86.044618098" Jul 12 19:23:40.561786 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:40.561757 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7466cd84d8-gm9qb" Jul 12 19:23:50.478051 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:23:50.478022 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6fxlg" Jul 12 19:24:52.094004 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:52.093961 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5d8c68f47b-dsvwx"] Jul 12 19:24:52.098064 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:52.098048 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5d8c68f47b-dsvwx" Jul 12 19:24:52.100160 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:52.100132 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 12 19:24:52.100317 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:52.100232 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 12 19:24:52.100317 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:52.100287 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-6ls66\"" Jul 12 19:24:52.100433 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:52.100384 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 12 19:24:52.100506 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:52.100488 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 12 19:24:52.100624 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:52.100608 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 12 19:24:52.104340 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:52.104321 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 12 19:24:52.107911 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:52.107893 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5d8c68f47b-dsvwx"] Jul 12 19:24:52.163529 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:52.163504 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4590cd89-b5f6-483b-8527-c40f763211b8-telemeter-client-tls\") pod \"telemeter-client-5d8c68f47b-dsvwx\" (UID: \"4590cd89-b5f6-483b-8527-c40f763211b8\") " pod="openshift-monitoring/telemeter-client-5d8c68f47b-dsvwx" Jul 12 19:24:52.163529 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:52.163531 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4590cd89-b5f6-483b-8527-c40f763211b8-federate-client-tls\") pod \"telemeter-client-5d8c68f47b-dsvwx\" (UID: \"4590cd89-b5f6-483b-8527-c40f763211b8\") " pod="openshift-monitoring/telemeter-client-5d8c68f47b-dsvwx" Jul 12 19:24:52.163685 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:52.163550 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4590cd89-b5f6-483b-8527-c40f763211b8-metrics-client-ca\") pod \"telemeter-client-5d8c68f47b-dsvwx\" (UID: \"4590cd89-b5f6-483b-8527-c40f763211b8\") " pod="openshift-monitoring/telemeter-client-5d8c68f47b-dsvwx" Jul 12 19:24:52.163685 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:52.163567 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4590cd89-b5f6-483b-8527-c40f763211b8-secret-telemeter-client\") pod \"telemeter-client-5d8c68f47b-dsvwx\" (UID: \"4590cd89-b5f6-483b-8527-c40f763211b8\") " pod="openshift-monitoring/telemeter-client-5d8c68f47b-dsvwx" Jul 12 19:24:52.163685 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:52.163616 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4590cd89-b5f6-483b-8527-c40f763211b8-serving-certs-ca-bundle\") pod \"telemeter-client-5d8c68f47b-dsvwx\" (UID: \"4590cd89-b5f6-483b-8527-c40f763211b8\") " pod="openshift-monitoring/telemeter-client-5d8c68f47b-dsvwx" Jul 12 19:24:52.163685 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:52.163666 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4590cd89-b5f6-483b-8527-c40f763211b8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5d8c68f47b-dsvwx\" (UID: \"4590cd89-b5f6-483b-8527-c40f763211b8\") " pod="openshift-monitoring/telemeter-client-5d8c68f47b-dsvwx" Jul 12 19:24:52.163808 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:52.163705 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4590cd89-b5f6-483b-8527-c40f763211b8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5d8c68f47b-dsvwx\" (UID: \"4590cd89-b5f6-483b-8527-c40f763211b8\") " pod="openshift-monitoring/telemeter-client-5d8c68f47b-dsvwx" Jul 12 19:24:52.163808 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:52.163757 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kvhwz\" (UniqueName: \"kubernetes.io/projected/4590cd89-b5f6-483b-8527-c40f763211b8-kube-api-access-kvhwz\") pod \"telemeter-client-5d8c68f47b-dsvwx\" (UID: \"4590cd89-b5f6-483b-8527-c40f763211b8\") " pod="openshift-monitoring/telemeter-client-5d8c68f47b-dsvwx" Jul 12 19:24:52.264784 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:52.264748 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kvhwz\" (UniqueName: \"kubernetes.io/projected/4590cd89-b5f6-483b-8527-c40f763211b8-kube-api-access-kvhwz\") pod \"telemeter-client-5d8c68f47b-dsvwx\" (UID: \"4590cd89-b5f6-483b-8527-c40f763211b8\") " pod="openshift-monitoring/telemeter-client-5d8c68f47b-dsvwx" Jul 12 19:24:52.264784 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:52.264789 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4590cd89-b5f6-483b-8527-c40f763211b8-telemeter-client-tls\") pod \"telemeter-client-5d8c68f47b-dsvwx\" (UID: \"4590cd89-b5f6-483b-8527-c40f763211b8\") " pod="openshift-monitoring/telemeter-client-5d8c68f47b-dsvwx" Jul 12 19:24:52.264977 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:52.264807 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4590cd89-b5f6-483b-8527-c40f763211b8-federate-client-tls\") pod \"telemeter-client-5d8c68f47b-dsvwx\" (UID: \"4590cd89-b5f6-483b-8527-c40f763211b8\") " pod="openshift-monitoring/telemeter-client-5d8c68f47b-dsvwx" Jul 12 19:24:52.264977 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:52.264832 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4590cd89-b5f6-483b-8527-c40f763211b8-metrics-client-ca\") pod \"telemeter-client-5d8c68f47b-dsvwx\" (UID: \"4590cd89-b5f6-483b-8527-c40f763211b8\") " pod="openshift-monitoring/telemeter-client-5d8c68f47b-dsvwx" Jul 12 19:24:52.264977 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:52.264857 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4590cd89-b5f6-483b-8527-c40f763211b8-secret-telemeter-client\") pod \"telemeter-client-5d8c68f47b-dsvwx\" (UID: \"4590cd89-b5f6-483b-8527-c40f763211b8\") " pod="openshift-monitoring/telemeter-client-5d8c68f47b-dsvwx" Jul 12 19:24:52.264977 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:52.264885 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4590cd89-b5f6-483b-8527-c40f763211b8-serving-certs-ca-bundle\") pod \"telemeter-client-5d8c68f47b-dsvwx\" (UID: \"4590cd89-b5f6-483b-8527-c40f763211b8\") " pod="openshift-monitoring/telemeter-client-5d8c68f47b-dsvwx" Jul 12 19:24:52.264977 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:52.264911 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4590cd89-b5f6-483b-8527-c40f763211b8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5d8c68f47b-dsvwx\" (UID: \"4590cd89-b5f6-483b-8527-c40f763211b8\") " pod="openshift-monitoring/telemeter-client-5d8c68f47b-dsvwx" Jul 12 19:24:52.264977 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:52.264951 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4590cd89-b5f6-483b-8527-c40f763211b8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5d8c68f47b-dsvwx\" (UID: \"4590cd89-b5f6-483b-8527-c40f763211b8\") " pod="openshift-monitoring/telemeter-client-5d8c68f47b-dsvwx" Jul 12 19:24:52.265635 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:52.265607 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4590cd89-b5f6-483b-8527-c40f763211b8-metrics-client-ca\") pod \"telemeter-client-5d8c68f47b-dsvwx\" (UID: \"4590cd89-b5f6-483b-8527-c40f763211b8\") " pod="openshift-monitoring/telemeter-client-5d8c68f47b-dsvwx" Jul 12 19:24:52.265738 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:52.265651 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4590cd89-b5f6-483b-8527-c40f763211b8-serving-certs-ca-bundle\") pod \"telemeter-client-5d8c68f47b-dsvwx\" (UID: \"4590cd89-b5f6-483b-8527-c40f763211b8\") " pod="openshift-monitoring/telemeter-client-5d8c68f47b-dsvwx" Jul 12 19:24:52.266101 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:52.266053 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4590cd89-b5f6-483b-8527-c40f763211b8-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5d8c68f47b-dsvwx\" (UID: \"4590cd89-b5f6-483b-8527-c40f763211b8\") " pod="openshift-monitoring/telemeter-client-5d8c68f47b-dsvwx" Jul 12 19:24:52.267380 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:52.267354 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4590cd89-b5f6-483b-8527-c40f763211b8-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5d8c68f47b-dsvwx\" (UID: \"4590cd89-b5f6-483b-8527-c40f763211b8\") " pod="openshift-monitoring/telemeter-client-5d8c68f47b-dsvwx" Jul 12 19:24:52.267582 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:52.267557 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/4590cd89-b5f6-483b-8527-c40f763211b8-telemeter-client-tls\") pod \"telemeter-client-5d8c68f47b-dsvwx\" (UID: \"4590cd89-b5f6-483b-8527-c40f763211b8\") " pod="openshift-monitoring/telemeter-client-5d8c68f47b-dsvwx" Jul 12 19:24:52.267663 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:52.267631 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/4590cd89-b5f6-483b-8527-c40f763211b8-federate-client-tls\") pod \"telemeter-client-5d8c68f47b-dsvwx\" (UID: \"4590cd89-b5f6-483b-8527-c40f763211b8\") " pod="openshift-monitoring/telemeter-client-5d8c68f47b-dsvwx" Jul 12 19:24:52.267757 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:52.267736 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/4590cd89-b5f6-483b-8527-c40f763211b8-secret-telemeter-client\") pod \"telemeter-client-5d8c68f47b-dsvwx\" (UID: \"4590cd89-b5f6-483b-8527-c40f763211b8\") " pod="openshift-monitoring/telemeter-client-5d8c68f47b-dsvwx" Jul 12 19:24:52.271791 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:52.271772 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kvhwz\" (UniqueName: \"kubernetes.io/projected/4590cd89-b5f6-483b-8527-c40f763211b8-kube-api-access-kvhwz\") pod \"telemeter-client-5d8c68f47b-dsvwx\" (UID: \"4590cd89-b5f6-483b-8527-c40f763211b8\") " pod="openshift-monitoring/telemeter-client-5d8c68f47b-dsvwx" Jul 12 19:24:52.408799 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:52.408740 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5d8c68f47b-dsvwx" Jul 12 19:24:52.538130 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:52.538100 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5d8c68f47b-dsvwx"] Jul 12 19:24:52.829458 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:52.829420 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d8c68f47b-dsvwx" event={"ID":"4590cd89-b5f6-483b-8527-c40f763211b8","Type":"ContainerStarted","Data":"b394140f10430aea1b456ee248b09b3e729cd7a204d250fd87d9f61d25365084"} Jul 12 19:24:54.838470 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:54.838394 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d8c68f47b-dsvwx" event={"ID":"4590cd89-b5f6-483b-8527-c40f763211b8","Type":"ContainerStarted","Data":"6d280e7698108ecb7fa4e2c74bf8dbfdb4749675a8d6c34f29e29dde4a2569fa"} Jul 12 19:24:54.838470 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:54.838452 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d8c68f47b-dsvwx" event={"ID":"4590cd89-b5f6-483b-8527-c40f763211b8","Type":"ContainerStarted","Data":"c6984084d64c9b623bb54132d0a497e9f4dae233e49715eee913e275fb2c167f"} Jul 12 19:24:54.838858 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:54.838471 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5d8c68f47b-dsvwx" event={"ID":"4590cd89-b5f6-483b-8527-c40f763211b8","Type":"ContainerStarted","Data":"e066f1704129b3bcbb899766916c490a4d00fe555e33d752c6777b3ef9d4394f"} Jul 12 19:24:54.858149 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:24:54.858105 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5d8c68f47b-dsvwx" podStartSLOduration=0.927562389 podStartE2EDuration="2.858091809s" totalImagesPullingTime="1.93052942s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:24:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:24:54.856803946 +0000 UTC m=+166.311396909" watchObservedRunningTime="2026-07-12 19:24:54.858091809 +0000 UTC m=+166.312684818" Jul 12 19:25:40.554529 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:25:40.554492 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404z4qk"] Jul 12 19:25:40.557921 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:25:40.557904 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404z4qk" Jul 12 19:25:40.560166 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:25:40.560143 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 12 19:25:40.560299 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:25:40.560215 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jxbgx\"" Jul 12 19:25:40.560299 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:25:40.560237 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 12 19:25:40.565720 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:25:40.565702 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404z4qk"] Jul 12 19:25:40.619643 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:25:40.619622 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c458f\" (UniqueName: \"kubernetes.io/projected/921a1cf6-2667-4ca1-85fb-0b95b7c0b574-kube-api-access-c458f\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404z4qk\" (UID: \"921a1cf6-2667-4ca1-85fb-0b95b7c0b574\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404z4qk" Jul 12 19:25:40.619750 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:25:40.619673 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/921a1cf6-2667-4ca1-85fb-0b95b7c0b574-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404z4qk\" (UID: \"921a1cf6-2667-4ca1-85fb-0b95b7c0b574\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404z4qk" Jul 12 19:25:40.619750 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:25:40.619720 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/921a1cf6-2667-4ca1-85fb-0b95b7c0b574-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404z4qk\" (UID: \"921a1cf6-2667-4ca1-85fb-0b95b7c0b574\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404z4qk" Jul 12 19:25:40.720337 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:25:40.720299 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/921a1cf6-2667-4ca1-85fb-0b95b7c0b574-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404z4qk\" (UID: \"921a1cf6-2667-4ca1-85fb-0b95b7c0b574\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404z4qk" Jul 12 19:25:40.720337 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:25:40.720341 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/921a1cf6-2667-4ca1-85fb-0b95b7c0b574-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404z4qk\" (UID: \"921a1cf6-2667-4ca1-85fb-0b95b7c0b574\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404z4qk" Jul 12 19:25:40.720482 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:25:40.720376 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c458f\" (UniqueName: \"kubernetes.io/projected/921a1cf6-2667-4ca1-85fb-0b95b7c0b574-kube-api-access-c458f\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404z4qk\" (UID: \"921a1cf6-2667-4ca1-85fb-0b95b7c0b574\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404z4qk" Jul 12 19:25:40.720639 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:25:40.720623 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/921a1cf6-2667-4ca1-85fb-0b95b7c0b574-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404z4qk\" (UID: \"921a1cf6-2667-4ca1-85fb-0b95b7c0b574\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404z4qk" Jul 12 19:25:40.720677 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:25:40.720654 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/921a1cf6-2667-4ca1-85fb-0b95b7c0b574-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404z4qk\" (UID: \"921a1cf6-2667-4ca1-85fb-0b95b7c0b574\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404z4qk" Jul 12 19:25:40.728020 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:25:40.727981 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c458f\" (UniqueName: \"kubernetes.io/projected/921a1cf6-2667-4ca1-85fb-0b95b7c0b574-kube-api-access-c458f\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404z4qk\" (UID: \"921a1cf6-2667-4ca1-85fb-0b95b7c0b574\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404z4qk" Jul 12 19:25:40.867791 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:25:40.867697 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404z4qk" Jul 12 19:25:40.989734 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:25:40.989661 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404z4qk"] Jul 12 19:25:40.992477 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:25:40.992437 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod921a1cf6_2667_4ca1_85fb_0b95b7c0b574.slice/crio-34897091ff0a70c2330bcd75e7fb802881a0d0d7d2a168670df9e8d42054af6f WatchSource:0}: Error finding container 34897091ff0a70c2330bcd75e7fb802881a0d0d7d2a168670df9e8d42054af6f: Status 404 returned error can't find the container with id 34897091ff0a70c2330bcd75e7fb802881a0d0d7d2a168670df9e8d42054af6f Jul 12 19:25:41.006044 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:25:41.006018 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404z4qk" event={"ID":"921a1cf6-2667-4ca1-85fb-0b95b7c0b574","Type":"ContainerStarted","Data":"34897091ff0a70c2330bcd75e7fb802881a0d0d7d2a168670df9e8d42054af6f"} Jul 12 19:25:47.033291 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:25:47.033261 2576 generic.go:356] "Generic (PLEG): container finished" podID="921a1cf6-2667-4ca1-85fb-0b95b7c0b574" containerID="7be5cce261ac866d7eb7b192382e64d56fb00dc93e806bce3221f51aa6b3cfbe" exitCode=0 Jul 12 19:25:47.033668 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:25:47.033348 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404z4qk" event={"ID":"921a1cf6-2667-4ca1-85fb-0b95b7c0b574","Type":"ContainerDied","Data":"7be5cce261ac866d7eb7b192382e64d56fb00dc93e806bce3221f51aa6b3cfbe"} Jul 12 19:25:49.043038 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:25:49.043004 2576 generic.go:356] "Generic (PLEG): container finished" podID="921a1cf6-2667-4ca1-85fb-0b95b7c0b574" containerID="01e68de92bd9dc209096ce28381cdb4564c18c2860a5acae5f9c3e2a212e7c19" exitCode=0 Jul 12 19:25:49.043386 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:25:49.043052 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404z4qk" event={"ID":"921a1cf6-2667-4ca1-85fb-0b95b7c0b574","Type":"ContainerDied","Data":"01e68de92bd9dc209096ce28381cdb4564c18c2860a5acae5f9c3e2a212e7c19"} Jul 12 19:25:57.076687 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:25:57.076655 2576 generic.go:356] "Generic (PLEG): container finished" podID="921a1cf6-2667-4ca1-85fb-0b95b7c0b574" containerID="66e649b298788a7e224d7e99bb38f162a840862b8094f42902b128dedca0927c" exitCode=0 Jul 12 19:25:57.077054 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:25:57.076742 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404z4qk" event={"ID":"921a1cf6-2667-4ca1-85fb-0b95b7c0b574","Type":"ContainerDied","Data":"66e649b298788a7e224d7e99bb38f162a840862b8094f42902b128dedca0927c"} Jul 12 19:25:58.210463 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:25:58.210442 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404z4qk" Jul 12 19:25:58.267663 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:25:58.267642 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c458f\" (UniqueName: \"kubernetes.io/projected/921a1cf6-2667-4ca1-85fb-0b95b7c0b574-kube-api-access-c458f\") pod \"921a1cf6-2667-4ca1-85fb-0b95b7c0b574\" (UID: \"921a1cf6-2667-4ca1-85fb-0b95b7c0b574\") " Jul 12 19:25:58.267774 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:25:58.267738 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/921a1cf6-2667-4ca1-85fb-0b95b7c0b574-util\") pod \"921a1cf6-2667-4ca1-85fb-0b95b7c0b574\" (UID: \"921a1cf6-2667-4ca1-85fb-0b95b7c0b574\") " Jul 12 19:25:58.267835 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:25:58.267821 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/921a1cf6-2667-4ca1-85fb-0b95b7c0b574-bundle\") pod \"921a1cf6-2667-4ca1-85fb-0b95b7c0b574\" (UID: \"921a1cf6-2667-4ca1-85fb-0b95b7c0b574\") " Jul 12 19:25:58.268377 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:25:58.268353 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/921a1cf6-2667-4ca1-85fb-0b95b7c0b574-bundle" (OuterVolumeSpecName: "bundle") pod "921a1cf6-2667-4ca1-85fb-0b95b7c0b574" (UID: "921a1cf6-2667-4ca1-85fb-0b95b7c0b574"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:25:58.269653 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:25:58.269631 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/921a1cf6-2667-4ca1-85fb-0b95b7c0b574-kube-api-access-c458f" (OuterVolumeSpecName: "kube-api-access-c458f") pod "921a1cf6-2667-4ca1-85fb-0b95b7c0b574" (UID: "921a1cf6-2667-4ca1-85fb-0b95b7c0b574"). InnerVolumeSpecName "kube-api-access-c458f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:25:58.273326 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:25:58.273302 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/921a1cf6-2667-4ca1-85fb-0b95b7c0b574-util" (OuterVolumeSpecName: "util") pod "921a1cf6-2667-4ca1-85fb-0b95b7c0b574" (UID: "921a1cf6-2667-4ca1-85fb-0b95b7c0b574"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:25:58.368591 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:25:58.368544 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/921a1cf6-2667-4ca1-85fb-0b95b7c0b574-bundle\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:25:58.368591 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:25:58.368562 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c458f\" (UniqueName: \"kubernetes.io/projected/921a1cf6-2667-4ca1-85fb-0b95b7c0b574-kube-api-access-c458f\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:25:58.368591 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:25:58.368572 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/921a1cf6-2667-4ca1-85fb-0b95b7c0b574-util\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:25:59.084892 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:25:59.084854 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404z4qk" event={"ID":"921a1cf6-2667-4ca1-85fb-0b95b7c0b574","Type":"ContainerDied","Data":"34897091ff0a70c2330bcd75e7fb802881a0d0d7d2a168670df9e8d42054af6f"} Jul 12 19:25:59.084892 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:25:59.084887 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404z4qk" Jul 12 19:25:59.084892 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:25:59.084899 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="34897091ff0a70c2330bcd75e7fb802881a0d0d7d2a168670df9e8d42054af6f" Jul 12 19:26:03.250602 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:03.250561 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2xw9t"] Jul 12 19:26:03.251069 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:03.250843 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="921a1cf6-2667-4ca1-85fb-0b95b7c0b574" containerName="pull" Jul 12 19:26:03.251069 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:03.250853 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="921a1cf6-2667-4ca1-85fb-0b95b7c0b574" containerName="pull" Jul 12 19:26:03.251069 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:03.250872 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="921a1cf6-2667-4ca1-85fb-0b95b7c0b574" containerName="extract" Jul 12 19:26:03.251069 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:03.250877 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="921a1cf6-2667-4ca1-85fb-0b95b7c0b574" containerName="extract" Jul 12 19:26:03.251069 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:03.250885 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="921a1cf6-2667-4ca1-85fb-0b95b7c0b574" containerName="util" Jul 12 19:26:03.251069 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:03.250890 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="921a1cf6-2667-4ca1-85fb-0b95b7c0b574" containerName="util" Jul 12 19:26:03.251069 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:03.250950 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="921a1cf6-2667-4ca1-85fb-0b95b7c0b574" containerName="extract" Jul 12 19:26:03.284540 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:03.284509 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2xw9t"] Jul 12 19:26:03.284678 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:03.284607 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2xw9t" Jul 12 19:26:03.286960 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:03.286938 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 12 19:26:03.287092 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:03.287007 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-gvdvg\"" Jul 12 19:26:03.287092 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:03.287085 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 12 19:26:03.406916 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:03.406889 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcs9v\" (UniqueName: \"kubernetes.io/projected/aa944776-f59e-4b31-8680-f7c59f39551d-kube-api-access-tcs9v\") pod \"cert-manager-operator-controller-manager-55c444bf86-2xw9t\" (UID: \"aa944776-f59e-4b31-8680-f7c59f39551d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2xw9t" Jul 12 19:26:03.407085 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:03.406925 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa944776-f59e-4b31-8680-f7c59f39551d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-2xw9t\" (UID: \"aa944776-f59e-4b31-8680-f7c59f39551d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2xw9t" Jul 12 19:26:03.508142 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:03.508051 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcs9v\" (UniqueName: \"kubernetes.io/projected/aa944776-f59e-4b31-8680-f7c59f39551d-kube-api-access-tcs9v\") pod \"cert-manager-operator-controller-manager-55c444bf86-2xw9t\" (UID: \"aa944776-f59e-4b31-8680-f7c59f39551d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2xw9t" Jul 12 19:26:03.508142 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:03.508092 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa944776-f59e-4b31-8680-f7c59f39551d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-2xw9t\" (UID: \"aa944776-f59e-4b31-8680-f7c59f39551d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2xw9t" Jul 12 19:26:03.508525 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:03.508505 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/aa944776-f59e-4b31-8680-f7c59f39551d-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-2xw9t\" (UID: \"aa944776-f59e-4b31-8680-f7c59f39551d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2xw9t" Jul 12 19:26:03.516405 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:03.516383 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcs9v\" (UniqueName: \"kubernetes.io/projected/aa944776-f59e-4b31-8680-f7c59f39551d-kube-api-access-tcs9v\") pod \"cert-manager-operator-controller-manager-55c444bf86-2xw9t\" (UID: \"aa944776-f59e-4b31-8680-f7c59f39551d\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2xw9t" Jul 12 19:26:03.593929 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:03.593901 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2xw9t" Jul 12 19:26:03.752098 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:03.752065 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2xw9t"] Jul 12 19:26:03.756205 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:26:03.756177 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa944776_f59e_4b31_8680_f7c59f39551d.slice/crio-19fb8117e2dca01c154c1f10d630ddab66172903b93437810acf4338093be4fa WatchSource:0}: Error finding container 19fb8117e2dca01c154c1f10d630ddab66172903b93437810acf4338093be4fa: Status 404 returned error can't find the container with id 19fb8117e2dca01c154c1f10d630ddab66172903b93437810acf4338093be4fa Jul 12 19:26:04.104687 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:04.104599 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2xw9t" event={"ID":"aa944776-f59e-4b31-8680-f7c59f39551d","Type":"ContainerStarted","Data":"19fb8117e2dca01c154c1f10d630ddab66172903b93437810acf4338093be4fa"} Jul 12 19:26:06.115841 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:06.115732 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2xw9t" event={"ID":"aa944776-f59e-4b31-8680-f7c59f39551d","Type":"ContainerStarted","Data":"3ed33f75101573e82d7a58057e23df322bd69726d8a261b474c0b223eacdc0e8"} Jul 12 19:26:06.136558 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:06.136506 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-2xw9t" podStartSLOduration=1.100101044 podStartE2EDuration="3.136489647s" totalImagesPullingTime="2.036388603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:26:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:26:06.134797207 +0000 UTC m=+237.589390171" watchObservedRunningTime="2026-07-12 19:26:06.136489647 +0000 UTC m=+237.591082610" Jul 12 19:26:07.924775 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:07.924739 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqtfmr"] Jul 12 19:26:07.938349 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:07.938324 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqtfmr"] Jul 12 19:26:07.938509 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:07.938434 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqtfmr" Jul 12 19:26:07.940785 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:07.940763 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jxbgx\"" Jul 12 19:26:07.940913 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:07.940796 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 12 19:26:07.940913 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:07.940836 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 12 19:26:08.047147 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:08.047109 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bh57h\" (UniqueName: \"kubernetes.io/projected/fd7ec824-7595-4c77-8282-a98384a4b465-kube-api-access-bh57h\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqtfmr\" (UID: \"fd7ec824-7595-4c77-8282-a98384a4b465\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqtfmr" Jul 12 19:26:08.047313 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:08.047175 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd7ec824-7595-4c77-8282-a98384a4b465-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqtfmr\" (UID: \"fd7ec824-7595-4c77-8282-a98384a4b465\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqtfmr" Jul 12 19:26:08.047313 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:08.047227 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd7ec824-7595-4c77-8282-a98384a4b465-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqtfmr\" (UID: \"fd7ec824-7595-4c77-8282-a98384a4b465\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqtfmr" Jul 12 19:26:08.148482 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:08.148454 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bh57h\" (UniqueName: \"kubernetes.io/projected/fd7ec824-7595-4c77-8282-a98384a4b465-kube-api-access-bh57h\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqtfmr\" (UID: \"fd7ec824-7595-4c77-8282-a98384a4b465\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqtfmr" Jul 12 19:26:08.148654 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:08.148499 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd7ec824-7595-4c77-8282-a98384a4b465-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqtfmr\" (UID: \"fd7ec824-7595-4c77-8282-a98384a4b465\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqtfmr" Jul 12 19:26:08.148654 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:08.148524 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd7ec824-7595-4c77-8282-a98384a4b465-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqtfmr\" (UID: \"fd7ec824-7595-4c77-8282-a98384a4b465\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqtfmr" Jul 12 19:26:08.148871 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:08.148856 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd7ec824-7595-4c77-8282-a98384a4b465-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqtfmr\" (UID: \"fd7ec824-7595-4c77-8282-a98384a4b465\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqtfmr" Jul 12 19:26:08.148928 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:08.148912 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd7ec824-7595-4c77-8282-a98384a4b465-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqtfmr\" (UID: \"fd7ec824-7595-4c77-8282-a98384a4b465\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqtfmr" Jul 12 19:26:08.156297 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:08.156274 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bh57h\" (UniqueName: \"kubernetes.io/projected/fd7ec824-7595-4c77-8282-a98384a4b465-kube-api-access-bh57h\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqtfmr\" (UID: \"fd7ec824-7595-4c77-8282-a98384a4b465\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqtfmr" Jul 12 19:26:08.249491 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:08.249461 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqtfmr" Jul 12 19:26:08.388364 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:08.388336 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqtfmr"] Jul 12 19:26:08.391299 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:26:08.391276 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd7ec824_7595_4c77_8282_a98384a4b465.slice/crio-ff6c1e4147f528e0d6b20e43d4e3e7190349f3ad787e2af492b2876c61e8f411 WatchSource:0}: Error finding container ff6c1e4147f528e0d6b20e43d4e3e7190349f3ad787e2af492b2876c61e8f411: Status 404 returned error can't find the container with id ff6c1e4147f528e0d6b20e43d4e3e7190349f3ad787e2af492b2876c61e8f411 Jul 12 19:26:09.129290 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:09.129259 2576 generic.go:356] "Generic (PLEG): container finished" podID="fd7ec824-7595-4c77-8282-a98384a4b465" containerID="119de94d96561c8939992f78f7c5d4622fa1ca1d9fa4cee154d4780e5a34eb95" exitCode=0 Jul 12 19:26:09.129642 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:09.129301 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqtfmr" event={"ID":"fd7ec824-7595-4c77-8282-a98384a4b465","Type":"ContainerDied","Data":"119de94d96561c8939992f78f7c5d4622fa1ca1d9fa4cee154d4780e5a34eb95"} Jul 12 19:26:09.129642 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:09.129333 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqtfmr" event={"ID":"fd7ec824-7595-4c77-8282-a98384a4b465","Type":"ContainerStarted","Data":"ff6c1e4147f528e0d6b20e43d4e3e7190349f3ad787e2af492b2876c61e8f411"} Jul 12 19:26:11.139748 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:11.139710 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqtfmr" event={"ID":"fd7ec824-7595-4c77-8282-a98384a4b465","Type":"ContainerStarted","Data":"28dc08f9b137bb1bcdd188ea1625077b5d61a3123677240558b57c84b30a202a"} Jul 12 19:26:11.670004 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:11.669954 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-qlgxg"] Jul 12 19:26:11.672095 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:11.672080 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qlgxg" Jul 12 19:26:11.674358 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:11.674329 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 12 19:26:11.675177 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:11.675157 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-5sj5r\"" Jul 12 19:26:11.675269 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:11.675197 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 12 19:26:11.681790 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:11.681770 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-qlgxg"] Jul 12 19:26:11.781035 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:11.780978 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlxzq\" (UniqueName: \"kubernetes.io/projected/2c35f5e7-af6e-4a0c-8799-969fa935f736-kube-api-access-dlxzq\") pod \"cert-manager-cainjector-559cdd8c87-qlgxg\" (UID: \"2c35f5e7-af6e-4a0c-8799-969fa935f736\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qlgxg" Jul 12 19:26:11.781186 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:11.781045 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c35f5e7-af6e-4a0c-8799-969fa935f736-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-qlgxg\" (UID: \"2c35f5e7-af6e-4a0c-8799-969fa935f736\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qlgxg" Jul 12 19:26:11.881484 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:11.881454 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlxzq\" (UniqueName: \"kubernetes.io/projected/2c35f5e7-af6e-4a0c-8799-969fa935f736-kube-api-access-dlxzq\") pod \"cert-manager-cainjector-559cdd8c87-qlgxg\" (UID: \"2c35f5e7-af6e-4a0c-8799-969fa935f736\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qlgxg" Jul 12 19:26:11.881484 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:11.881490 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c35f5e7-af6e-4a0c-8799-969fa935f736-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-qlgxg\" (UID: \"2c35f5e7-af6e-4a0c-8799-969fa935f736\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qlgxg" Jul 12 19:26:11.888845 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:11.888814 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2c35f5e7-af6e-4a0c-8799-969fa935f736-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-qlgxg\" (UID: \"2c35f5e7-af6e-4a0c-8799-969fa935f736\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qlgxg" Jul 12 19:26:11.888945 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:11.888848 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlxzq\" (UniqueName: \"kubernetes.io/projected/2c35f5e7-af6e-4a0c-8799-969fa935f736-kube-api-access-dlxzq\") pod \"cert-manager-cainjector-559cdd8c87-qlgxg\" (UID: \"2c35f5e7-af6e-4a0c-8799-969fa935f736\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-qlgxg" Jul 12 19:26:11.989793 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:11.989764 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qlgxg" Jul 12 19:26:12.114537 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:12.114506 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-qlgxg"] Jul 12 19:26:12.117160 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:26:12.117134 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2c35f5e7_af6e_4a0c_8799_969fa935f736.slice/crio-24d8f6e21c90f7900e0a31463a81c17e562eba7e7c892e1d89a116fb24ed9adb WatchSource:0}: Error finding container 24d8f6e21c90f7900e0a31463a81c17e562eba7e7c892e1d89a116fb24ed9adb: Status 404 returned error can't find the container with id 24d8f6e21c90f7900e0a31463a81c17e562eba7e7c892e1d89a116fb24ed9adb Jul 12 19:26:12.145462 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:12.145433 2576 generic.go:356] "Generic (PLEG): container finished" podID="fd7ec824-7595-4c77-8282-a98384a4b465" containerID="28dc08f9b137bb1bcdd188ea1625077b5d61a3123677240558b57c84b30a202a" exitCode=0 Jul 12 19:26:12.145810 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:12.145503 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqtfmr" event={"ID":"fd7ec824-7595-4c77-8282-a98384a4b465","Type":"ContainerDied","Data":"28dc08f9b137bb1bcdd188ea1625077b5d61a3123677240558b57c84b30a202a"} Jul 12 19:26:12.146836 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:12.146809 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qlgxg" event={"ID":"2c35f5e7-af6e-4a0c-8799-969fa935f736","Type":"ContainerStarted","Data":"24d8f6e21c90f7900e0a31463a81c17e562eba7e7c892e1d89a116fb24ed9adb"} Jul 12 19:26:13.154425 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:13.154393 2576 generic.go:356] "Generic (PLEG): container finished" podID="fd7ec824-7595-4c77-8282-a98384a4b465" containerID="aa276ea100c1805142d21a909c93589d5ecd1ec785fb18dd7005f983c9b30549" exitCode=0 Jul 12 19:26:13.155023 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:13.154436 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqtfmr" event={"ID":"fd7ec824-7595-4c77-8282-a98384a4b465","Type":"ContainerDied","Data":"aa276ea100c1805142d21a909c93589d5ecd1ec785fb18dd7005f983c9b30549"} Jul 12 19:26:14.771134 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:14.771105 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqtfmr" Jul 12 19:26:14.906807 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:14.906780 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd7ec824-7595-4c77-8282-a98384a4b465-bundle\") pod \"fd7ec824-7595-4c77-8282-a98384a4b465\" (UID: \"fd7ec824-7595-4c77-8282-a98384a4b465\") " Jul 12 19:26:14.906973 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:14.906848 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd7ec824-7595-4c77-8282-a98384a4b465-util\") pod \"fd7ec824-7595-4c77-8282-a98384a4b465\" (UID: \"fd7ec824-7595-4c77-8282-a98384a4b465\") " Jul 12 19:26:14.906973 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:14.906952 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bh57h\" (UniqueName: \"kubernetes.io/projected/fd7ec824-7595-4c77-8282-a98384a4b465-kube-api-access-bh57h\") pod \"fd7ec824-7595-4c77-8282-a98384a4b465\" (UID: \"fd7ec824-7595-4c77-8282-a98384a4b465\") " Jul 12 19:26:14.907196 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:14.907173 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd7ec824-7595-4c77-8282-a98384a4b465-bundle" (OuterVolumeSpecName: "bundle") pod "fd7ec824-7595-4c77-8282-a98384a4b465" (UID: "fd7ec824-7595-4c77-8282-a98384a4b465"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:26:14.909805 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:14.909776 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd7ec824-7595-4c77-8282-a98384a4b465-kube-api-access-bh57h" (OuterVolumeSpecName: "kube-api-access-bh57h") pod "fd7ec824-7595-4c77-8282-a98384a4b465" (UID: "fd7ec824-7595-4c77-8282-a98384a4b465"). InnerVolumeSpecName "kube-api-access-bh57h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:26:14.911625 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:14.911605 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fd7ec824-7595-4c77-8282-a98384a4b465-util" (OuterVolumeSpecName: "util") pod "fd7ec824-7595-4c77-8282-a98384a4b465" (UID: "fd7ec824-7595-4c77-8282-a98384a4b465"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:26:15.008752 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:15.008663 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fd7ec824-7595-4c77-8282-a98384a4b465-util\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:26:15.008752 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:15.008699 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bh57h\" (UniqueName: \"kubernetes.io/projected/fd7ec824-7595-4c77-8282-a98384a4b465-kube-api-access-bh57h\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:26:15.008752 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:15.008714 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fd7ec824-7595-4c77-8282-a98384a4b465-bundle\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:26:15.170123 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:15.170094 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqtfmr" Jul 12 19:26:15.170287 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:15.170100 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fqtfmr" event={"ID":"fd7ec824-7595-4c77-8282-a98384a4b465","Type":"ContainerDied","Data":"ff6c1e4147f528e0d6b20e43d4e3e7190349f3ad787e2af492b2876c61e8f411"} Jul 12 19:26:15.170287 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:15.170215 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ff6c1e4147f528e0d6b20e43d4e3e7190349f3ad787e2af492b2876c61e8f411" Jul 12 19:26:15.171856 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:15.171834 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qlgxg" event={"ID":"2c35f5e7-af6e-4a0c-8799-969fa935f736","Type":"ContainerStarted","Data":"17e5212100304a545248bccbc2b8f738aeeb0b96db8c184c188721daf21e4ff0"} Jul 12 19:26:15.188893 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:15.188848 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-qlgxg" podStartSLOduration=1.494641002 podStartE2EDuration="4.188831796s" totalImagesPullingTime="2.694190794s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:26:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:26:15.1871926 +0000 UTC m=+246.641785567" watchObservedRunningTime="2026-07-12 19:26:15.188831796 +0000 UTC m=+246.643424760" Jul 12 19:26:17.663379 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:17.663345 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-lgwbt"] Jul 12 19:26:17.663740 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:17.663633 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd7ec824-7595-4c77-8282-a98384a4b465" containerName="util" Jul 12 19:26:17.663740 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:17.663644 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd7ec824-7595-4c77-8282-a98384a4b465" containerName="util" Jul 12 19:26:17.663740 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:17.663655 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd7ec824-7595-4c77-8282-a98384a4b465" containerName="extract" Jul 12 19:26:17.663740 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:17.663663 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd7ec824-7595-4c77-8282-a98384a4b465" containerName="extract" Jul 12 19:26:17.663740 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:17.663671 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd7ec824-7595-4c77-8282-a98384a4b465" containerName="pull" Jul 12 19:26:17.663740 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:17.663676 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd7ec824-7595-4c77-8282-a98384a4b465" containerName="pull" Jul 12 19:26:17.663740 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:17.663724 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd7ec824-7595-4c77-8282-a98384a4b465" containerName="extract" Jul 12 19:26:17.666781 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:17.666764 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-lgwbt" Jul 12 19:26:17.668853 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:17.668831 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-7nk7r\"" Jul 12 19:26:17.674946 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:17.674918 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-lgwbt"] Jul 12 19:26:17.829778 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:17.829745 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d940411f-36bb-4c7c-8143-a88786225286-bound-sa-token\") pod \"cert-manager-55b4d954d5-lgwbt\" (UID: \"d940411f-36bb-4c7c-8143-a88786225286\") " pod="cert-manager/cert-manager-55b4d954d5-lgwbt" Jul 12 19:26:17.829942 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:17.829797 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v4rgm\" (UniqueName: \"kubernetes.io/projected/d940411f-36bb-4c7c-8143-a88786225286-kube-api-access-v4rgm\") pod \"cert-manager-55b4d954d5-lgwbt\" (UID: \"d940411f-36bb-4c7c-8143-a88786225286\") " pod="cert-manager/cert-manager-55b4d954d5-lgwbt" Jul 12 19:26:17.930933 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:17.930853 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d940411f-36bb-4c7c-8143-a88786225286-bound-sa-token\") pod \"cert-manager-55b4d954d5-lgwbt\" (UID: \"d940411f-36bb-4c7c-8143-a88786225286\") " pod="cert-manager/cert-manager-55b4d954d5-lgwbt" Jul 12 19:26:17.930933 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:17.930904 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v4rgm\" (UniqueName: \"kubernetes.io/projected/d940411f-36bb-4c7c-8143-a88786225286-kube-api-access-v4rgm\") pod \"cert-manager-55b4d954d5-lgwbt\" (UID: \"d940411f-36bb-4c7c-8143-a88786225286\") " pod="cert-manager/cert-manager-55b4d954d5-lgwbt" Jul 12 19:26:17.939620 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:17.939593 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/d940411f-36bb-4c7c-8143-a88786225286-bound-sa-token\") pod \"cert-manager-55b4d954d5-lgwbt\" (UID: \"d940411f-36bb-4c7c-8143-a88786225286\") " pod="cert-manager/cert-manager-55b4d954d5-lgwbt" Jul 12 19:26:17.939876 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:17.939856 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v4rgm\" (UniqueName: \"kubernetes.io/projected/d940411f-36bb-4c7c-8143-a88786225286-kube-api-access-v4rgm\") pod \"cert-manager-55b4d954d5-lgwbt\" (UID: \"d940411f-36bb-4c7c-8143-a88786225286\") " pod="cert-manager/cert-manager-55b4d954d5-lgwbt" Jul 12 19:26:17.975822 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:17.975793 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-lgwbt" Jul 12 19:26:18.104158 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:18.104124 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-lgwbt"] Jul 12 19:26:18.107532 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:26:18.107503 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd940411f_36bb_4c7c_8143_a88786225286.slice/crio-319c175f992d1d78b25d5bed2b6ada2768fd184b94ca54379e0d12666db8be36 WatchSource:0}: Error finding container 319c175f992d1d78b25d5bed2b6ada2768fd184b94ca54379e0d12666db8be36: Status 404 returned error can't find the container with id 319c175f992d1d78b25d5bed2b6ada2768fd184b94ca54379e0d12666db8be36 Jul 12 19:26:18.186816 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:18.186788 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-lgwbt" event={"ID":"d940411f-36bb-4c7c-8143-a88786225286","Type":"ContainerStarted","Data":"63c3ddff4133fbe910cda3b6c43c2978deca8801bb96641a2c27cfd78dfee5e2"} Jul 12 19:26:18.187001 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:18.186832 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-lgwbt" event={"ID":"d940411f-36bb-4c7c-8143-a88786225286","Type":"ContainerStarted","Data":"319c175f992d1d78b25d5bed2b6ada2768fd184b94ca54379e0d12666db8be36"} Jul 12 19:26:18.200939 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:18.200897 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-lgwbt" podStartSLOduration=1.200881688 podStartE2EDuration="1.200881688s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:26:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:26:18.200399744 +0000 UTC m=+249.654992712" watchObservedRunningTime="2026-07-12 19:26:18.200881688 +0000 UTC m=+249.655474641" Jul 12 19:26:25.144406 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:25.144377 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g4lth"] Jul 12 19:26:25.147735 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:25.147718 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g4lth" Jul 12 19:26:25.150080 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:25.150044 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 12 19:26:25.150183 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:25.150100 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 12 19:26:25.150820 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:25.150801 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-fp2kv\"" Jul 12 19:26:25.154478 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:25.154452 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g4lth"] Jul 12 19:26:25.289810 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:25.289780 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5rmz\" (UniqueName: \"kubernetes.io/projected/103f212a-af4d-4357-a42c-0bb75eecd6f5-kube-api-access-p5rmz\") pod \"openshift-lws-operator-fd8ccff4c-g4lth\" (UID: \"103f212a-af4d-4357-a42c-0bb75eecd6f5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g4lth" Jul 12 19:26:25.290008 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:25.289842 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/103f212a-af4d-4357-a42c-0bb75eecd6f5-tmp\") pod \"openshift-lws-operator-fd8ccff4c-g4lth\" (UID: \"103f212a-af4d-4357-a42c-0bb75eecd6f5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g4lth" Jul 12 19:26:25.391174 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:25.391138 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5rmz\" (UniqueName: \"kubernetes.io/projected/103f212a-af4d-4357-a42c-0bb75eecd6f5-kube-api-access-p5rmz\") pod \"openshift-lws-operator-fd8ccff4c-g4lth\" (UID: \"103f212a-af4d-4357-a42c-0bb75eecd6f5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g4lth" Jul 12 19:26:25.391333 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:25.391202 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/103f212a-af4d-4357-a42c-0bb75eecd6f5-tmp\") pod \"openshift-lws-operator-fd8ccff4c-g4lth\" (UID: \"103f212a-af4d-4357-a42c-0bb75eecd6f5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g4lth" Jul 12 19:26:25.391575 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:25.391557 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/103f212a-af4d-4357-a42c-0bb75eecd6f5-tmp\") pod \"openshift-lws-operator-fd8ccff4c-g4lth\" (UID: \"103f212a-af4d-4357-a42c-0bb75eecd6f5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g4lth" Jul 12 19:26:25.398839 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:25.398792 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5rmz\" (UniqueName: \"kubernetes.io/projected/103f212a-af4d-4357-a42c-0bb75eecd6f5-kube-api-access-p5rmz\") pod \"openshift-lws-operator-fd8ccff4c-g4lth\" (UID: \"103f212a-af4d-4357-a42c-0bb75eecd6f5\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g4lth" Jul 12 19:26:25.456996 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:25.456965 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g4lth" Jul 12 19:26:25.582936 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:25.582797 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g4lth"] Jul 12 19:26:25.585467 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:26:25.585440 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod103f212a_af4d_4357_a42c_0bb75eecd6f5.slice/crio-123a7e616b499936ca894b14ac5ba2ca53789a12699ae761b09ee1c08df37eaf WatchSource:0}: Error finding container 123a7e616b499936ca894b14ac5ba2ca53789a12699ae761b09ee1c08df37eaf: Status 404 returned error can't find the container with id 123a7e616b499936ca894b14ac5ba2ca53789a12699ae761b09ee1c08df37eaf Jul 12 19:26:26.219117 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:26.219080 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g4lth" event={"ID":"103f212a-af4d-4357-a42c-0bb75eecd6f5","Type":"ContainerStarted","Data":"123a7e616b499936ca894b14ac5ba2ca53789a12699ae761b09ee1c08df37eaf"} Jul 12 19:26:28.229591 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:28.229552 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g4lth" event={"ID":"103f212a-af4d-4357-a42c-0bb75eecd6f5","Type":"ContainerStarted","Data":"15a9faafc1264e42dea9fbc50affb22c8bb7ce5b04fc4689aafb76702b12ac82"} Jul 12 19:26:28.247139 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:28.247092 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-g4lth" podStartSLOduration=1.430616191 podStartE2EDuration="3.24707791s" totalImagesPullingTime="1.816461719s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:26:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:26:28.245621154 +0000 UTC m=+259.700214117" watchObservedRunningTime="2026-07-12 19:26:28.24707791 +0000 UTC m=+259.701670873" Jul 12 19:26:32.974522 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:32.974449 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2q45"] Jul 12 19:26:32.977794 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:32.977777 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2q45" Jul 12 19:26:32.979973 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:32.979946 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 12 19:26:32.980072 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:32.980044 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 12 19:26:32.980841 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:32.980828 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jxbgx\"" Jul 12 19:26:32.985447 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:32.985182 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2q45"] Jul 12 19:26:33.052076 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:33.052050 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82v48\" (UniqueName: \"kubernetes.io/projected/3c461c5c-a8ad-4e36-bb19-94cd38d3679d-kube-api-access-82v48\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2q45\" (UID: \"3c461c5c-a8ad-4e36-bb19-94cd38d3679d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2q45" Jul 12 19:26:33.052240 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:33.052084 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c461c5c-a8ad-4e36-bb19-94cd38d3679d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2q45\" (UID: \"3c461c5c-a8ad-4e36-bb19-94cd38d3679d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2q45" Jul 12 19:26:33.052240 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:33.052123 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c461c5c-a8ad-4e36-bb19-94cd38d3679d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2q45\" (UID: \"3c461c5c-a8ad-4e36-bb19-94cd38d3679d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2q45" Jul 12 19:26:33.153419 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:33.153388 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82v48\" (UniqueName: \"kubernetes.io/projected/3c461c5c-a8ad-4e36-bb19-94cd38d3679d-kube-api-access-82v48\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2q45\" (UID: \"3c461c5c-a8ad-4e36-bb19-94cd38d3679d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2q45" Jul 12 19:26:33.153533 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:33.153425 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c461c5c-a8ad-4e36-bb19-94cd38d3679d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2q45\" (UID: \"3c461c5c-a8ad-4e36-bb19-94cd38d3679d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2q45" Jul 12 19:26:33.153533 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:33.153477 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c461c5c-a8ad-4e36-bb19-94cd38d3679d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2q45\" (UID: \"3c461c5c-a8ad-4e36-bb19-94cd38d3679d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2q45" Jul 12 19:26:33.153810 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:33.153793 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c461c5c-a8ad-4e36-bb19-94cd38d3679d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2q45\" (UID: \"3c461c5c-a8ad-4e36-bb19-94cd38d3679d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2q45" Jul 12 19:26:33.153863 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:33.153845 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c461c5c-a8ad-4e36-bb19-94cd38d3679d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2q45\" (UID: \"3c461c5c-a8ad-4e36-bb19-94cd38d3679d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2q45" Jul 12 19:26:33.161056 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:33.161032 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82v48\" (UniqueName: \"kubernetes.io/projected/3c461c5c-a8ad-4e36-bb19-94cd38d3679d-kube-api-access-82v48\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2q45\" (UID: \"3c461c5c-a8ad-4e36-bb19-94cd38d3679d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2q45" Jul 12 19:26:33.287654 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:33.287580 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2q45" Jul 12 19:26:33.415889 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:33.415866 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2q45"] Jul 12 19:26:33.418363 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:26:33.418337 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c461c5c_a8ad_4e36_bb19_94cd38d3679d.slice/crio-6bad0100ccaec6fcdd2b41928137bb795295f3da43ada3c62597f315ee6b867a WatchSource:0}: Error finding container 6bad0100ccaec6fcdd2b41928137bb795295f3da43ada3c62597f315ee6b867a: Status 404 returned error can't find the container with id 6bad0100ccaec6fcdd2b41928137bb795295f3da43ada3c62597f315ee6b867a Jul 12 19:26:34.255911 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:34.255878 2576 generic.go:356] "Generic (PLEG): container finished" podID="3c461c5c-a8ad-4e36-bb19-94cd38d3679d" containerID="c083e201d5d4ec9ab9474bf0d5f56fdb719dfadb8e2057993924dd81c60b118d" exitCode=0 Jul 12 19:26:34.256376 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:34.255935 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2q45" event={"ID":"3c461c5c-a8ad-4e36-bb19-94cd38d3679d","Type":"ContainerDied","Data":"c083e201d5d4ec9ab9474bf0d5f56fdb719dfadb8e2057993924dd81c60b118d"} Jul 12 19:26:34.256376 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:34.256011 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2q45" event={"ID":"3c461c5c-a8ad-4e36-bb19-94cd38d3679d","Type":"ContainerStarted","Data":"6bad0100ccaec6fcdd2b41928137bb795295f3da43ada3c62597f315ee6b867a"} Jul 12 19:26:35.262144 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:35.262107 2576 generic.go:356] "Generic (PLEG): container finished" podID="3c461c5c-a8ad-4e36-bb19-94cd38d3679d" containerID="133e5dec0202e1f02e7ae4387bd7f8ca8fa7bc82ac5724eec5d758e812f212c2" exitCode=0 Jul 12 19:26:35.262515 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:35.262167 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2q45" event={"ID":"3c461c5c-a8ad-4e36-bb19-94cd38d3679d","Type":"ContainerDied","Data":"133e5dec0202e1f02e7ae4387bd7f8ca8fa7bc82ac5724eec5d758e812f212c2"} Jul 12 19:26:36.269242 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:36.269205 2576 generic.go:356] "Generic (PLEG): container finished" podID="3c461c5c-a8ad-4e36-bb19-94cd38d3679d" containerID="3b67aae1bce50774533eebfaae8e0f9f9a66fc8584fc33748d3a3d95f7ea079c" exitCode=0 Jul 12 19:26:36.269626 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:36.269279 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2q45" event={"ID":"3c461c5c-a8ad-4e36-bb19-94cd38d3679d","Type":"ContainerDied","Data":"3b67aae1bce50774533eebfaae8e0f9f9a66fc8584fc33748d3a3d95f7ea079c"} Jul 12 19:26:37.409622 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:37.409597 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2q45" Jul 12 19:26:37.487420 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:37.487395 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c461c5c-a8ad-4e36-bb19-94cd38d3679d-util\") pod \"3c461c5c-a8ad-4e36-bb19-94cd38d3679d\" (UID: \"3c461c5c-a8ad-4e36-bb19-94cd38d3679d\") " Jul 12 19:26:37.487571 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:37.487452 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-82v48\" (UniqueName: \"kubernetes.io/projected/3c461c5c-a8ad-4e36-bb19-94cd38d3679d-kube-api-access-82v48\") pod \"3c461c5c-a8ad-4e36-bb19-94cd38d3679d\" (UID: \"3c461c5c-a8ad-4e36-bb19-94cd38d3679d\") " Jul 12 19:26:37.487571 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:37.487470 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c461c5c-a8ad-4e36-bb19-94cd38d3679d-bundle\") pod \"3c461c5c-a8ad-4e36-bb19-94cd38d3679d\" (UID: \"3c461c5c-a8ad-4e36-bb19-94cd38d3679d\") " Jul 12 19:26:37.488187 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:37.488161 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c461c5c-a8ad-4e36-bb19-94cd38d3679d-bundle" (OuterVolumeSpecName: "bundle") pod "3c461c5c-a8ad-4e36-bb19-94cd38d3679d" (UID: "3c461c5c-a8ad-4e36-bb19-94cd38d3679d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:26:37.489502 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:37.489470 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3c461c5c-a8ad-4e36-bb19-94cd38d3679d-kube-api-access-82v48" (OuterVolumeSpecName: "kube-api-access-82v48") pod "3c461c5c-a8ad-4e36-bb19-94cd38d3679d" (UID: "3c461c5c-a8ad-4e36-bb19-94cd38d3679d"). InnerVolumeSpecName "kube-api-access-82v48". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:26:37.492597 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:37.492558 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3c461c5c-a8ad-4e36-bb19-94cd38d3679d-util" (OuterVolumeSpecName: "util") pod "3c461c5c-a8ad-4e36-bb19-94cd38d3679d" (UID: "3c461c5c-a8ad-4e36-bb19-94cd38d3679d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:26:37.588084 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:37.588019 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-82v48\" (UniqueName: \"kubernetes.io/projected/3c461c5c-a8ad-4e36-bb19-94cd38d3679d-kube-api-access-82v48\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:26:37.588084 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:37.588044 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3c461c5c-a8ad-4e36-bb19-94cd38d3679d-bundle\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:26:37.588084 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:37.588053 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3c461c5c-a8ad-4e36-bb19-94cd38d3679d-util\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:26:38.280463 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:38.280435 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2q45" Jul 12 19:26:38.280632 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:38.280436 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afr2q45" event={"ID":"3c461c5c-a8ad-4e36-bb19-94cd38d3679d","Type":"ContainerDied","Data":"6bad0100ccaec6fcdd2b41928137bb795295f3da43ada3c62597f315ee6b867a"} Jul 12 19:26:38.280632 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:38.280548 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6bad0100ccaec6fcdd2b41928137bb795295f3da43ada3c62597f315ee6b867a" Jul 12 19:26:46.259384 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:46.259346 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5449d7969f-nwsdg"] Jul 12 19:26:46.259845 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:46.259691 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c461c5c-a8ad-4e36-bb19-94cd38d3679d" containerName="pull" Jul 12 19:26:46.259845 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:46.259702 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c461c5c-a8ad-4e36-bb19-94cd38d3679d" containerName="pull" Jul 12 19:26:46.259845 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:46.259712 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c461c5c-a8ad-4e36-bb19-94cd38d3679d" containerName="util" Jul 12 19:26:46.259845 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:46.259718 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c461c5c-a8ad-4e36-bb19-94cd38d3679d" containerName="util" Jul 12 19:26:46.259845 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:46.259724 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3c461c5c-a8ad-4e36-bb19-94cd38d3679d" containerName="extract" Jul 12 19:26:46.259845 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:46.259730 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3c461c5c-a8ad-4e36-bb19-94cd38d3679d" containerName="extract" Jul 12 19:26:46.259845 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:46.259786 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3c461c5c-a8ad-4e36-bb19-94cd38d3679d" containerName="extract" Jul 12 19:26:46.266459 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:46.266438 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5449d7969f-nwsdg" Jul 12 19:26:46.269423 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:46.269402 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 12 19:26:46.269657 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:46.269639 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-4nbfd\"" Jul 12 19:26:46.269745 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:46.269729 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 12 19:26:46.270197 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:46.270180 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 12 19:26:46.270467 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:46.270452 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 12 19:26:46.286630 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:46.286609 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5449d7969f-nwsdg"] Jul 12 19:26:46.357230 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:46.357197 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/73a3c458-394e-4400-b7e8-c8d6855c85ba-webhook-cert\") pod \"opendatahub-operator-controller-manager-5449d7969f-nwsdg\" (UID: \"73a3c458-394e-4400-b7e8-c8d6855c85ba\") " pod="opendatahub/opendatahub-operator-controller-manager-5449d7969f-nwsdg" Jul 12 19:26:46.357388 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:46.357240 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9r274\" (UniqueName: \"kubernetes.io/projected/73a3c458-394e-4400-b7e8-c8d6855c85ba-kube-api-access-9r274\") pod \"opendatahub-operator-controller-manager-5449d7969f-nwsdg\" (UID: \"73a3c458-394e-4400-b7e8-c8d6855c85ba\") " pod="opendatahub/opendatahub-operator-controller-manager-5449d7969f-nwsdg" Jul 12 19:26:46.357388 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:46.357263 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73a3c458-394e-4400-b7e8-c8d6855c85ba-tmp\") pod \"opendatahub-operator-controller-manager-5449d7969f-nwsdg\" (UID: \"73a3c458-394e-4400-b7e8-c8d6855c85ba\") " pod="opendatahub/opendatahub-operator-controller-manager-5449d7969f-nwsdg" Jul 12 19:26:46.357388 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:46.357287 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/73a3c458-394e-4400-b7e8-c8d6855c85ba-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5449d7969f-nwsdg\" (UID: \"73a3c458-394e-4400-b7e8-c8d6855c85ba\") " pod="opendatahub/opendatahub-operator-controller-manager-5449d7969f-nwsdg" Jul 12 19:26:46.357388 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:46.357325 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/73a3c458-394e-4400-b7e8-c8d6855c85ba-manifests\") pod \"opendatahub-operator-controller-manager-5449d7969f-nwsdg\" (UID: \"73a3c458-394e-4400-b7e8-c8d6855c85ba\") " pod="opendatahub/opendatahub-operator-controller-manager-5449d7969f-nwsdg" Jul 12 19:26:46.458622 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:46.458584 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73a3c458-394e-4400-b7e8-c8d6855c85ba-tmp\") pod \"opendatahub-operator-controller-manager-5449d7969f-nwsdg\" (UID: \"73a3c458-394e-4400-b7e8-c8d6855c85ba\") " pod="opendatahub/opendatahub-operator-controller-manager-5449d7969f-nwsdg" Jul 12 19:26:46.458622 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:46.458621 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/73a3c458-394e-4400-b7e8-c8d6855c85ba-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5449d7969f-nwsdg\" (UID: \"73a3c458-394e-4400-b7e8-c8d6855c85ba\") " pod="opendatahub/opendatahub-operator-controller-manager-5449d7969f-nwsdg" Jul 12 19:26:46.458822 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:46.458657 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/73a3c458-394e-4400-b7e8-c8d6855c85ba-manifests\") pod \"opendatahub-operator-controller-manager-5449d7969f-nwsdg\" (UID: \"73a3c458-394e-4400-b7e8-c8d6855c85ba\") " pod="opendatahub/opendatahub-operator-controller-manager-5449d7969f-nwsdg" Jul 12 19:26:46.458822 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:46.458679 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/73a3c458-394e-4400-b7e8-c8d6855c85ba-webhook-cert\") pod \"opendatahub-operator-controller-manager-5449d7969f-nwsdg\" (UID: \"73a3c458-394e-4400-b7e8-c8d6855c85ba\") " pod="opendatahub/opendatahub-operator-controller-manager-5449d7969f-nwsdg" Jul 12 19:26:46.458822 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:46.458708 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9r274\" (UniqueName: \"kubernetes.io/projected/73a3c458-394e-4400-b7e8-c8d6855c85ba-kube-api-access-9r274\") pod \"opendatahub-operator-controller-manager-5449d7969f-nwsdg\" (UID: \"73a3c458-394e-4400-b7e8-c8d6855c85ba\") " pod="opendatahub/opendatahub-operator-controller-manager-5449d7969f-nwsdg" Jul 12 19:26:46.459134 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:46.459101 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/73a3c458-394e-4400-b7e8-c8d6855c85ba-manifests\") pod \"opendatahub-operator-controller-manager-5449d7969f-nwsdg\" (UID: \"73a3c458-394e-4400-b7e8-c8d6855c85ba\") " pod="opendatahub/opendatahub-operator-controller-manager-5449d7969f-nwsdg" Jul 12 19:26:46.461024 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:46.460979 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/73a3c458-394e-4400-b7e8-c8d6855c85ba-tmp\") pod \"opendatahub-operator-controller-manager-5449d7969f-nwsdg\" (UID: \"73a3c458-394e-4400-b7e8-c8d6855c85ba\") " pod="opendatahub/opendatahub-operator-controller-manager-5449d7969f-nwsdg" Jul 12 19:26:46.461225 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:46.461209 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/73a3c458-394e-4400-b7e8-c8d6855c85ba-webhook-cert\") pod \"opendatahub-operator-controller-manager-5449d7969f-nwsdg\" (UID: \"73a3c458-394e-4400-b7e8-c8d6855c85ba\") " pod="opendatahub/opendatahub-operator-controller-manager-5449d7969f-nwsdg" Jul 12 19:26:46.461267 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:46.461231 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/73a3c458-394e-4400-b7e8-c8d6855c85ba-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5449d7969f-nwsdg\" (UID: \"73a3c458-394e-4400-b7e8-c8d6855c85ba\") " pod="opendatahub/opendatahub-operator-controller-manager-5449d7969f-nwsdg" Jul 12 19:26:46.475938 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:46.475911 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9r274\" (UniqueName: \"kubernetes.io/projected/73a3c458-394e-4400-b7e8-c8d6855c85ba-kube-api-access-9r274\") pod \"opendatahub-operator-controller-manager-5449d7969f-nwsdg\" (UID: \"73a3c458-394e-4400-b7e8-c8d6855c85ba\") " pod="opendatahub/opendatahub-operator-controller-manager-5449d7969f-nwsdg" Jul 12 19:26:46.576107 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:46.576024 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5449d7969f-nwsdg" Jul 12 19:26:46.707365 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:46.707330 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5449d7969f-nwsdg"] Jul 12 19:26:46.710870 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:26:46.710844 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73a3c458_394e_4400_b7e8_c8d6855c85ba.slice/crio-6e83a0be0c3110165d62b187d8ea3fe494aefe0465f7821c103f0974356f8437 WatchSource:0}: Error finding container 6e83a0be0c3110165d62b187d8ea3fe494aefe0465f7821c103f0974356f8437: Status 404 returned error can't find the container with id 6e83a0be0c3110165d62b187d8ea3fe494aefe0465f7821c103f0974356f8437 Jul 12 19:26:47.325896 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:47.325817 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5449d7969f-nwsdg" event={"ID":"73a3c458-394e-4400-b7e8-c8d6855c85ba","Type":"ContainerStarted","Data":"6e83a0be0c3110165d62b187d8ea3fe494aefe0465f7821c103f0974356f8437"} Jul 12 19:26:50.341615 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:50.341572 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5449d7969f-nwsdg" event={"ID":"73a3c458-394e-4400-b7e8-c8d6855c85ba","Type":"ContainerStarted","Data":"b04fb09e00322dff49a2d71828b6151d57a93285ba1b0406bf260c306347a557"} Jul 12 19:26:51.347548 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:51.347509 2576 generic.go:356] "Generic (PLEG): container finished" podID="73a3c458-394e-4400-b7e8-c8d6855c85ba" containerID="b04fb09e00322dff49a2d71828b6151d57a93285ba1b0406bf260c306347a557" exitCode=0 Jul 12 19:26:51.347922 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:51.347572 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5449d7969f-nwsdg" event={"ID":"73a3c458-394e-4400-b7e8-c8d6855c85ba","Type":"ContainerDied","Data":"b04fb09e00322dff49a2d71828b6151d57a93285ba1b0406bf260c306347a557"} Jul 12 19:26:52.354283 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:52.354248 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5449d7969f-nwsdg" event={"ID":"73a3c458-394e-4400-b7e8-c8d6855c85ba","Type":"ContainerStarted","Data":"405c27703d3342d90253481afcf346bd92ce2228ee037eb71a4e90cd193439b4"} Jul 12 19:26:52.354687 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:52.354382 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5449d7969f-nwsdg" Jul 12 19:26:52.374870 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:26:52.374824 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5449d7969f-nwsdg" podStartSLOduration=1.8812909740000001 podStartE2EDuration="6.374805603s" totalImagesPullingTime="3.451989148s" totalInitContainerRuntime="1.041525481s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:26:46 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:26:52.372832502 +0000 UTC m=+283.827425465" watchObservedRunningTime="2026-07-12 19:26:52.374805603 +0000 UTC m=+283.829398565" Jul 12 19:27:03.361206 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:03.361174 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5449d7969f-nwsdg" Jul 12 19:27:07.856061 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:07.856026 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-654967888b-rnlk6"] Jul 12 19:27:07.859398 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:07.859378 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-654967888b-rnlk6" Jul 12 19:27:07.861582 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:07.861558 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 12 19:27:07.861710 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:07.861620 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 12 19:27:07.861710 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:07.861626 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-wq9r5\"" Jul 12 19:27:07.862652 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:07.862632 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 12 19:27:07.862722 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:07.862659 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 12 19:27:07.869450 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:07.869429 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-654967888b-rnlk6"] Jul 12 19:27:07.930465 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:07.930434 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qdvpk\" (UniqueName: \"kubernetes.io/projected/42d6a7be-2253-4d88-8992-8fe83e2ea727-kube-api-access-qdvpk\") pod \"kube-auth-proxy-654967888b-rnlk6\" (UID: \"42d6a7be-2253-4d88-8992-8fe83e2ea727\") " pod="openshift-ingress/kube-auth-proxy-654967888b-rnlk6" Jul 12 19:27:07.930614 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:07.930488 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42d6a7be-2253-4d88-8992-8fe83e2ea727-tls-certs\") pod \"kube-auth-proxy-654967888b-rnlk6\" (UID: \"42d6a7be-2253-4d88-8992-8fe83e2ea727\") " pod="openshift-ingress/kube-auth-proxy-654967888b-rnlk6" Jul 12 19:27:07.930614 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:07.930591 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42d6a7be-2253-4d88-8992-8fe83e2ea727-tmp\") pod \"kube-auth-proxy-654967888b-rnlk6\" (UID: \"42d6a7be-2253-4d88-8992-8fe83e2ea727\") " pod="openshift-ingress/kube-auth-proxy-654967888b-rnlk6" Jul 12 19:27:08.031691 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:08.031651 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42d6a7be-2253-4d88-8992-8fe83e2ea727-tmp\") pod \"kube-auth-proxy-654967888b-rnlk6\" (UID: \"42d6a7be-2253-4d88-8992-8fe83e2ea727\") " pod="openshift-ingress/kube-auth-proxy-654967888b-rnlk6" Jul 12 19:27:08.031858 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:08.031697 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qdvpk\" (UniqueName: \"kubernetes.io/projected/42d6a7be-2253-4d88-8992-8fe83e2ea727-kube-api-access-qdvpk\") pod \"kube-auth-proxy-654967888b-rnlk6\" (UID: \"42d6a7be-2253-4d88-8992-8fe83e2ea727\") " pod="openshift-ingress/kube-auth-proxy-654967888b-rnlk6" Jul 12 19:27:08.031858 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:08.031737 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42d6a7be-2253-4d88-8992-8fe83e2ea727-tls-certs\") pod \"kube-auth-proxy-654967888b-rnlk6\" (UID: \"42d6a7be-2253-4d88-8992-8fe83e2ea727\") " pod="openshift-ingress/kube-auth-proxy-654967888b-rnlk6" Jul 12 19:27:08.033939 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:08.033903 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/42d6a7be-2253-4d88-8992-8fe83e2ea727-tmp\") pod \"kube-auth-proxy-654967888b-rnlk6\" (UID: \"42d6a7be-2253-4d88-8992-8fe83e2ea727\") " pod="openshift-ingress/kube-auth-proxy-654967888b-rnlk6" Jul 12 19:27:08.034133 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:08.034116 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/42d6a7be-2253-4d88-8992-8fe83e2ea727-tls-certs\") pod \"kube-auth-proxy-654967888b-rnlk6\" (UID: \"42d6a7be-2253-4d88-8992-8fe83e2ea727\") " pod="openshift-ingress/kube-auth-proxy-654967888b-rnlk6" Jul 12 19:27:08.047101 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:08.047079 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qdvpk\" (UniqueName: \"kubernetes.io/projected/42d6a7be-2253-4d88-8992-8fe83e2ea727-kube-api-access-qdvpk\") pod \"kube-auth-proxy-654967888b-rnlk6\" (UID: \"42d6a7be-2253-4d88-8992-8fe83e2ea727\") " pod="openshift-ingress/kube-auth-proxy-654967888b-rnlk6" Jul 12 19:27:08.085797 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:08.085764 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9zsvq"] Jul 12 19:27:08.089119 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:08.089100 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9zsvq" Jul 12 19:27:08.091500 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:08.091482 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 12 19:27:08.091623 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:08.091486 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-qnzfx\"" Jul 12 19:27:08.099321 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:08.099294 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9zsvq"] Jul 12 19:27:08.169835 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:08.169762 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-654967888b-rnlk6" Jul 12 19:27:08.233486 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:08.233436 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe75f8a7-055b-42b3-9120-95152115a284-cert\") pod \"odh-model-controller-7998c67dc4-9zsvq\" (UID: \"fe75f8a7-055b-42b3-9120-95152115a284\") " pod="opendatahub/odh-model-controller-7998c67dc4-9zsvq" Jul 12 19:27:08.233643 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:08.233570 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8m22h\" (UniqueName: \"kubernetes.io/projected/fe75f8a7-055b-42b3-9120-95152115a284-kube-api-access-8m22h\") pod \"odh-model-controller-7998c67dc4-9zsvq\" (UID: \"fe75f8a7-055b-42b3-9120-95152115a284\") " pod="opendatahub/odh-model-controller-7998c67dc4-9zsvq" Jul 12 19:27:08.300554 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:08.300521 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-654967888b-rnlk6"] Jul 12 19:27:08.303121 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:27:08.303097 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42d6a7be_2253_4d88_8992_8fe83e2ea727.slice/crio-c222187bc40fa7d88307dfe9fc45f9e4c17f202431b33f69a46f79f247fb0d39 WatchSource:0}: Error finding container c222187bc40fa7d88307dfe9fc45f9e4c17f202431b33f69a46f79f247fb0d39: Status 404 returned error can't find the container with id c222187bc40fa7d88307dfe9fc45f9e4c17f202431b33f69a46f79f247fb0d39 Jul 12 19:27:08.334467 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:08.334442 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe75f8a7-055b-42b3-9120-95152115a284-cert\") pod \"odh-model-controller-7998c67dc4-9zsvq\" (UID: \"fe75f8a7-055b-42b3-9120-95152115a284\") " pod="opendatahub/odh-model-controller-7998c67dc4-9zsvq" Jul 12 19:27:08.334589 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:08.334490 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8m22h\" (UniqueName: \"kubernetes.io/projected/fe75f8a7-055b-42b3-9120-95152115a284-kube-api-access-8m22h\") pod \"odh-model-controller-7998c67dc4-9zsvq\" (UID: \"fe75f8a7-055b-42b3-9120-95152115a284\") " pod="opendatahub/odh-model-controller-7998c67dc4-9zsvq" Jul 12 19:27:08.334654 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:27:08.334613 2576 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 12 19:27:08.334707 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:27:08.334690 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/fe75f8a7-055b-42b3-9120-95152115a284-cert podName:fe75f8a7-055b-42b3-9120-95152115a284 nodeName:}" failed. No retries permitted until 2026-07-12 19:27:08.834666648 +0000 UTC m=+300.289259602 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/fe75f8a7-055b-42b3-9120-95152115a284-cert") pod "odh-model-controller-7998c67dc4-9zsvq" (UID: "fe75f8a7-055b-42b3-9120-95152115a284") : secret "odh-model-controller-webhook-cert" not found Jul 12 19:27:08.342421 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:08.342402 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8m22h\" (UniqueName: \"kubernetes.io/projected/fe75f8a7-055b-42b3-9120-95152115a284-kube-api-access-8m22h\") pod \"odh-model-controller-7998c67dc4-9zsvq\" (UID: \"fe75f8a7-055b-42b3-9120-95152115a284\") " pod="opendatahub/odh-model-controller-7998c67dc4-9zsvq" Jul 12 19:27:08.425676 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:08.425598 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-654967888b-rnlk6" event={"ID":"42d6a7be-2253-4d88-8992-8fe83e2ea727","Type":"ContainerStarted","Data":"c222187bc40fa7d88307dfe9fc45f9e4c17f202431b33f69a46f79f247fb0d39"} Jul 12 19:27:08.840135 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:08.840022 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe75f8a7-055b-42b3-9120-95152115a284-cert\") pod \"odh-model-controller-7998c67dc4-9zsvq\" (UID: \"fe75f8a7-055b-42b3-9120-95152115a284\") " pod="opendatahub/odh-model-controller-7998c67dc4-9zsvq" Jul 12 19:27:08.842386 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:08.842362 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fe75f8a7-055b-42b3-9120-95152115a284-cert\") pod \"odh-model-controller-7998c67dc4-9zsvq\" (UID: \"fe75f8a7-055b-42b3-9120-95152115a284\") " pod="opendatahub/odh-model-controller-7998c67dc4-9zsvq" Jul 12 19:27:08.988946 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:08.988882 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl"] Jul 12 19:27:08.994284 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:08.994260 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl" Jul 12 19:27:08.996460 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:08.996438 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 12 19:27:08.997072 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:08.997047 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 12 19:27:08.997204 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:08.997185 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 12 19:27:08.997378 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:08.997288 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 12 19:27:08.997500 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:08.997326 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-zjc87\"" Jul 12 19:27:09.001821 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:09.001798 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mj4zs_888aafef-f377-46e3-a36b-58cbabc198f8/ovn-acl-logging/0.log" Jul 12 19:27:09.001952 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:09.001933 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-qnzfx\"" Jul 12 19:27:09.010229 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:09.010213 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-9zsvq" Jul 12 19:27:09.010335 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:09.010313 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mj4zs_888aafef-f377-46e3-a36b-58cbabc198f8/ovn-acl-logging/0.log" Jul 12 19:27:09.010656 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:09.010628 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl"] Jul 12 19:27:09.012555 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:09.012540 2576 kubelet.go:1648] "Image garbage collection succeeded" Jul 12 19:27:09.142450 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:09.142407 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e3af4fb3-0b0e-4c6c-a059-60091f415344-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-cdrgl\" (UID: \"e3af4fb3-0b0e-4c6c-a059-60091f415344\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl" Jul 12 19:27:09.142697 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:09.142512 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e3af4fb3-0b0e-4c6c-a059-60091f415344-cacerts\") pod \"istiod-openshift-gateway-7574459656-cdrgl\" (UID: \"e3af4fb3-0b0e-4c6c-a059-60091f415344\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl" Jul 12 19:27:09.142697 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:09.142543 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwg2r\" (UniqueName: \"kubernetes.io/projected/e3af4fb3-0b0e-4c6c-a059-60091f415344-kube-api-access-rwg2r\") pod \"istiod-openshift-gateway-7574459656-cdrgl\" (UID: \"e3af4fb3-0b0e-4c6c-a059-60091f415344\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl" Jul 12 19:27:09.142697 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:09.142583 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3af4fb3-0b0e-4c6c-a059-60091f415344-istio-token\") pod \"istiod-openshift-gateway-7574459656-cdrgl\" (UID: \"e3af4fb3-0b0e-4c6c-a059-60091f415344\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl" Jul 12 19:27:09.142697 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:09.142655 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3af4fb3-0b0e-4c6c-a059-60091f415344-local-certs\") pod \"istiod-openshift-gateway-7574459656-cdrgl\" (UID: \"e3af4fb3-0b0e-4c6c-a059-60091f415344\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl" Jul 12 19:27:09.142928 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:09.142698 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e3af4fb3-0b0e-4c6c-a059-60091f415344-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-cdrgl\" (UID: \"e3af4fb3-0b0e-4c6c-a059-60091f415344\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl" Jul 12 19:27:09.142928 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:09.142746 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e3af4fb3-0b0e-4c6c-a059-60091f415344-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-cdrgl\" (UID: \"e3af4fb3-0b0e-4c6c-a059-60091f415344\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl" Jul 12 19:27:09.158221 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:09.158100 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-9zsvq"] Jul 12 19:27:09.160796 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:27:09.160766 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe75f8a7_055b_42b3_9120_95152115a284.slice/crio-2f97128c1483e2f43e1a1f6489d25517fcaebeaa58165a7d4249249680e93c73 WatchSource:0}: Error finding container 2f97128c1483e2f43e1a1f6489d25517fcaebeaa58165a7d4249249680e93c73: Status 404 returned error can't find the container with id 2f97128c1483e2f43e1a1f6489d25517fcaebeaa58165a7d4249249680e93c73 Jul 12 19:27:09.243835 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:09.243793 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e3af4fb3-0b0e-4c6c-a059-60091f415344-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-cdrgl\" (UID: \"e3af4fb3-0b0e-4c6c-a059-60091f415344\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl" Jul 12 19:27:09.244022 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:09.243854 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e3af4fb3-0b0e-4c6c-a059-60091f415344-cacerts\") pod \"istiod-openshift-gateway-7574459656-cdrgl\" (UID: \"e3af4fb3-0b0e-4c6c-a059-60091f415344\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl" Jul 12 19:27:09.244022 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:09.243876 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwg2r\" (UniqueName: \"kubernetes.io/projected/e3af4fb3-0b0e-4c6c-a059-60091f415344-kube-api-access-rwg2r\") pod \"istiod-openshift-gateway-7574459656-cdrgl\" (UID: \"e3af4fb3-0b0e-4c6c-a059-60091f415344\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl" Jul 12 19:27:09.244022 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:09.243898 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3af4fb3-0b0e-4c6c-a059-60091f415344-istio-token\") pod \"istiod-openshift-gateway-7574459656-cdrgl\" (UID: \"e3af4fb3-0b0e-4c6c-a059-60091f415344\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl" Jul 12 19:27:09.244022 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:09.243937 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3af4fb3-0b0e-4c6c-a059-60091f415344-local-certs\") pod \"istiod-openshift-gateway-7574459656-cdrgl\" (UID: \"e3af4fb3-0b0e-4c6c-a059-60091f415344\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl" Jul 12 19:27:09.244228 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:09.244061 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e3af4fb3-0b0e-4c6c-a059-60091f415344-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-cdrgl\" (UID: \"e3af4fb3-0b0e-4c6c-a059-60091f415344\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl" Jul 12 19:27:09.244228 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:09.244109 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e3af4fb3-0b0e-4c6c-a059-60091f415344-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-cdrgl\" (UID: \"e3af4fb3-0b0e-4c6c-a059-60091f415344\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl" Jul 12 19:27:09.244687 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:09.244645 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e3af4fb3-0b0e-4c6c-a059-60091f415344-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-cdrgl\" (UID: \"e3af4fb3-0b0e-4c6c-a059-60091f415344\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl" Jul 12 19:27:09.246369 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:09.246340 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e3af4fb3-0b0e-4c6c-a059-60091f415344-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-cdrgl\" (UID: \"e3af4fb3-0b0e-4c6c-a059-60091f415344\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl" Jul 12 19:27:09.246468 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:09.246385 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e3af4fb3-0b0e-4c6c-a059-60091f415344-cacerts\") pod \"istiod-openshift-gateway-7574459656-cdrgl\" (UID: \"e3af4fb3-0b0e-4c6c-a059-60091f415344\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl" Jul 12 19:27:09.246619 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:09.246602 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3af4fb3-0b0e-4c6c-a059-60091f415344-local-certs\") pod \"istiod-openshift-gateway-7574459656-cdrgl\" (UID: \"e3af4fb3-0b0e-4c6c-a059-60091f415344\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl" Jul 12 19:27:09.246803 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:09.246783 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e3af4fb3-0b0e-4c6c-a059-60091f415344-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-cdrgl\" (UID: \"e3af4fb3-0b0e-4c6c-a059-60091f415344\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl" Jul 12 19:27:09.257759 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:09.257733 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwg2r\" (UniqueName: \"kubernetes.io/projected/e3af4fb3-0b0e-4c6c-a059-60091f415344-kube-api-access-rwg2r\") pod \"istiod-openshift-gateway-7574459656-cdrgl\" (UID: \"e3af4fb3-0b0e-4c6c-a059-60091f415344\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl" Jul 12 19:27:09.260857 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:09.260841 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3af4fb3-0b0e-4c6c-a059-60091f415344-istio-token\") pod \"istiod-openshift-gateway-7574459656-cdrgl\" (UID: \"e3af4fb3-0b0e-4c6c-a059-60091f415344\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl" Jul 12 19:27:09.307056 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:09.307015 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl" Jul 12 19:27:09.433563 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:09.433527 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9zsvq" event={"ID":"fe75f8a7-055b-42b3-9120-95152115a284","Type":"ContainerStarted","Data":"2f97128c1483e2f43e1a1f6489d25517fcaebeaa58165a7d4249249680e93c73"} Jul 12 19:27:09.460606 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:09.460583 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl"] Jul 12 19:27:09.462773 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:27:09.462744 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3af4fb3_0b0e_4c6c_a059_60091f415344.slice/crio-aa3f426df9f9de59efdca143d4cc242fb05b01683d245311b3d0077acbb85def WatchSource:0}: Error finding container aa3f426df9f9de59efdca143d4cc242fb05b01683d245311b3d0077acbb85def: Status 404 returned error can't find the container with id aa3f426df9f9de59efdca143d4cc242fb05b01683d245311b3d0077acbb85def Jul 12 19:27:10.441829 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:10.441790 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl" event={"ID":"e3af4fb3-0b0e-4c6c-a059-60091f415344","Type":"ContainerStarted","Data":"aa3f426df9f9de59efdca143d4cc242fb05b01683d245311b3d0077acbb85def"} Jul 12 19:27:13.168434 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:13.168405 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 12 19:27:13.230841 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:13.230781 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 12 19:27:13.230945 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:13.230904 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 12 19:27:13.464276 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:13.464237 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-654967888b-rnlk6" event={"ID":"42d6a7be-2253-4d88-8992-8fe83e2ea727","Type":"ContainerStarted","Data":"ab81825572caaafb878def73a238ca4b846daafeab2b62d31612c2d441429be9"} Jul 12 19:27:13.465929 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:13.465902 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-9zsvq" event={"ID":"fe75f8a7-055b-42b3-9120-95152115a284","Type":"ContainerStarted","Data":"09e5716ca19d503b302dd6784457052e7b15165149d3fe65fa7ee1df1a3f2fb9"} Jul 12 19:27:13.466080 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:13.466038 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-9zsvq" Jul 12 19:27:13.467473 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:13.467447 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl" event={"ID":"e3af4fb3-0b0e-4c6c-a059-60091f415344","Type":"ContainerStarted","Data":"2d69c9def9b2825d3d8d10ece43d5a4231b287d54b1900ecb76ba0eb2839df5a"} Jul 12 19:27:13.467593 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:13.467580 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl" Jul 12 19:27:13.481467 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:13.481429 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-654967888b-rnlk6" podStartSLOduration=1.6201251920000002 podStartE2EDuration="6.481416113s" totalImagesPullingTime="4.861290921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:27:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:27:13.479851212 +0000 UTC m=+304.934444180" watchObservedRunningTime="2026-07-12 19:27:13.481416113 +0000 UTC m=+304.936009076" Jul 12 19:27:13.496024 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:13.495957 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-9zsvq" podStartSLOduration=1.480437996 podStartE2EDuration="5.495941106s" totalImagesPullingTime="4.01550311s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:27:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:27:13.495426674 +0000 UTC m=+304.950019639" watchObservedRunningTime="2026-07-12 19:27:13.495941106 +0000 UTC m=+304.950534071" Jul 12 19:27:13.513020 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:13.512952 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl" podStartSLOduration=1.747136435 podStartE2EDuration="5.512936963s" totalImagesPullingTime="3.765800528s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:27:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:27:13.511917315 +0000 UTC m=+304.966510279" watchObservedRunningTime="2026-07-12 19:27:13.512936963 +0000 UTC m=+304.967529925" Jul 12 19:27:14.474637 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:14.474603 2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-cdrgl container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 12 19:27:14.475012 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:14.474654 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl" podUID="e3af4fb3-0b0e-4c6c-a059-60091f415344" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 12 19:27:17.474665 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:17.474637 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl" Jul 12 19:27:20.333434 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:20.333398 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl"] Jul 12 19:27:20.333809 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:20.333576 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl" podUID="e3af4fb3-0b0e-4c6c-a059-60091f415344" containerName="discovery" containerID="cri-o://2d69c9def9b2825d3d8d10ece43d5a4231b287d54b1900ecb76ba0eb2839df5a" gracePeriod=30 Jul 12 19:27:20.473634 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:20.473596 2576 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-cdrgl container/discovery namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.25:8080/ready\": dial tcp 10.133.0.25:8080: connect: connection refused" start-of-body= Jul 12 19:27:20.473772 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:20.473677 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl" podUID="e3af4fb3-0b0e-4c6c-a059-60091f415344" containerName="discovery" probeResult="failure" output="Get \"http://10.133.0.25:8080/ready\": dial tcp 10.133.0.25:8080: connect: connection refused" Jul 12 19:27:20.504930 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:20.504904 2576 generic.go:356] "Generic (PLEG): container finished" podID="e3af4fb3-0b0e-4c6c-a059-60091f415344" containerID="2d69c9def9b2825d3d8d10ece43d5a4231b287d54b1900ecb76ba0eb2839df5a" exitCode=0 Jul 12 19:27:20.505088 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:20.504976 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl" event={"ID":"e3af4fb3-0b0e-4c6c-a059-60091f415344","Type":"ContainerDied","Data":"2d69c9def9b2825d3d8d10ece43d5a4231b287d54b1900ecb76ba0eb2839df5a"} Jul 12 19:27:20.580752 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:20.580728 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl" Jul 12 19:27:20.746741 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:20.746714 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3af4fb3-0b0e-4c6c-a059-60091f415344-local-certs\") pod \"e3af4fb3-0b0e-4c6c-a059-60091f415344\" (UID: \"e3af4fb3-0b0e-4c6c-a059-60091f415344\") " Jul 12 19:27:20.746900 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:20.746746 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e3af4fb3-0b0e-4c6c-a059-60091f415344-istio-kubeconfig\") pod \"e3af4fb3-0b0e-4c6c-a059-60091f415344\" (UID: \"e3af4fb3-0b0e-4c6c-a059-60091f415344\") " Jul 12 19:27:20.746900 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:20.746791 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e3af4fb3-0b0e-4c6c-a059-60091f415344-istio-csr-ca-configmap\") pod \"e3af4fb3-0b0e-4c6c-a059-60091f415344\" (UID: \"e3af4fb3-0b0e-4c6c-a059-60091f415344\") " Jul 12 19:27:20.746900 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:20.746824 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwg2r\" (UniqueName: \"kubernetes.io/projected/e3af4fb3-0b0e-4c6c-a059-60091f415344-kube-api-access-rwg2r\") pod \"e3af4fb3-0b0e-4c6c-a059-60091f415344\" (UID: \"e3af4fb3-0b0e-4c6c-a059-60091f415344\") " Jul 12 19:27:20.746900 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:20.746860 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e3af4fb3-0b0e-4c6c-a059-60091f415344-istio-csr-dns-cert\") pod \"e3af4fb3-0b0e-4c6c-a059-60091f415344\" (UID: \"e3af4fb3-0b0e-4c6c-a059-60091f415344\") " Jul 12 19:27:20.746900 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:20.746878 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e3af4fb3-0b0e-4c6c-a059-60091f415344-cacerts\") pod \"e3af4fb3-0b0e-4c6c-a059-60091f415344\" (UID: \"e3af4fb3-0b0e-4c6c-a059-60091f415344\") " Jul 12 19:27:20.746900 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:20.746895 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3af4fb3-0b0e-4c6c-a059-60091f415344-istio-token\") pod \"e3af4fb3-0b0e-4c6c-a059-60091f415344\" (UID: \"e3af4fb3-0b0e-4c6c-a059-60091f415344\") " Jul 12 19:27:20.747289 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:20.747259 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e3af4fb3-0b0e-4c6c-a059-60091f415344-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "e3af4fb3-0b0e-4c6c-a059-60091f415344" (UID: "e3af4fb3-0b0e-4c6c-a059-60091f415344"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 19:27:20.749339 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:20.749294 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3af4fb3-0b0e-4c6c-a059-60091f415344-istio-token" (OuterVolumeSpecName: "istio-token") pod "e3af4fb3-0b0e-4c6c-a059-60091f415344" (UID: "e3af4fb3-0b0e-4c6c-a059-60091f415344"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:27:20.749446 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:20.749328 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3af4fb3-0b0e-4c6c-a059-60091f415344-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "e3af4fb3-0b0e-4c6c-a059-60091f415344" (UID: "e3af4fb3-0b0e-4c6c-a059-60091f415344"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 19:27:20.749501 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:20.749448 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3af4fb3-0b0e-4c6c-a059-60091f415344-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "e3af4fb3-0b0e-4c6c-a059-60091f415344" (UID: "e3af4fb3-0b0e-4c6c-a059-60091f415344"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 19:27:20.749501 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:20.749476 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e3af4fb3-0b0e-4c6c-a059-60091f415344-cacerts" (OuterVolumeSpecName: "cacerts") pod "e3af4fb3-0b0e-4c6c-a059-60091f415344" (UID: "e3af4fb3-0b0e-4c6c-a059-60091f415344"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 19:27:20.749574 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:20.749542 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e3af4fb3-0b0e-4c6c-a059-60091f415344-local-certs" (OuterVolumeSpecName: "local-certs") pod "e3af4fb3-0b0e-4c6c-a059-60091f415344" (UID: "e3af4fb3-0b0e-4c6c-a059-60091f415344"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:27:20.749608 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:20.749578 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e3af4fb3-0b0e-4c6c-a059-60091f415344-kube-api-access-rwg2r" (OuterVolumeSpecName: "kube-api-access-rwg2r") pod "e3af4fb3-0b0e-4c6c-a059-60091f415344" (UID: "e3af4fb3-0b0e-4c6c-a059-60091f415344"). InnerVolumeSpecName "kube-api-access-rwg2r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:27:20.847718 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:20.847688 2576 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/e3af4fb3-0b0e-4c6c-a059-60091f415344-local-certs\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:27:20.847718 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:20.847716 2576 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/e3af4fb3-0b0e-4c6c-a059-60091f415344-istio-kubeconfig\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:27:20.847921 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:20.847730 2576 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/e3af4fb3-0b0e-4c6c-a059-60091f415344-istio-csr-ca-configmap\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:27:20.847921 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:20.847742 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwg2r\" (UniqueName: \"kubernetes.io/projected/e3af4fb3-0b0e-4c6c-a059-60091f415344-kube-api-access-rwg2r\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:27:20.847921 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:20.847754 2576 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/e3af4fb3-0b0e-4c6c-a059-60091f415344-istio-csr-dns-cert\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:27:20.847921 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:20.847765 2576 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/e3af4fb3-0b0e-4c6c-a059-60091f415344-cacerts\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:27:20.847921 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:20.847778 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e3af4fb3-0b0e-4c6c-a059-60091f415344-istio-token\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:27:21.512718 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:21.512692 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl" Jul 12 19:27:21.513171 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:21.512740 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl" event={"ID":"e3af4fb3-0b0e-4c6c-a059-60091f415344","Type":"ContainerDied","Data":"aa3f426df9f9de59efdca143d4cc242fb05b01683d245311b3d0077acbb85def"} Jul 12 19:27:21.513171 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:21.512796 2576 scope.go:117] "RemoveContainer" containerID="2d69c9def9b2825d3d8d10ece43d5a4231b287d54b1900ecb76ba0eb2839df5a" Jul 12 19:27:21.528961 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:21.528938 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl"] Jul 12 19:27:21.532860 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:21.532839 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-cdrgl"] Jul 12 19:27:23.087332 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:23.087289 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e3af4fb3-0b0e-4c6c-a059-60091f415344" path="/var/lib/kubelet/pods/e3af4fb3-0b0e-4c6c-a059-60091f415344/volumes" Jul 12 19:27:24.475680 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:27:24.475648 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-9zsvq" Jul 12 19:28:06.525908 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:06.525834 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z2zxl"] Jul 12 19:28:06.526346 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:06.526260 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e3af4fb3-0b0e-4c6c-a059-60091f415344" containerName="discovery" Jul 12 19:28:06.526346 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:06.526276 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e3af4fb3-0b0e-4c6c-a059-60091f415344" containerName="discovery" Jul 12 19:28:06.526346 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:06.526344 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e3af4fb3-0b0e-4c6c-a059-60091f415344" containerName="discovery" Jul 12 19:28:06.529233 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:06.529210 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-z2zxl" Jul 12 19:28:06.531668 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:06.531641 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-2nbpd\"" Jul 12 19:28:06.531668 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:06.531658 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 12 19:28:06.531844 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:06.531711 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 12 19:28:06.540112 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:06.540091 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z2zxl"] Jul 12 19:28:06.616799 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:06.616773 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-msfwf\" (UniqueName: \"kubernetes.io/projected/526dcb47-4660-48fe-8f92-5e3f14b1e4a8-kube-api-access-msfwf\") pod \"kuadrant-operator-catalog-z2zxl\" (UID: \"526dcb47-4660-48fe-8f92-5e3f14b1e4a8\") " pod="kuadrant-system/kuadrant-operator-catalog-z2zxl" Jul 12 19:28:06.717663 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:06.717636 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-msfwf\" (UniqueName: \"kubernetes.io/projected/526dcb47-4660-48fe-8f92-5e3f14b1e4a8-kube-api-access-msfwf\") pod \"kuadrant-operator-catalog-z2zxl\" (UID: \"526dcb47-4660-48fe-8f92-5e3f14b1e4a8\") " pod="kuadrant-system/kuadrant-operator-catalog-z2zxl" Jul 12 19:28:06.728837 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:06.728811 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-msfwf\" (UniqueName: \"kubernetes.io/projected/526dcb47-4660-48fe-8f92-5e3f14b1e4a8-kube-api-access-msfwf\") pod \"kuadrant-operator-catalog-z2zxl\" (UID: \"526dcb47-4660-48fe-8f92-5e3f14b1e4a8\") " pod="kuadrant-system/kuadrant-operator-catalog-z2zxl" Jul 12 19:28:06.840026 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:06.839936 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-z2zxl" Jul 12 19:28:06.890676 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:06.890519 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z2zxl"] Jul 12 19:28:06.980269 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:06.980218 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z2zxl"] Jul 12 19:28:06.982514 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:28:06.982486 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod526dcb47_4660_48fe_8f92_5e3f14b1e4a8.slice/crio-d22b87805ed19344f54d5d55989962d2dc51a073883e0a257c0f0a4944140d30 WatchSource:0}: Error finding container d22b87805ed19344f54d5d55989962d2dc51a073883e0a257c0f0a4944140d30: Status 404 returned error can't find the container with id d22b87805ed19344f54d5d55989962d2dc51a073883e0a257c0f0a4944140d30 Jul 12 19:28:06.983883 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:06.983865 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 12 19:28:07.093608 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:07.093535 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ptnpz"] Jul 12 19:28:07.097970 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:07.097951 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ptnpz" Jul 12 19:28:07.103811 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:07.103788 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ptnpz"] Jul 12 19:28:07.224792 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:07.224761 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crmbg\" (UniqueName: \"kubernetes.io/projected/c39de0eb-143b-40d0-bdcc-f82958842e6e-kube-api-access-crmbg\") pod \"kuadrant-operator-catalog-ptnpz\" (UID: \"c39de0eb-143b-40d0-bdcc-f82958842e6e\") " pod="kuadrant-system/kuadrant-operator-catalog-ptnpz" Jul 12 19:28:07.325914 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:07.325879 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crmbg\" (UniqueName: \"kubernetes.io/projected/c39de0eb-143b-40d0-bdcc-f82958842e6e-kube-api-access-crmbg\") pod \"kuadrant-operator-catalog-ptnpz\" (UID: \"c39de0eb-143b-40d0-bdcc-f82958842e6e\") " pod="kuadrant-system/kuadrant-operator-catalog-ptnpz" Jul 12 19:28:07.333247 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:07.333223 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crmbg\" (UniqueName: \"kubernetes.io/projected/c39de0eb-143b-40d0-bdcc-f82958842e6e-kube-api-access-crmbg\") pod \"kuadrant-operator-catalog-ptnpz\" (UID: \"c39de0eb-143b-40d0-bdcc-f82958842e6e\") " pod="kuadrant-system/kuadrant-operator-catalog-ptnpz" Jul 12 19:28:07.407870 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:07.407789 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-ptnpz" Jul 12 19:28:07.546084 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:07.545981 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-ptnpz"] Jul 12 19:28:07.575228 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:28:07.575190 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc39de0eb_143b_40d0_bdcc_f82958842e6e.slice/crio-d4b58324190010a2daee1106d2594224bcb2656c3b3f61ba074db58fd4a65b11 WatchSource:0}: Error finding container d4b58324190010a2daee1106d2594224bcb2656c3b3f61ba074db58fd4a65b11: Status 404 returned error can't find the container with id d4b58324190010a2daee1106d2594224bcb2656c3b3f61ba074db58fd4a65b11 Jul 12 19:28:07.734865 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:07.734817 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-z2zxl" event={"ID":"526dcb47-4660-48fe-8f92-5e3f14b1e4a8","Type":"ContainerStarted","Data":"d22b87805ed19344f54d5d55989962d2dc51a073883e0a257c0f0a4944140d30"} Jul 12 19:28:07.736359 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:07.736327 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ptnpz" event={"ID":"c39de0eb-143b-40d0-bdcc-f82958842e6e","Type":"ContainerStarted","Data":"d4b58324190010a2daee1106d2594224bcb2656c3b3f61ba074db58fd4a65b11"} Jul 12 19:28:09.748848 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:09.748799 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-z2zxl" event={"ID":"526dcb47-4660-48fe-8f92-5e3f14b1e4a8","Type":"ContainerStarted","Data":"d7cb91c6fdd1d23a682d7ddb89c2ad879639f0fe527ef764b469bff53a031fac"} Jul 12 19:28:09.749319 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:09.748829 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-z2zxl" podUID="526dcb47-4660-48fe-8f92-5e3f14b1e4a8" containerName="registry-server" containerID="cri-o://d7cb91c6fdd1d23a682d7ddb89c2ad879639f0fe527ef764b469bff53a031fac" gracePeriod=2 Jul 12 19:28:09.750417 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:09.750388 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-ptnpz" event={"ID":"c39de0eb-143b-40d0-bdcc-f82958842e6e","Type":"ContainerStarted","Data":"82fffe6fa5f72f2ef8f71d128013b0523cbb2cbaaedcdea3afeb5cb7438106a0"} Jul 12 19:28:09.762770 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:09.762722 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-z2zxl" podStartSLOduration=1.6396892589999998 podStartE2EDuration="3.762705009s" totalImagesPullingTime="2.12301575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:28:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:28:09.761604361 +0000 UTC m=+361.216197326" watchObservedRunningTime="2026-07-12 19:28:09.762705009 +0000 UTC m=+361.217297971" Jul 12 19:28:09.775670 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:09.775627 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-ptnpz" podStartSLOduration=1.224237556 podStartE2EDuration="2.775614299s" totalImagesPullingTime="1.551376743s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:28:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:28:09.774849157 +0000 UTC m=+361.229442120" watchObservedRunningTime="2026-07-12 19:28:09.775614299 +0000 UTC m=+361.230207261" Jul 12 19:28:09.990873 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:09.990849 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-z2zxl" Jul 12 19:28:10.150815 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:10.150726 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-msfwf\" (UniqueName: \"kubernetes.io/projected/526dcb47-4660-48fe-8f92-5e3f14b1e4a8-kube-api-access-msfwf\") pod \"526dcb47-4660-48fe-8f92-5e3f14b1e4a8\" (UID: \"526dcb47-4660-48fe-8f92-5e3f14b1e4a8\") " Jul 12 19:28:10.152873 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:10.152851 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/526dcb47-4660-48fe-8f92-5e3f14b1e4a8-kube-api-access-msfwf" (OuterVolumeSpecName: "kube-api-access-msfwf") pod "526dcb47-4660-48fe-8f92-5e3f14b1e4a8" (UID: "526dcb47-4660-48fe-8f92-5e3f14b1e4a8"). InnerVolumeSpecName "kube-api-access-msfwf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:28:10.251782 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:10.251748 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-msfwf\" (UniqueName: \"kubernetes.io/projected/526dcb47-4660-48fe-8f92-5e3f14b1e4a8-kube-api-access-msfwf\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:28:10.756177 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:10.756141 2576 generic.go:356] "Generic (PLEG): container finished" podID="526dcb47-4660-48fe-8f92-5e3f14b1e4a8" containerID="d7cb91c6fdd1d23a682d7ddb89c2ad879639f0fe527ef764b469bff53a031fac" exitCode=0 Jul 12 19:28:10.756591 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:10.756187 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-z2zxl" Jul 12 19:28:10.756591 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:10.756228 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-z2zxl" event={"ID":"526dcb47-4660-48fe-8f92-5e3f14b1e4a8","Type":"ContainerDied","Data":"d7cb91c6fdd1d23a682d7ddb89c2ad879639f0fe527ef764b469bff53a031fac"} Jul 12 19:28:10.756591 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:10.756281 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-z2zxl" event={"ID":"526dcb47-4660-48fe-8f92-5e3f14b1e4a8","Type":"ContainerDied","Data":"d22b87805ed19344f54d5d55989962d2dc51a073883e0a257c0f0a4944140d30"} Jul 12 19:28:10.756591 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:10.756306 2576 scope.go:117] "RemoveContainer" containerID="d7cb91c6fdd1d23a682d7ddb89c2ad879639f0fe527ef764b469bff53a031fac" Jul 12 19:28:10.765874 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:10.765853 2576 scope.go:117] "RemoveContainer" containerID="d7cb91c6fdd1d23a682d7ddb89c2ad879639f0fe527ef764b469bff53a031fac" Jul 12 19:28:10.766188 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:28:10.766167 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7cb91c6fdd1d23a682d7ddb89c2ad879639f0fe527ef764b469bff53a031fac\": container with ID starting with d7cb91c6fdd1d23a682d7ddb89c2ad879639f0fe527ef764b469bff53a031fac not found: ID does not exist" containerID="d7cb91c6fdd1d23a682d7ddb89c2ad879639f0fe527ef764b469bff53a031fac" Jul 12 19:28:10.766246 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:10.766196 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7cb91c6fdd1d23a682d7ddb89c2ad879639f0fe527ef764b469bff53a031fac"} err="failed to get container status \"d7cb91c6fdd1d23a682d7ddb89c2ad879639f0fe527ef764b469bff53a031fac\": rpc error: code = NotFound desc = could not find container \"d7cb91c6fdd1d23a682d7ddb89c2ad879639f0fe527ef764b469bff53a031fac\": container with ID starting with d7cb91c6fdd1d23a682d7ddb89c2ad879639f0fe527ef764b469bff53a031fac not found: ID does not exist" Jul 12 19:28:10.776430 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:10.776402 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z2zxl"] Jul 12 19:28:10.780632 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:10.780267 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z2zxl"] Jul 12 19:28:11.083244 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:11.083169 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="526dcb47-4660-48fe-8f92-5e3f14b1e4a8" path="/var/lib/kubelet/pods/526dcb47-4660-48fe-8f92-5e3f14b1e4a8/volumes" Jul 12 19:28:17.408922 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:17.408882 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-ptnpz" Jul 12 19:28:17.409445 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:17.408958 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-ptnpz" Jul 12 19:28:17.432360 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:17.432330 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-ptnpz" Jul 12 19:28:17.811834 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:17.811806 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-ptnpz" Jul 12 19:28:22.122891 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:22.122857 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sx5hm"] Jul 12 19:28:22.123274 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:22.123218 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="526dcb47-4660-48fe-8f92-5e3f14b1e4a8" containerName="registry-server" Jul 12 19:28:22.123274 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:22.123231 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="526dcb47-4660-48fe-8f92-5e3f14b1e4a8" containerName="registry-server" Jul 12 19:28:22.123348 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:22.123312 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="526dcb47-4660-48fe-8f92-5e3f14b1e4a8" containerName="registry-server" Jul 12 19:28:22.127880 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:22.127863 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sx5hm" Jul 12 19:28:22.131156 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:22.131131 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-sfq5m\"" Jul 12 19:28:22.132912 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:22.132892 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sx5hm"] Jul 12 19:28:22.255974 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:22.255934 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lsdzj\" (UniqueName: \"kubernetes.io/projected/1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d-kube-api-access-lsdzj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sx5hm\" (UID: \"1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sx5hm" Jul 12 19:28:22.255974 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:22.255972 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sx5hm\" (UID: \"1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sx5hm" Jul 12 19:28:22.256189 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:22.256063 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sx5hm\" (UID: \"1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sx5hm" Jul 12 19:28:22.357226 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:22.357195 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lsdzj\" (UniqueName: \"kubernetes.io/projected/1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d-kube-api-access-lsdzj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sx5hm\" (UID: \"1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sx5hm" Jul 12 19:28:22.357226 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:22.357229 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sx5hm\" (UID: \"1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sx5hm" Jul 12 19:28:22.357398 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:22.357255 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sx5hm\" (UID: \"1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sx5hm" Jul 12 19:28:22.357571 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:22.357553 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sx5hm\" (UID: \"1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sx5hm" Jul 12 19:28:22.357611 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:22.357597 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sx5hm\" (UID: \"1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sx5hm" Jul 12 19:28:22.365612 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:22.365588 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lsdzj\" (UniqueName: \"kubernetes.io/projected/1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d-kube-api-access-lsdzj\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sx5hm\" (UID: \"1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sx5hm" Jul 12 19:28:22.437597 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:22.437575 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sx5hm" Jul 12 19:28:22.564367 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:22.564345 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sx5hm"] Jul 12 19:28:22.566077 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:28:22.566051 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d9768e7_42ed_4d7c_9704_1d9f71b3fe6d.slice/crio-3be1f41a3a789905616740a2259f56182065a5dc89c6bcebef8f791e31f48400 WatchSource:0}: Error finding container 3be1f41a3a789905616740a2259f56182065a5dc89c6bcebef8f791e31f48400: Status 404 returned error can't find the container with id 3be1f41a3a789905616740a2259f56182065a5dc89c6bcebef8f791e31f48400 Jul 12 19:28:22.724482 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:22.724414 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g7trn"] Jul 12 19:28:22.727697 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:22.727681 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g7trn" Jul 12 19:28:22.734932 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:22.734904 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g7trn"] Jul 12 19:28:22.815749 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:22.815714 2576 generic.go:356] "Generic (PLEG): container finished" podID="1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d" containerID="5e892afd18f120324b8339cde7ef9c2d1a5ec466b8aa1f55aa1193855566cc4c" exitCode=0 Jul 12 19:28:22.815907 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:22.815780 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sx5hm" event={"ID":"1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d","Type":"ContainerDied","Data":"5e892afd18f120324b8339cde7ef9c2d1a5ec466b8aa1f55aa1193855566cc4c"} Jul 12 19:28:22.815907 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:22.815838 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sx5hm" event={"ID":"1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d","Type":"ContainerStarted","Data":"3be1f41a3a789905616740a2259f56182065a5dc89c6bcebef8f791e31f48400"} Jul 12 19:28:22.861666 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:22.861630 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bf4a0806-1dc6-4850-924b-3ccecd65b997-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g7trn\" (UID: \"bf4a0806-1dc6-4850-924b-3ccecd65b997\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g7trn" Jul 12 19:28:22.861666 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:22.861667 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bf4a0806-1dc6-4850-924b-3ccecd65b997-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g7trn\" (UID: \"bf4a0806-1dc6-4850-924b-3ccecd65b997\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g7trn" Jul 12 19:28:22.861860 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:22.861692 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-56wpv\" (UniqueName: \"kubernetes.io/projected/bf4a0806-1dc6-4850-924b-3ccecd65b997-kube-api-access-56wpv\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g7trn\" (UID: \"bf4a0806-1dc6-4850-924b-3ccecd65b997\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g7trn" Jul 12 19:28:22.962424 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:22.962374 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bf4a0806-1dc6-4850-924b-3ccecd65b997-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g7trn\" (UID: \"bf4a0806-1dc6-4850-924b-3ccecd65b997\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g7trn" Jul 12 19:28:22.962424 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:22.962430 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bf4a0806-1dc6-4850-924b-3ccecd65b997-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g7trn\" (UID: \"bf4a0806-1dc6-4850-924b-3ccecd65b997\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g7trn" Jul 12 19:28:22.962669 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:22.962458 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-56wpv\" (UniqueName: \"kubernetes.io/projected/bf4a0806-1dc6-4850-924b-3ccecd65b997-kube-api-access-56wpv\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g7trn\" (UID: \"bf4a0806-1dc6-4850-924b-3ccecd65b997\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g7trn" Jul 12 19:28:22.962846 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:22.962822 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bf4a0806-1dc6-4850-924b-3ccecd65b997-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g7trn\" (UID: \"bf4a0806-1dc6-4850-924b-3ccecd65b997\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g7trn" Jul 12 19:28:22.962846 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:22.962837 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bf4a0806-1dc6-4850-924b-3ccecd65b997-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g7trn\" (UID: \"bf4a0806-1dc6-4850-924b-3ccecd65b997\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g7trn" Jul 12 19:28:22.973786 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:22.973759 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-56wpv\" (UniqueName: \"kubernetes.io/projected/bf4a0806-1dc6-4850-924b-3ccecd65b997-kube-api-access-56wpv\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g7trn\" (UID: \"bf4a0806-1dc6-4850-924b-3ccecd65b997\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g7trn" Jul 12 19:28:23.037132 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:23.037042 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g7trn" Jul 12 19:28:23.163444 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:23.163419 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g7trn"] Jul 12 19:28:23.165279 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:28:23.165249 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf4a0806_1dc6_4850_924b_3ccecd65b997.slice/crio-006f73cfa4112e2604847f3db56edd408f5cc9ef97ab01463d6697f5702c4034 WatchSource:0}: Error finding container 006f73cfa4112e2604847f3db56edd408f5cc9ef97ab01463d6697f5702c4034: Status 404 returned error can't find the container with id 006f73cfa4112e2604847f3db56edd408f5cc9ef97ab01463d6697f5702c4034 Jul 12 19:28:23.323119 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:23.323048 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tdrhh"] Jul 12 19:28:23.326346 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:23.326329 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tdrhh" Jul 12 19:28:23.333646 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:23.333620 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tdrhh"] Jul 12 19:28:23.467273 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:23.467238 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkmmr\" (UniqueName: \"kubernetes.io/projected/7ee204fe-56da-4083-b92e-6cee48404ad8-kube-api-access-tkmmr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tdrhh\" (UID: \"7ee204fe-56da-4083-b92e-6cee48404ad8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tdrhh" Jul 12 19:28:23.467459 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:23.467292 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ee204fe-56da-4083-b92e-6cee48404ad8-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tdrhh\" (UID: \"7ee204fe-56da-4083-b92e-6cee48404ad8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tdrhh" Jul 12 19:28:23.467459 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:23.467327 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ee204fe-56da-4083-b92e-6cee48404ad8-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tdrhh\" (UID: \"7ee204fe-56da-4083-b92e-6cee48404ad8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tdrhh" Jul 12 19:28:23.567714 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:23.567690 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ee204fe-56da-4083-b92e-6cee48404ad8-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tdrhh\" (UID: \"7ee204fe-56da-4083-b92e-6cee48404ad8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tdrhh" Jul 12 19:28:23.567825 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:23.567727 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ee204fe-56da-4083-b92e-6cee48404ad8-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tdrhh\" (UID: \"7ee204fe-56da-4083-b92e-6cee48404ad8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tdrhh" Jul 12 19:28:23.567825 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:23.567789 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkmmr\" (UniqueName: \"kubernetes.io/projected/7ee204fe-56da-4083-b92e-6cee48404ad8-kube-api-access-tkmmr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tdrhh\" (UID: \"7ee204fe-56da-4083-b92e-6cee48404ad8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tdrhh" Jul 12 19:28:23.568067 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:23.568048 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ee204fe-56da-4083-b92e-6cee48404ad8-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tdrhh\" (UID: \"7ee204fe-56da-4083-b92e-6cee48404ad8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tdrhh" Jul 12 19:28:23.568067 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:23.568060 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ee204fe-56da-4083-b92e-6cee48404ad8-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tdrhh\" (UID: \"7ee204fe-56da-4083-b92e-6cee48404ad8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tdrhh" Jul 12 19:28:23.574939 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:23.574884 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkmmr\" (UniqueName: \"kubernetes.io/projected/7ee204fe-56da-4083-b92e-6cee48404ad8-kube-api-access-tkmmr\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tdrhh\" (UID: \"7ee204fe-56da-4083-b92e-6cee48404ad8\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tdrhh" Jul 12 19:28:23.636307 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:23.636277 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tdrhh" Jul 12 19:28:23.724063 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:23.724029 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sn52n"] Jul 12 19:28:23.728290 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:23.728268 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sn52n" Jul 12 19:28:23.735055 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:23.735029 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sn52n"] Jul 12 19:28:23.771929 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:23.771907 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tdrhh"] Jul 12 19:28:23.774269 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:28:23.774240 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ee204fe_56da_4083_b92e_6cee48404ad8.slice/crio-b641db0b44a8d80c1d4c7935d6a98c388a6c7e7f462a495ebf5078e6bd23bd68 WatchSource:0}: Error finding container b641db0b44a8d80c1d4c7935d6a98c388a6c7e7f462a495ebf5078e6bd23bd68: Status 404 returned error can't find the container with id b641db0b44a8d80c1d4c7935d6a98c388a6c7e7f462a495ebf5078e6bd23bd68 Jul 12 19:28:23.823535 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:23.823508 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tdrhh" event={"ID":"7ee204fe-56da-4083-b92e-6cee48404ad8","Type":"ContainerStarted","Data":"b641db0b44a8d80c1d4c7935d6a98c388a6c7e7f462a495ebf5078e6bd23bd68"} Jul 12 19:28:23.825131 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:23.825076 2576 generic.go:356] "Generic (PLEG): container finished" podID="bf4a0806-1dc6-4850-924b-3ccecd65b997" containerID="0097052156c51766d694332d6cba5c76a87cf3b16eb60f07355da1f0f419ddc4" exitCode=0 Jul 12 19:28:23.825229 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:23.825155 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g7trn" event={"ID":"bf4a0806-1dc6-4850-924b-3ccecd65b997","Type":"ContainerDied","Data":"0097052156c51766d694332d6cba5c76a87cf3b16eb60f07355da1f0f419ddc4"} Jul 12 19:28:23.825229 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:23.825208 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g7trn" event={"ID":"bf4a0806-1dc6-4850-924b-3ccecd65b997","Type":"ContainerStarted","Data":"006f73cfa4112e2604847f3db56edd408f5cc9ef97ab01463d6697f5702c4034"} Jul 12 19:28:23.827031 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:23.826976 2576 generic.go:356] "Generic (PLEG): container finished" podID="1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d" containerID="bf4d2b62453629ff70d85df00678e95a5df67991352024411f7784d27268520d" exitCode=0 Jul 12 19:28:23.827031 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:23.827020 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sx5hm" event={"ID":"1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d","Type":"ContainerDied","Data":"bf4d2b62453629ff70d85df00678e95a5df67991352024411f7784d27268520d"} Jul 12 19:28:23.870601 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:23.870571 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t5gh\" (UniqueName: \"kubernetes.io/projected/14bade62-668c-4df2-a2d4-2ac60f1e6094-kube-api-access-5t5gh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sn52n\" (UID: \"14bade62-668c-4df2-a2d4-2ac60f1e6094\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sn52n" Jul 12 19:28:23.870686 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:23.870660 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14bade62-668c-4df2-a2d4-2ac60f1e6094-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sn52n\" (UID: \"14bade62-668c-4df2-a2d4-2ac60f1e6094\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sn52n" Jul 12 19:28:23.870738 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:23.870698 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14bade62-668c-4df2-a2d4-2ac60f1e6094-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sn52n\" (UID: \"14bade62-668c-4df2-a2d4-2ac60f1e6094\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sn52n" Jul 12 19:28:23.971335 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:23.971299 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t5gh\" (UniqueName: \"kubernetes.io/projected/14bade62-668c-4df2-a2d4-2ac60f1e6094-kube-api-access-5t5gh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sn52n\" (UID: \"14bade62-668c-4df2-a2d4-2ac60f1e6094\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sn52n" Jul 12 19:28:23.971489 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:23.971375 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14bade62-668c-4df2-a2d4-2ac60f1e6094-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sn52n\" (UID: \"14bade62-668c-4df2-a2d4-2ac60f1e6094\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sn52n" Jul 12 19:28:23.971489 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:23.971407 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14bade62-668c-4df2-a2d4-2ac60f1e6094-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sn52n\" (UID: \"14bade62-668c-4df2-a2d4-2ac60f1e6094\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sn52n" Jul 12 19:28:23.971752 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:23.971729 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14bade62-668c-4df2-a2d4-2ac60f1e6094-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sn52n\" (UID: \"14bade62-668c-4df2-a2d4-2ac60f1e6094\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sn52n" Jul 12 19:28:23.971817 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:23.971798 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14bade62-668c-4df2-a2d4-2ac60f1e6094-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sn52n\" (UID: \"14bade62-668c-4df2-a2d4-2ac60f1e6094\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sn52n" Jul 12 19:28:23.980779 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:23.980758 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t5gh\" (UniqueName: \"kubernetes.io/projected/14bade62-668c-4df2-a2d4-2ac60f1e6094-kube-api-access-5t5gh\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sn52n\" (UID: \"14bade62-668c-4df2-a2d4-2ac60f1e6094\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sn52n" Jul 12 19:28:24.041329 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:24.041294 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sn52n" Jul 12 19:28:24.183631 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:24.183597 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sn52n"] Jul 12 19:28:24.186456 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:28:24.186431 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14bade62_668c_4df2_a2d4_2ac60f1e6094.slice/crio-ffa1ae2838188fbfe3640c72d8c1813b97905d946d338c8f0d3c7c9ff229c375 WatchSource:0}: Error finding container ffa1ae2838188fbfe3640c72d8c1813b97905d946d338c8f0d3c7c9ff229c375: Status 404 returned error can't find the container with id ffa1ae2838188fbfe3640c72d8c1813b97905d946d338c8f0d3c7c9ff229c375 Jul 12 19:28:24.833135 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:24.833100 2576 generic.go:356] "Generic (PLEG): container finished" podID="14bade62-668c-4df2-a2d4-2ac60f1e6094" containerID="95f9743df559c1b01a61cf624d3f12f3c5889cc392db2470af83167aac401034" exitCode=0 Jul 12 19:28:24.833285 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:24.833188 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sn52n" event={"ID":"14bade62-668c-4df2-a2d4-2ac60f1e6094","Type":"ContainerDied","Data":"95f9743df559c1b01a61cf624d3f12f3c5889cc392db2470af83167aac401034"} Jul 12 19:28:24.833285 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:24.833239 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sn52n" event={"ID":"14bade62-668c-4df2-a2d4-2ac60f1e6094","Type":"ContainerStarted","Data":"ffa1ae2838188fbfe3640c72d8c1813b97905d946d338c8f0d3c7c9ff229c375"} Jul 12 19:28:24.835373 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:24.835348 2576 generic.go:356] "Generic (PLEG): container finished" podID="1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d" containerID="83d65f76c02a5edaddc19dc7c831c560e5e29370d143d59dedf28ba9afe2eb61" exitCode=0 Jul 12 19:28:24.835519 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:24.835428 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sx5hm" event={"ID":"1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d","Type":"ContainerDied","Data":"83d65f76c02a5edaddc19dc7c831c560e5e29370d143d59dedf28ba9afe2eb61"} Jul 12 19:28:24.836920 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:24.836895 2576 generic.go:356] "Generic (PLEG): container finished" podID="7ee204fe-56da-4083-b92e-6cee48404ad8" containerID="8151db33a4f76517ea34dabde909ebcf06728952c2e29a5610db62a905fc4d73" exitCode=0 Jul 12 19:28:24.837013 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:24.836975 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tdrhh" event={"ID":"7ee204fe-56da-4083-b92e-6cee48404ad8","Type":"ContainerDied","Data":"8151db33a4f76517ea34dabde909ebcf06728952c2e29a5610db62a905fc4d73"} Jul 12 19:28:24.838854 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:24.838833 2576 generic.go:356] "Generic (PLEG): container finished" podID="bf4a0806-1dc6-4850-924b-3ccecd65b997" containerID="84d14e7f9504128a1d59073676fb8469c83ed3445682e11023f46257c59a5775" exitCode=0 Jul 12 19:28:24.838932 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:24.838880 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g7trn" event={"ID":"bf4a0806-1dc6-4850-924b-3ccecd65b997","Type":"ContainerDied","Data":"84d14e7f9504128a1d59073676fb8469c83ed3445682e11023f46257c59a5775"} Jul 12 19:28:25.845556 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:25.845522 2576 generic.go:356] "Generic (PLEG): container finished" podID="7ee204fe-56da-4083-b92e-6cee48404ad8" containerID="d876a9b47f4d5db0dcf7aea771c21c051da5c07b2d1e8504a54e2e586585051e" exitCode=0 Jul 12 19:28:25.845911 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:25.845606 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tdrhh" event={"ID":"7ee204fe-56da-4083-b92e-6cee48404ad8","Type":"ContainerDied","Data":"d876a9b47f4d5db0dcf7aea771c21c051da5c07b2d1e8504a54e2e586585051e"} Jul 12 19:28:25.847815 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:25.847792 2576 generic.go:356] "Generic (PLEG): container finished" podID="bf4a0806-1dc6-4850-924b-3ccecd65b997" containerID="6b304dda5f5969416a9f1767479a853b66b2bf7acce89bb08f81f6d6a4781a6d" exitCode=0 Jul 12 19:28:25.847896 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:25.847875 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g7trn" event={"ID":"bf4a0806-1dc6-4850-924b-3ccecd65b997","Type":"ContainerDied","Data":"6b304dda5f5969416a9f1767479a853b66b2bf7acce89bb08f81f6d6a4781a6d"} Jul 12 19:28:25.849631 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:25.849611 2576 generic.go:356] "Generic (PLEG): container finished" podID="14bade62-668c-4df2-a2d4-2ac60f1e6094" containerID="600e7cf8f66a31cd413f0cecd7c5680b0bf4edc459ebd5d1bdf7584771032b11" exitCode=0 Jul 12 19:28:25.849722 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:25.849690 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sn52n" event={"ID":"14bade62-668c-4df2-a2d4-2ac60f1e6094","Type":"ContainerDied","Data":"600e7cf8f66a31cd413f0cecd7c5680b0bf4edc459ebd5d1bdf7584771032b11"} Jul 12 19:28:25.983055 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:25.983030 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sx5hm" Jul 12 19:28:25.989127 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:25.989102 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d-util\") pod \"1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d\" (UID: \"1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d\") " Jul 12 19:28:25.989276 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:25.989164 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lsdzj\" (UniqueName: \"kubernetes.io/projected/1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d-kube-api-access-lsdzj\") pod \"1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d\" (UID: \"1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d\") " Jul 12 19:28:25.989276 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:25.989241 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d-bundle\") pod \"1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d\" (UID: \"1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d\") " Jul 12 19:28:25.989813 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:25.989788 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d-bundle" (OuterVolumeSpecName: "bundle") pod "1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d" (UID: "1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:28:25.991862 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:25.991839 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d-kube-api-access-lsdzj" (OuterVolumeSpecName: "kube-api-access-lsdzj") pod "1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d" (UID: "1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d"). InnerVolumeSpecName "kube-api-access-lsdzj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:28:25.996110 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:25.996077 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d-util" (OuterVolumeSpecName: "util") pod "1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d" (UID: "1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:28:26.089785 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:26.089749 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d-bundle\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:28:26.089785 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:26.089777 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d-util\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:28:26.089785 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:26.089786 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lsdzj\" (UniqueName: \"kubernetes.io/projected/1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d-kube-api-access-lsdzj\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:28:26.856397 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:26.856370 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sx5hm" Jul 12 19:28:26.856397 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:26.856380 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sx5hm" event={"ID":"1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d","Type":"ContainerDied","Data":"3be1f41a3a789905616740a2259f56182065a5dc89c6bcebef8f791e31f48400"} Jul 12 19:28:26.856831 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:26.856429 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3be1f41a3a789905616740a2259f56182065a5dc89c6bcebef8f791e31f48400" Jul 12 19:28:26.858499 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:26.858475 2576 generic.go:356] "Generic (PLEG): container finished" podID="7ee204fe-56da-4083-b92e-6cee48404ad8" containerID="9747d9ecf3bb6a799267b61df430634c431fed8639d9d9f9a50ba8412d09d42f" exitCode=0 Jul 12 19:28:26.858641 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:26.858572 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tdrhh" event={"ID":"7ee204fe-56da-4083-b92e-6cee48404ad8","Type":"ContainerDied","Data":"9747d9ecf3bb6a799267b61df430634c431fed8639d9d9f9a50ba8412d09d42f"} Jul 12 19:28:26.860669 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:26.860643 2576 generic.go:356] "Generic (PLEG): container finished" podID="14bade62-668c-4df2-a2d4-2ac60f1e6094" containerID="c30e1980087da3b6e0521d87a717ba01ed7673823f41561997643a649c89f135" exitCode=0 Jul 12 19:28:26.860784 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:26.860728 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sn52n" event={"ID":"14bade62-668c-4df2-a2d4-2ac60f1e6094","Type":"ContainerDied","Data":"c30e1980087da3b6e0521d87a717ba01ed7673823f41561997643a649c89f135"} Jul 12 19:28:26.989171 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:26.989150 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g7trn" Jul 12 19:28:26.998756 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:26.998733 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bf4a0806-1dc6-4850-924b-3ccecd65b997-bundle\") pod \"bf4a0806-1dc6-4850-924b-3ccecd65b997\" (UID: \"bf4a0806-1dc6-4850-924b-3ccecd65b997\") " Jul 12 19:28:26.998858 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:26.998812 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-56wpv\" (UniqueName: \"kubernetes.io/projected/bf4a0806-1dc6-4850-924b-3ccecd65b997-kube-api-access-56wpv\") pod \"bf4a0806-1dc6-4850-924b-3ccecd65b997\" (UID: \"bf4a0806-1dc6-4850-924b-3ccecd65b997\") " Jul 12 19:28:26.998924 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:26.998876 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bf4a0806-1dc6-4850-924b-3ccecd65b997-util\") pod \"bf4a0806-1dc6-4850-924b-3ccecd65b997\" (UID: \"bf4a0806-1dc6-4850-924b-3ccecd65b997\") " Jul 12 19:28:26.999347 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:26.999321 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf4a0806-1dc6-4850-924b-3ccecd65b997-bundle" (OuterVolumeSpecName: "bundle") pod "bf4a0806-1dc6-4850-924b-3ccecd65b997" (UID: "bf4a0806-1dc6-4850-924b-3ccecd65b997"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:28:27.000804 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:27.000780 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bf4a0806-1dc6-4850-924b-3ccecd65b997-kube-api-access-56wpv" (OuterVolumeSpecName: "kube-api-access-56wpv") pod "bf4a0806-1dc6-4850-924b-3ccecd65b997" (UID: "bf4a0806-1dc6-4850-924b-3ccecd65b997"). InnerVolumeSpecName "kube-api-access-56wpv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:28:27.004309 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:27.004288 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bf4a0806-1dc6-4850-924b-3ccecd65b997-util" (OuterVolumeSpecName: "util") pod "bf4a0806-1dc6-4850-924b-3ccecd65b997" (UID: "bf4a0806-1dc6-4850-924b-3ccecd65b997"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:28:27.100024 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:27.099975 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/bf4a0806-1dc6-4850-924b-3ccecd65b997-bundle\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:28:27.100135 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:27.100031 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-56wpv\" (UniqueName: \"kubernetes.io/projected/bf4a0806-1dc6-4850-924b-3ccecd65b997-kube-api-access-56wpv\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:28:27.100135 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:27.100049 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/bf4a0806-1dc6-4850-924b-3ccecd65b997-util\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:28:27.873760 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:27.873725 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g7trn" event={"ID":"bf4a0806-1dc6-4850-924b-3ccecd65b997","Type":"ContainerDied","Data":"006f73cfa4112e2604847f3db56edd408f5cc9ef97ab01463d6697f5702c4034"} Jul 12 19:28:27.874231 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:27.873811 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="006f73cfa4112e2604847f3db56edd408f5cc9ef97ab01463d6697f5702c4034" Jul 12 19:28:27.874231 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:27.873736 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g7trn" Jul 12 19:28:28.029845 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:28.029817 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sn52n" Jul 12 19:28:28.031782 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:28.031766 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tdrhh" Jul 12 19:28:28.109808 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:28.109776 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ee204fe-56da-4083-b92e-6cee48404ad8-util\") pod \"7ee204fe-56da-4083-b92e-6cee48404ad8\" (UID: \"7ee204fe-56da-4083-b92e-6cee48404ad8\") " Jul 12 19:28:28.109808 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:28.109808 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14bade62-668c-4df2-a2d4-2ac60f1e6094-bundle\") pod \"14bade62-668c-4df2-a2d4-2ac60f1e6094\" (UID: \"14bade62-668c-4df2-a2d4-2ac60f1e6094\") " Jul 12 19:28:28.110014 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:28.109842 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14bade62-668c-4df2-a2d4-2ac60f1e6094-util\") pod \"14bade62-668c-4df2-a2d4-2ac60f1e6094\" (UID: \"14bade62-668c-4df2-a2d4-2ac60f1e6094\") " Jul 12 19:28:28.110014 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:28.109874 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tkmmr\" (UniqueName: \"kubernetes.io/projected/7ee204fe-56da-4083-b92e-6cee48404ad8-kube-api-access-tkmmr\") pod \"7ee204fe-56da-4083-b92e-6cee48404ad8\" (UID: \"7ee204fe-56da-4083-b92e-6cee48404ad8\") " Jul 12 19:28:28.110014 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:28.109924 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5t5gh\" (UniqueName: \"kubernetes.io/projected/14bade62-668c-4df2-a2d4-2ac60f1e6094-kube-api-access-5t5gh\") pod \"14bade62-668c-4df2-a2d4-2ac60f1e6094\" (UID: \"14bade62-668c-4df2-a2d4-2ac60f1e6094\") " Jul 12 19:28:28.110014 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:28.109954 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ee204fe-56da-4083-b92e-6cee48404ad8-bundle\") pod \"7ee204fe-56da-4083-b92e-6cee48404ad8\" (UID: \"7ee204fe-56da-4083-b92e-6cee48404ad8\") " Jul 12 19:28:28.110577 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:28.110502 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14bade62-668c-4df2-a2d4-2ac60f1e6094-bundle" (OuterVolumeSpecName: "bundle") pod "14bade62-668c-4df2-a2d4-2ac60f1e6094" (UID: "14bade62-668c-4df2-a2d4-2ac60f1e6094"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:28:28.110577 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:28.110535 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ee204fe-56da-4083-b92e-6cee48404ad8-bundle" (OuterVolumeSpecName: "bundle") pod "7ee204fe-56da-4083-b92e-6cee48404ad8" (UID: "7ee204fe-56da-4083-b92e-6cee48404ad8"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:28:28.112025 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:28.111978 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7ee204fe-56da-4083-b92e-6cee48404ad8-kube-api-access-tkmmr" (OuterVolumeSpecName: "kube-api-access-tkmmr") pod "7ee204fe-56da-4083-b92e-6cee48404ad8" (UID: "7ee204fe-56da-4083-b92e-6cee48404ad8"). InnerVolumeSpecName "kube-api-access-tkmmr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:28:28.112131 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:28.112018 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/14bade62-668c-4df2-a2d4-2ac60f1e6094-kube-api-access-5t5gh" (OuterVolumeSpecName: "kube-api-access-5t5gh") pod "14bade62-668c-4df2-a2d4-2ac60f1e6094" (UID: "14bade62-668c-4df2-a2d4-2ac60f1e6094"). InnerVolumeSpecName "kube-api-access-5t5gh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:28:28.115240 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:28.115209 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/14bade62-668c-4df2-a2d4-2ac60f1e6094-util" (OuterVolumeSpecName: "util") pod "14bade62-668c-4df2-a2d4-2ac60f1e6094" (UID: "14bade62-668c-4df2-a2d4-2ac60f1e6094"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:28:28.118379 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:28.118356 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7ee204fe-56da-4083-b92e-6cee48404ad8-util" (OuterVolumeSpecName: "util") pod "7ee204fe-56da-4083-b92e-6cee48404ad8" (UID: "7ee204fe-56da-4083-b92e-6cee48404ad8"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:28:28.210503 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:28.210472 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5t5gh\" (UniqueName: \"kubernetes.io/projected/14bade62-668c-4df2-a2d4-2ac60f1e6094-kube-api-access-5t5gh\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:28:28.210503 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:28.210499 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/7ee204fe-56da-4083-b92e-6cee48404ad8-bundle\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:28:28.210674 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:28.210510 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/7ee204fe-56da-4083-b92e-6cee48404ad8-util\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:28:28.210674 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:28.210518 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/14bade62-668c-4df2-a2d4-2ac60f1e6094-bundle\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:28:28.210674 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:28.210525 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/14bade62-668c-4df2-a2d4-2ac60f1e6094-util\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:28:28.210674 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:28.210533 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tkmmr\" (UniqueName: \"kubernetes.io/projected/7ee204fe-56da-4083-b92e-6cee48404ad8-kube-api-access-tkmmr\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:28:28.881385 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:28.881349 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sn52n" Jul 12 19:28:28.881385 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:28.881366 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sn52n" event={"ID":"14bade62-668c-4df2-a2d4-2ac60f1e6094","Type":"ContainerDied","Data":"ffa1ae2838188fbfe3640c72d8c1813b97905d946d338c8f0d3c7c9ff229c375"} Jul 12 19:28:28.881836 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:28.881414 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ffa1ae2838188fbfe3640c72d8c1813b97905d946d338c8f0d3c7c9ff229c375" Jul 12 19:28:28.883340 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:28.883313 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tdrhh" event={"ID":"7ee204fe-56da-4083-b92e-6cee48404ad8","Type":"ContainerDied","Data":"b641db0b44a8d80c1d4c7935d6a98c388a6c7e7f462a495ebf5078e6bd23bd68"} Jul 12 19:28:28.883431 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:28.883348 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tdrhh" Jul 12 19:28:28.883431 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:28.883360 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b641db0b44a8d80c1d4c7935d6a98c388a6c7e7f462a495ebf5078e6bd23bd68" Jul 12 19:28:38.297533 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:38.297500 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jnb6"] Jul 12 19:28:38.297902 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:38.297867 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ee204fe-56da-4083-b92e-6cee48404ad8" containerName="extract" Jul 12 19:28:38.297902 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:38.297879 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ee204fe-56da-4083-b92e-6cee48404ad8" containerName="extract" Jul 12 19:28:38.297902 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:38.297895 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14bade62-668c-4df2-a2d4-2ac60f1e6094" containerName="util" Jul 12 19:28:38.297902 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:38.297900 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="14bade62-668c-4df2-a2d4-2ac60f1e6094" containerName="util" Jul 12 19:28:38.298047 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:38.297906 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ee204fe-56da-4083-b92e-6cee48404ad8" containerName="pull" Jul 12 19:28:38.298047 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:38.297912 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ee204fe-56da-4083-b92e-6cee48404ad8" containerName="pull" Jul 12 19:28:38.298047 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:38.297919 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf4a0806-1dc6-4850-924b-3ccecd65b997" containerName="pull" Jul 12 19:28:38.298047 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:38.297924 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf4a0806-1dc6-4850-924b-3ccecd65b997" containerName="pull" Jul 12 19:28:38.298047 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:38.297930 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14bade62-668c-4df2-a2d4-2ac60f1e6094" containerName="pull" Jul 12 19:28:38.298047 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:38.297938 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="14bade62-668c-4df2-a2d4-2ac60f1e6094" containerName="pull" Jul 12 19:28:38.298047 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:38.297949 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d" containerName="util" Jul 12 19:28:38.298047 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:38.297956 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d" containerName="util" Jul 12 19:28:38.298047 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:38.297964 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d" containerName="pull" Jul 12 19:28:38.298047 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:38.297972 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d" containerName="pull" Jul 12 19:28:38.298047 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:38.297977 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf4a0806-1dc6-4850-924b-3ccecd65b997" containerName="extract" Jul 12 19:28:38.298047 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:38.297994 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf4a0806-1dc6-4850-924b-3ccecd65b997" containerName="extract" Jul 12 19:28:38.298047 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:38.298002 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7ee204fe-56da-4083-b92e-6cee48404ad8" containerName="util" Jul 12 19:28:38.298047 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:38.298009 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7ee204fe-56da-4083-b92e-6cee48404ad8" containerName="util" Jul 12 19:28:38.298047 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:38.298016 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d" containerName="extract" Jul 12 19:28:38.298047 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:38.298024 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d" containerName="extract" Jul 12 19:28:38.298047 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:38.298034 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="14bade62-668c-4df2-a2d4-2ac60f1e6094" containerName="extract" Jul 12 19:28:38.298047 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:38.298039 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="14bade62-668c-4df2-a2d4-2ac60f1e6094" containerName="extract" Jul 12 19:28:38.298047 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:38.298053 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bf4a0806-1dc6-4850-924b-3ccecd65b997" containerName="util" Jul 12 19:28:38.298574 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:38.298058 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="bf4a0806-1dc6-4850-924b-3ccecd65b997" containerName="util" Jul 12 19:28:38.298574 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:38.298118 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="bf4a0806-1dc6-4850-924b-3ccecd65b997" containerName="extract" Jul 12 19:28:38.298574 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:38.298126 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d" containerName="extract" Jul 12 19:28:38.298574 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:38.298131 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="14bade62-668c-4df2-a2d4-2ac60f1e6094" containerName="extract" Jul 12 19:28:38.298574 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:38.298137 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7ee204fe-56da-4083-b92e-6cee48404ad8" containerName="extract" Jul 12 19:28:38.304423 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:38.304407 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jnb6" Jul 12 19:28:38.306486 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:38.306465 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-w8qtf\"" Jul 12 19:28:38.310193 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:38.310172 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jnb6"] Jul 12 19:28:38.387485 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:38.387448 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gm2c\" (UniqueName: \"kubernetes.io/projected/23d1cd89-15da-448f-a984-a7feffff329f-kube-api-access-5gm2c\") pod \"limitador-operator-controller-manager-859d7b78bd-7jnb6\" (UID: \"23d1cd89-15da-448f-a984-a7feffff329f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jnb6" Jul 12 19:28:38.488855 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:38.488815 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gm2c\" (UniqueName: \"kubernetes.io/projected/23d1cd89-15da-448f-a984-a7feffff329f-kube-api-access-5gm2c\") pod \"limitador-operator-controller-manager-859d7b78bd-7jnb6\" (UID: \"23d1cd89-15da-448f-a984-a7feffff329f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jnb6" Jul 12 19:28:38.501691 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:38.501665 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gm2c\" (UniqueName: \"kubernetes.io/projected/23d1cd89-15da-448f-a984-a7feffff329f-kube-api-access-5gm2c\") pod \"limitador-operator-controller-manager-859d7b78bd-7jnb6\" (UID: \"23d1cd89-15da-448f-a984-a7feffff329f\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jnb6" Jul 12 19:28:38.615178 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:38.615098 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jnb6" Jul 12 19:28:38.750331 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:38.750308 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jnb6"] Jul 12 19:28:38.752094 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:28:38.752068 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23d1cd89_15da_448f_a984_a7feffff329f.slice/crio-0f86576b0dcec73a915731a0963726caa3bf2b429db7db31095de7a435486a2f WatchSource:0}: Error finding container 0f86576b0dcec73a915731a0963726caa3bf2b429db7db31095de7a435486a2f: Status 404 returned error can't find the container with id 0f86576b0dcec73a915731a0963726caa3bf2b429db7db31095de7a435486a2f Jul 12 19:28:38.937502 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:38.937464 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jnb6" event={"ID":"23d1cd89-15da-448f-a984-a7feffff329f","Type":"ContainerStarted","Data":"0f86576b0dcec73a915731a0963726caa3bf2b429db7db31095de7a435486a2f"} Jul 12 19:28:40.949461 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:40.949418 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jnb6" event={"ID":"23d1cd89-15da-448f-a984-a7feffff329f","Type":"ContainerStarted","Data":"71ea9cdefb493e4652b170ac8c4c4506bd295bbc233d670c273b117d6c24d157"} Jul 12 19:28:40.949818 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:40.949493 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jnb6" Jul 12 19:28:40.967018 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:40.966958 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jnb6" podStartSLOduration=1.311804391 podStartE2EDuration="2.966942901s" totalImagesPullingTime="1.65513851s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:28:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:28:40.965263472 +0000 UTC m=+392.419856445" watchObservedRunningTime="2026-07-12 19:28:40.966942901 +0000 UTC m=+392.421535864" Jul 12 19:28:43.274046 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:43.274012 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4tz"] Jul 12 19:28:43.280098 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:43.280079 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4tz" Jul 12 19:28:43.282214 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:43.282192 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qz7q6\"" Jul 12 19:28:43.294051 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:43.294026 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4tz"] Jul 12 19:28:43.329279 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:43.329249 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3a805721-6b78-467b-b934-e9aba4260dfc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xz4tz\" (UID: \"3a805721-6b78-467b-b934-e9aba4260dfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4tz" Jul 12 19:28:43.329439 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:43.329288 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p6cz\" (UniqueName: \"kubernetes.io/projected/3a805721-6b78-467b-b934-e9aba4260dfc-kube-api-access-8p6cz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xz4tz\" (UID: \"3a805721-6b78-467b-b934-e9aba4260dfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4tz" Jul 12 19:28:43.430281 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:43.430244 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3a805721-6b78-467b-b934-e9aba4260dfc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xz4tz\" (UID: \"3a805721-6b78-467b-b934-e9aba4260dfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4tz" Jul 12 19:28:43.430431 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:43.430290 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p6cz\" (UniqueName: \"kubernetes.io/projected/3a805721-6b78-467b-b934-e9aba4260dfc-kube-api-access-8p6cz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xz4tz\" (UID: \"3a805721-6b78-467b-b934-e9aba4260dfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4tz" Jul 12 19:28:43.430657 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:43.430636 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3a805721-6b78-467b-b934-e9aba4260dfc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xz4tz\" (UID: \"3a805721-6b78-467b-b934-e9aba4260dfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4tz" Jul 12 19:28:43.438761 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:43.438731 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p6cz\" (UniqueName: \"kubernetes.io/projected/3a805721-6b78-467b-b934-e9aba4260dfc-kube-api-access-8p6cz\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xz4tz\" (UID: \"3a805721-6b78-467b-b934-e9aba4260dfc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4tz" Jul 12 19:28:43.590240 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:43.590144 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4tz" Jul 12 19:28:43.736417 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:43.736390 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4tz"] Jul 12 19:28:43.739238 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:28:43.739210 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a805721_6b78_467b_b934_e9aba4260dfc.slice/crio-3691a604529ca154ebcb352d0d0ac4ff091b5dc95098d0ba097dbe73f0af2328 WatchSource:0}: Error finding container 3691a604529ca154ebcb352d0d0ac4ff091b5dc95098d0ba097dbe73f0af2328: Status 404 returned error can't find the container with id 3691a604529ca154ebcb352d0d0ac4ff091b5dc95098d0ba097dbe73f0af2328 Jul 12 19:28:43.965092 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:43.965058 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4tz" event={"ID":"3a805721-6b78-467b-b934-e9aba4260dfc","Type":"ContainerStarted","Data":"3691a604529ca154ebcb352d0d0ac4ff091b5dc95098d0ba097dbe73f0af2328"} Jul 12 19:28:46.321134 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:46.321106 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wbwk8"] Jul 12 19:28:46.324674 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:46.324657 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wbwk8" Jul 12 19:28:46.328750 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:46.328730 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-6l8z7\"" Jul 12 19:28:46.335359 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:46.335338 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wbwk8"] Jul 12 19:28:46.458259 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:46.458222 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tl6wl\" (UniqueName: \"kubernetes.io/projected/e5b98265-fd90-4b00-a8fb-6aad2eda6308-kube-api-access-tl6wl\") pod \"authorino-operator-75cc8d5cb7-wbwk8\" (UID: \"e5b98265-fd90-4b00-a8fb-6aad2eda6308\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wbwk8" Jul 12 19:28:46.559623 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:46.559583 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tl6wl\" (UniqueName: \"kubernetes.io/projected/e5b98265-fd90-4b00-a8fb-6aad2eda6308-kube-api-access-tl6wl\") pod \"authorino-operator-75cc8d5cb7-wbwk8\" (UID: \"e5b98265-fd90-4b00-a8fb-6aad2eda6308\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wbwk8" Jul 12 19:28:46.570577 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:46.570539 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tl6wl\" (UniqueName: \"kubernetes.io/projected/e5b98265-fd90-4b00-a8fb-6aad2eda6308-kube-api-access-tl6wl\") pod \"authorino-operator-75cc8d5cb7-wbwk8\" (UID: \"e5b98265-fd90-4b00-a8fb-6aad2eda6308\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-wbwk8" Jul 12 19:28:46.636294 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:46.636232 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wbwk8" Jul 12 19:28:46.797368 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:46.797338 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-wbwk8"] Jul 12 19:28:46.799153 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:28:46.799117 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode5b98265_fd90_4b00_a8fb_6aad2eda6308.slice/crio-dca48265ebcb33353bcf8b3729c39a5df30671236322c14555763dc6a4bdaa81 WatchSource:0}: Error finding container dca48265ebcb33353bcf8b3729c39a5df30671236322c14555763dc6a4bdaa81: Status 404 returned error can't find the container with id dca48265ebcb33353bcf8b3729c39a5df30671236322c14555763dc6a4bdaa81 Jul 12 19:28:46.985369 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:46.985338 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wbwk8" event={"ID":"e5b98265-fd90-4b00-a8fb-6aad2eda6308","Type":"ContainerStarted","Data":"dca48265ebcb33353bcf8b3729c39a5df30671236322c14555763dc6a4bdaa81"} Jul 12 19:28:49.664402 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:49.664366 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tmxhm"] Jul 12 19:28:49.667724 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:49.667703 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tmxhm" Jul 12 19:28:49.669884 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:49.669863 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-2wtv7\"" Jul 12 19:28:49.670008 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:49.669863 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 12 19:28:49.682981 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:49.682953 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tmxhm"] Jul 12 19:28:49.788394 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:49.788353 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hq5j7\" (UniqueName: \"kubernetes.io/projected/cee282b2-f6e2-4180-95b4-521dcc13ecdf-kube-api-access-hq5j7\") pod \"dns-operator-controller-manager-864dd78c4c-tmxhm\" (UID: \"cee282b2-f6e2-4180-95b4-521dcc13ecdf\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tmxhm" Jul 12 19:28:49.888950 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:49.888912 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hq5j7\" (UniqueName: \"kubernetes.io/projected/cee282b2-f6e2-4180-95b4-521dcc13ecdf-kube-api-access-hq5j7\") pod \"dns-operator-controller-manager-864dd78c4c-tmxhm\" (UID: \"cee282b2-f6e2-4180-95b4-521dcc13ecdf\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tmxhm" Jul 12 19:28:49.899794 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:49.899769 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hq5j7\" (UniqueName: \"kubernetes.io/projected/cee282b2-f6e2-4180-95b4-521dcc13ecdf-kube-api-access-hq5j7\") pod \"dns-operator-controller-manager-864dd78c4c-tmxhm\" (UID: \"cee282b2-f6e2-4180-95b4-521dcc13ecdf\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tmxhm" Jul 12 19:28:49.977834 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:49.977813 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tmxhm" Jul 12 19:28:50.127761 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:50.127738 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-tmxhm"] Jul 12 19:28:50.129936 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:28:50.129898 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcee282b2_f6e2_4180_95b4_521dcc13ecdf.slice/crio-f6c7e1366f43dd27f71b0bccc15c592a7e8c00986e741e901cc0e66683575ad3 WatchSource:0}: Error finding container f6c7e1366f43dd27f71b0bccc15c592a7e8c00986e741e901cc0e66683575ad3: Status 404 returned error can't find the container with id f6c7e1366f43dd27f71b0bccc15c592a7e8c00986e741e901cc0e66683575ad3 Jul 12 19:28:51.009312 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:51.009277 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4tz" event={"ID":"3a805721-6b78-467b-b934-e9aba4260dfc","Type":"ContainerStarted","Data":"a46b781976faafa2c3334c12b7f002f1eccf289249b043b57d6d209cb8b28208"} Jul 12 19:28:51.009714 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:51.009344 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4tz" Jul 12 19:28:51.010953 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:51.010919 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wbwk8" event={"ID":"e5b98265-fd90-4b00-a8fb-6aad2eda6308","Type":"ContainerStarted","Data":"f82126792ff263f184df418eb9c2eab77586100ffeb358ade147f6ecf293e12f"} Jul 12 19:28:51.011095 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:51.011002 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wbwk8" Jul 12 19:28:51.012129 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:51.012103 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tmxhm" event={"ID":"cee282b2-f6e2-4180-95b4-521dcc13ecdf","Type":"ContainerStarted","Data":"f6c7e1366f43dd27f71b0bccc15c592a7e8c00986e741e901cc0e66683575ad3"} Jul 12 19:28:51.032453 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:51.032409 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4tz" podStartSLOduration=1.817245932 podStartE2EDuration="8.032393108s" totalImagesPullingTime="6.215147176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:28:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:28:51.029151189 +0000 UTC m=+402.483744153" watchObservedRunningTime="2026-07-12 19:28:51.032393108 +0000 UTC m=+402.486986070" Jul 12 19:28:51.045430 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:51.045385 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wbwk8" podStartSLOduration=1.8532571839999998 podStartE2EDuration="5.045369065s" totalImagesPullingTime="3.192111881s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:28:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:28:51.043399648 +0000 UTC m=+402.497992613" watchObservedRunningTime="2026-07-12 19:28:51.045369065 +0000 UTC m=+402.499962028" Jul 12 19:28:51.956954 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:51.956925 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jnb6" Jul 12 19:28:52.872500 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:52.872465 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-58nvv"] Jul 12 19:28:52.877408 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:52.877380 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-58nvv" Jul 12 19:28:52.879981 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:52.879947 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-sfq5m\"" Jul 12 19:28:52.880121 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:52.880040 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jul 12 19:28:52.880295 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:52.880277 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jul 12 19:28:52.889037 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:52.889014 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-58nvv"] Jul 12 19:28:53.019230 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:53.019193 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tttlj\" (UniqueName: \"kubernetes.io/projected/84eb4da4-7798-4a28-85e5-16369b69caeb-kube-api-access-tttlj\") pod \"kuadrant-console-plugin-66b5774985-58nvv\" (UID: \"84eb4da4-7798-4a28-85e5-16369b69caeb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-58nvv" Jul 12 19:28:53.019390 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:53.019310 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/84eb4da4-7798-4a28-85e5-16369b69caeb-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-58nvv\" (UID: \"84eb4da4-7798-4a28-85e5-16369b69caeb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-58nvv" Jul 12 19:28:53.019390 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:53.019344 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/84eb4da4-7798-4a28-85e5-16369b69caeb-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-58nvv\" (UID: \"84eb4da4-7798-4a28-85e5-16369b69caeb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-58nvv" Jul 12 19:28:53.025001 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:53.024964 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tmxhm" event={"ID":"cee282b2-f6e2-4180-95b4-521dcc13ecdf","Type":"ContainerStarted","Data":"2f5d8cfd7ca8766b85541081d41279bcfc9a0036a235747bbe71b6001b7a9fa1"} Jul 12 19:28:53.025193 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:53.025175 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tmxhm" Jul 12 19:28:53.042411 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:53.042369 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tmxhm" podStartSLOduration=1.9073396040000001 podStartE2EDuration="4.04235009s" totalImagesPullingTime="2.135010486s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:28:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:28:53.04151771 +0000 UTC m=+404.496110673" watchObservedRunningTime="2026-07-12 19:28:53.04235009 +0000 UTC m=+404.496943057" Jul 12 19:28:53.120260 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:53.120215 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/84eb4da4-7798-4a28-85e5-16369b69caeb-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-58nvv\" (UID: \"84eb4da4-7798-4a28-85e5-16369b69caeb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-58nvv" Jul 12 19:28:53.120260 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:53.120254 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/84eb4da4-7798-4a28-85e5-16369b69caeb-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-58nvv\" (UID: \"84eb4da4-7798-4a28-85e5-16369b69caeb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-58nvv" Jul 12 19:28:53.120463 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:28:53.120358 2576 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jul 12 19:28:53.120463 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:53.120391 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tttlj\" (UniqueName: \"kubernetes.io/projected/84eb4da4-7798-4a28-85e5-16369b69caeb-kube-api-access-tttlj\") pod \"kuadrant-console-plugin-66b5774985-58nvv\" (UID: \"84eb4da4-7798-4a28-85e5-16369b69caeb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-58nvv" Jul 12 19:28:53.120463 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:28:53.120423 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/84eb4da4-7798-4a28-85e5-16369b69caeb-plugin-serving-cert podName:84eb4da4-7798-4a28-85e5-16369b69caeb nodeName:}" failed. No retries permitted until 2026-07-12 19:28:53.620406626 +0000 UTC m=+405.074999567 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/84eb4da4-7798-4a28-85e5-16369b69caeb-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-58nvv" (UID: "84eb4da4-7798-4a28-85e5-16369b69caeb") : secret "plugin-serving-cert" not found Jul 12 19:28:53.120897 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:53.120879 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/84eb4da4-7798-4a28-85e5-16369b69caeb-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-58nvv\" (UID: \"84eb4da4-7798-4a28-85e5-16369b69caeb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-58nvv" Jul 12 19:28:53.130515 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:53.130448 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tttlj\" (UniqueName: \"kubernetes.io/projected/84eb4da4-7798-4a28-85e5-16369b69caeb-kube-api-access-tttlj\") pod \"kuadrant-console-plugin-66b5774985-58nvv\" (UID: \"84eb4da4-7798-4a28-85e5-16369b69caeb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-58nvv" Jul 12 19:28:53.625318 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:53.625285 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/84eb4da4-7798-4a28-85e5-16369b69caeb-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-58nvv\" (UID: \"84eb4da4-7798-4a28-85e5-16369b69caeb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-58nvv" Jul 12 19:28:53.627649 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:53.627628 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/84eb4da4-7798-4a28-85e5-16369b69caeb-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-58nvv\" (UID: \"84eb4da4-7798-4a28-85e5-16369b69caeb\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-58nvv" Jul 12 19:28:53.788064 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:53.788037 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-58nvv" Jul 12 19:28:53.914556 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:53.914515 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-58nvv"] Jul 12 19:28:53.915814 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:28:53.915787 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod84eb4da4_7798_4a28_85e5_16369b69caeb.slice/crio-0edc81526ea0435f97cbd41cc14d6b40b599fc641f0514abf2ceb85221c29a5f WatchSource:0}: Error finding container 0edc81526ea0435f97cbd41cc14d6b40b599fc641f0514abf2ceb85221c29a5f: Status 404 returned error can't find the container with id 0edc81526ea0435f97cbd41cc14d6b40b599fc641f0514abf2ceb85221c29a5f Jul 12 19:28:54.031211 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:28:54.031177 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-58nvv" event={"ID":"84eb4da4-7798-4a28-85e5-16369b69caeb","Type":"ContainerStarted","Data":"0edc81526ea0435f97cbd41cc14d6b40b599fc641f0514abf2ceb85221c29a5f"} Jul 12 19:29:02.020574 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:02.020525 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4tz" Jul 12 19:29:02.021057 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:02.020999 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-wbwk8" Jul 12 19:29:03.660765 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.660729 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d4jp5"] Jul 12 19:29:03.678287 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.678262 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d4jp5" Jul 12 19:29:03.686025 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.685999 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d4jp5"] Jul 12 19:29:03.759261 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.759229 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d4jp5"] Jul 12 19:29:03.759541 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:29:03.759516 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-pqdgf], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d4jp5" podUID="934beef6-3f1f-4186-bf31-ed343437861c" Jul 12 19:29:03.767441 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.767414 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d4jp5"] Jul 12 19:29:03.777956 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.777932 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4tz"] Jul 12 19:29:03.778907 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.778618 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4tz" podUID="3a805721-6b78-467b-b934-e9aba4260dfc" containerName="manager" containerID="cri-o://a46b781976faafa2c3334c12b7f002f1eccf289249b043b57d6d209cb8b28208" gracePeriod=2 Jul 12 19:29:03.784095 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.784066 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ldhc4"] Jul 12 19:29:03.795016 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.790018 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ldhc4" Jul 12 19:29:03.795016 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:29:03.791102 2576 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"3a805721-6b78-467b-b934-e9aba4260dfc\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-xz4tz\": pods \"kuadrant-operator-controller-manager-8684c9ff49-xz4tz\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4tz" Jul 12 19:29:03.795016 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.792476 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4tz"] Jul 12 19:29:03.795016 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:29:03.793111 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xz4tz\" is forbidden: User \"system:node:ip-10-0-137-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-63.ec2.internal' and this object" podUID="3a805721-6b78-467b-b934-e9aba4260dfc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4tz" Jul 12 19:29:03.800681 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.800617 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ldhc4"] Jul 12 19:29:03.804811 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.804789 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jnb6"] Jul 12 19:29:03.805138 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.805093 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jnb6" podUID="23d1cd89-15da-448f-a984-a7feffff329f" containerName="manager" containerID="cri-o://71ea9cdefb493e4652b170ac8c4c4506bd295bbc233d670c273b117d6c24d157" gracePeriod=2 Jul 12 19:29:03.807790 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.807763 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447q9"] Jul 12 19:29:03.808299 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.808280 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a805721-6b78-467b-b934-e9aba4260dfc" containerName="manager" Jul 12 19:29:03.808424 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.808302 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a805721-6b78-467b-b934-e9aba4260dfc" containerName="manager" Jul 12 19:29:03.808424 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.808418 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a805721-6b78-467b-b934-e9aba4260dfc" containerName="manager" Jul 12 19:29:03.812117 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.812099 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447q9" Jul 12 19:29:03.814211 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.814184 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jnb6"] Jul 12 19:29:03.821006 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.820959 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pqdgf\" (UniqueName: \"kubernetes.io/projected/934beef6-3f1f-4186-bf31-ed343437861c-kube-api-access-pqdgf\") pod \"kuadrant-operator-controller-manager-55467d9f7-d4jp5\" (UID: \"934beef6-3f1f-4186-bf31-ed343437861c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d4jp5" Jul 12 19:29:03.821203 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.821181 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/934beef6-3f1f-4186-bf31-ed343437861c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-d4jp5\" (UID: \"934beef6-3f1f-4186-bf31-ed343437861c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d4jp5" Jul 12 19:29:03.825119 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.825093 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447q9"] Jul 12 19:29:03.831579 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.831557 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jmlrw"] Jul 12 19:29:03.831962 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.831948 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="23d1cd89-15da-448f-a984-a7feffff329f" containerName="manager" Jul 12 19:29:03.832063 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.831966 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="23d1cd89-15da-448f-a984-a7feffff329f" containerName="manager" Jul 12 19:29:03.832114 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.832093 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="23d1cd89-15da-448f-a984-a7feffff329f" containerName="manager" Jul 12 19:29:03.835196 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.835182 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jmlrw" Jul 12 19:29:03.848440 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:29:03.848410 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xz4tz\" is forbidden: User \"system:node:ip-10-0-137-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-63.ec2.internal' and this object" podUID="3a805721-6b78-467b-b934-e9aba4260dfc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4tz" Jul 12 19:29:03.850079 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:29:03.850046 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7jnb6\" is forbidden: User \"system:node:ip-10-0-137-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-63.ec2.internal' and this object" podUID="23d1cd89-15da-448f-a984-a7feffff329f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jnb6" Jul 12 19:29:03.852016 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:29:03.851970 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xz4tz\" is forbidden: User \"system:node:ip-10-0-137-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-63.ec2.internal' and this object" podUID="3a805721-6b78-467b-b934-e9aba4260dfc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4tz" Jul 12 19:29:03.852658 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.852635 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jmlrw"] Jul 12 19:29:03.854038 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:29:03.854008 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7jnb6\" is forbidden: User \"system:node:ip-10-0-137-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-63.ec2.internal' and this object" podUID="23d1cd89-15da-448f-a984-a7feffff329f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jnb6" Jul 12 19:29:03.898631 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.898608 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447q9"] Jul 12 19:29:03.899652 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:29:03.899624 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-d7jsl], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447q9" podUID="c3fb2e84-447c-4947-bcd0-22742cf99688" Jul 12 19:29:03.922262 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.922201 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d7jsl\" (UniqueName: \"kubernetes.io/projected/c3fb2e84-447c-4947-bcd0-22742cf99688-kube-api-access-d7jsl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-447q9\" (UID: \"c3fb2e84-447c-4947-bcd0-22742cf99688\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447q9" Jul 12 19:29:03.922262 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.922241 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpqs6\" (UniqueName: \"kubernetes.io/projected/7db091d3-9823-4679-a6ae-dd931c812554-kube-api-access-tpqs6\") pod \"kuadrant-operator-controller-manager-55467d9f7-ldhc4\" (UID: \"7db091d3-9823-4679-a6ae-dd931c812554\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ldhc4" Jul 12 19:29:03.922425 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.922310 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3fb2e84-447c-4947-bcd0-22742cf99688-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-447q9\" (UID: \"c3fb2e84-447c-4947-bcd0-22742cf99688\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447q9" Jul 12 19:29:03.922425 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.922337 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7db091d3-9823-4679-a6ae-dd931c812554-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-ldhc4\" (UID: \"7db091d3-9823-4679-a6ae-dd931c812554\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ldhc4" Jul 12 19:29:03.922425 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.922417 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pqdgf\" (UniqueName: \"kubernetes.io/projected/934beef6-3f1f-4186-bf31-ed343437861c-kube-api-access-pqdgf\") pod \"kuadrant-operator-controller-manager-55467d9f7-d4jp5\" (UID: \"934beef6-3f1f-4186-bf31-ed343437861c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d4jp5" Jul 12 19:29:03.922604 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.922479 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/934beef6-3f1f-4186-bf31-ed343437861c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-d4jp5\" (UID: \"934beef6-3f1f-4186-bf31-ed343437861c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d4jp5" Jul 12 19:29:03.922604 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.922507 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6czpm\" (UniqueName: \"kubernetes.io/projected/dab9a189-e4fe-45a9-a841-7f5052ebc607-kube-api-access-6czpm\") pod \"limitador-operator-controller-manager-859d7b78bd-jmlrw\" (UID: \"dab9a189-e4fe-45a9-a841-7f5052ebc607\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jmlrw" Jul 12 19:29:03.922858 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.922835 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/934beef6-3f1f-4186-bf31-ed343437861c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-d4jp5\" (UID: \"934beef6-3f1f-4186-bf31-ed343437861c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d4jp5" Jul 12 19:29:03.929262 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:29:03.929243 2576 projected.go:196] Error preparing data for projected volume kube-api-access-pqdgf for pod kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d4jp5: failed to fetch token: pod "kuadrant-operator-controller-manager-55467d9f7-d4jp5" not found Jul 12 19:29:03.929363 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:29:03.929314 2576 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/934beef6-3f1f-4186-bf31-ed343437861c-kube-api-access-pqdgf podName:934beef6-3f1f-4186-bf31-ed343437861c nodeName:}" failed. No retries permitted until 2026-07-12 19:29:04.429294486 +0000 UTC m=+415.883887432 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-pqdgf" (UniqueName: "kubernetes.io/projected/934beef6-3f1f-4186-bf31-ed343437861c-kube-api-access-pqdgf") pod "kuadrant-operator-controller-manager-55467d9f7-d4jp5" (UID: "934beef6-3f1f-4186-bf31-ed343437861c") : failed to fetch token: pod "kuadrant-operator-controller-manager-55467d9f7-d4jp5" not found Jul 12 19:29:03.935159 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.935130 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sc7wr"] Jul 12 19:29:03.939252 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.939233 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sc7wr" Jul 12 19:29:03.942171 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:29:03.942139 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7jnb6\" is forbidden: User \"system:node:ip-10-0-137-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-63.ec2.internal' and this object" podUID="23d1cd89-15da-448f-a984-a7feffff329f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jnb6" Jul 12 19:29:03.955675 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:03.955653 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sc7wr"] Jul 12 19:29:03.973669 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:29:03.973642 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xz4tz\" is forbidden: User \"system:node:ip-10-0-137-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-63.ec2.internal' and this object" podUID="3a805721-6b78-467b-b934-e9aba4260dfc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4tz" Jul 12 19:29:04.023932 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:04.023893 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6czpm\" (UniqueName: \"kubernetes.io/projected/dab9a189-e4fe-45a9-a841-7f5052ebc607-kube-api-access-6czpm\") pod \"limitador-operator-controller-manager-859d7b78bd-jmlrw\" (UID: \"dab9a189-e4fe-45a9-a841-7f5052ebc607\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jmlrw" Jul 12 19:29:04.024118 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:04.023940 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d7jsl\" (UniqueName: \"kubernetes.io/projected/c3fb2e84-447c-4947-bcd0-22742cf99688-kube-api-access-d7jsl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-447q9\" (UID: \"c3fb2e84-447c-4947-bcd0-22742cf99688\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447q9" Jul 12 19:29:04.024118 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:04.023975 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpqs6\" (UniqueName: \"kubernetes.io/projected/7db091d3-9823-4679-a6ae-dd931c812554-kube-api-access-tpqs6\") pod \"kuadrant-operator-controller-manager-55467d9f7-ldhc4\" (UID: \"7db091d3-9823-4679-a6ae-dd931c812554\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ldhc4" Jul 12 19:29:04.024118 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:04.024031 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bxp87\" (UniqueName: \"kubernetes.io/projected/eb058928-bf8e-42d4-820a-46438ccb6b09-kube-api-access-bxp87\") pod \"kuadrant-operator-controller-manager-86878c769f-sc7wr\" (UID: \"eb058928-bf8e-42d4-820a-46438ccb6b09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sc7wr" Jul 12 19:29:04.024118 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:04.024069 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3fb2e84-447c-4947-bcd0-22742cf99688-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-447q9\" (UID: \"c3fb2e84-447c-4947-bcd0-22742cf99688\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447q9" Jul 12 19:29:04.024118 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:04.024096 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7db091d3-9823-4679-a6ae-dd931c812554-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-ldhc4\" (UID: \"7db091d3-9823-4679-a6ae-dd931c812554\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ldhc4" Jul 12 19:29:04.024356 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:04.024139 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eb058928-bf8e-42d4-820a-46438ccb6b09-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-sc7wr\" (UID: \"eb058928-bf8e-42d4-820a-46438ccb6b09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sc7wr" Jul 12 19:29:04.024568 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:04.024525 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3fb2e84-447c-4947-bcd0-22742cf99688-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-447q9\" (UID: \"c3fb2e84-447c-4947-bcd0-22742cf99688\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447q9" Jul 12 19:29:04.024780 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:04.024759 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7db091d3-9823-4679-a6ae-dd931c812554-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-ldhc4\" (UID: \"7db091d3-9823-4679-a6ae-dd931c812554\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ldhc4" Jul 12 19:29:04.033886 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:04.033652 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-tmxhm" Jul 12 19:29:04.034233 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:04.034186 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6czpm\" (UniqueName: \"kubernetes.io/projected/dab9a189-e4fe-45a9-a841-7f5052ebc607-kube-api-access-6czpm\") pod \"limitador-operator-controller-manager-859d7b78bd-jmlrw\" (UID: \"dab9a189-e4fe-45a9-a841-7f5052ebc607\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jmlrw" Jul 12 19:29:04.034437 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:04.034414 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d7jsl\" (UniqueName: \"kubernetes.io/projected/c3fb2e84-447c-4947-bcd0-22742cf99688-kube-api-access-d7jsl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-447q9\" (UID: \"c3fb2e84-447c-4947-bcd0-22742cf99688\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447q9" Jul 12 19:29:04.034966 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:04.034944 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpqs6\" (UniqueName: \"kubernetes.io/projected/7db091d3-9823-4679-a6ae-dd931c812554-kube-api-access-tpqs6\") pod \"kuadrant-operator-controller-manager-55467d9f7-ldhc4\" (UID: \"7db091d3-9823-4679-a6ae-dd931c812554\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ldhc4" Jul 12 19:29:04.035766 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:29:04.035738 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xz4tz\" is forbidden: User \"system:node:ip-10-0-137-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-63.ec2.internal' and this object" podUID="3a805721-6b78-467b-b934-e9aba4260dfc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4tz" Jul 12 19:29:04.037497 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:29:04.037473 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7jnb6\" is forbidden: User \"system:node:ip-10-0-137-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-63.ec2.internal' and this object" podUID="23d1cd89-15da-448f-a984-a7feffff329f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jnb6" Jul 12 19:29:04.094691 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:04.094661 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447q9" Jul 12 19:29:04.094870 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:04.094691 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d4jp5" Jul 12 19:29:04.096850 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:29:04.096812 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7jnb6\" is forbidden: User \"system:node:ip-10-0-137-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-63.ec2.internal' and this object" podUID="23d1cd89-15da-448f-a984-a7feffff329f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jnb6" Jul 12 19:29:04.106182 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:04.106070 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447q9" Jul 12 19:29:04.109132 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:04.109103 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d4jp5" Jul 12 19:29:04.117625 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:29:04.117586 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xz4tz\" is forbidden: User \"system:node:ip-10-0-137-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-63.ec2.internal' and this object" podUID="3a805721-6b78-467b-b934-e9aba4260dfc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4tz" Jul 12 19:29:04.122739 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:29:04.122700 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xz4tz\" is forbidden: User \"system:node:ip-10-0-137-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-63.ec2.internal' and this object" podUID="3a805721-6b78-467b-b934-e9aba4260dfc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4tz" Jul 12 19:29:04.124379 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:29:04.124341 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-d4jp5\" is forbidden: User \"system:node:ip-10-0-137-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-63.ec2.internal' and this object" podUID="934beef6-3f1f-4186-bf31-ed343437861c" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d4jp5" Jul 12 19:29:04.125828 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:04.125794 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bxp87\" (UniqueName: \"kubernetes.io/projected/eb058928-bf8e-42d4-820a-46438ccb6b09-kube-api-access-bxp87\") pod \"kuadrant-operator-controller-manager-86878c769f-sc7wr\" (UID: \"eb058928-bf8e-42d4-820a-46438ccb6b09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sc7wr" Jul 12 19:29:04.125925 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:04.125853 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eb058928-bf8e-42d4-820a-46438ccb6b09-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-sc7wr\" (UID: \"eb058928-bf8e-42d4-820a-46438ccb6b09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sc7wr" Jul 12 19:29:04.126304 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:29:04.126185 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7jnb6\" is forbidden: User \"system:node:ip-10-0-137-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-63.ec2.internal' and this object" podUID="23d1cd89-15da-448f-a984-a7feffff329f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jnb6" Jul 12 19:29:04.126304 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:04.126272 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eb058928-bf8e-42d4-820a-46438ccb6b09-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-sc7wr\" (UID: \"eb058928-bf8e-42d4-820a-46438ccb6b09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sc7wr" Jul 12 19:29:04.135350 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:04.135323 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bxp87\" (UniqueName: \"kubernetes.io/projected/eb058928-bf8e-42d4-820a-46438ccb6b09-kube-api-access-bxp87\") pod \"kuadrant-operator-controller-manager-86878c769f-sc7wr\" (UID: \"eb058928-bf8e-42d4-820a-46438ccb6b09\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sc7wr" Jul 12 19:29:04.191313 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:04.191275 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ldhc4" Jul 12 19:29:04.206636 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:04.206612 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jmlrw" Jul 12 19:29:04.226170 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:04.226142 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/934beef6-3f1f-4186-bf31-ed343437861c-extensions-socket-volume\") pod \"934beef6-3f1f-4186-bf31-ed343437861c\" (UID: \"934beef6-3f1f-4186-bf31-ed343437861c\") " Jul 12 19:29:04.226279 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:04.226191 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3fb2e84-447c-4947-bcd0-22742cf99688-extensions-socket-volume\") pod \"c3fb2e84-447c-4947-bcd0-22742cf99688\" (UID: \"c3fb2e84-447c-4947-bcd0-22742cf99688\") " Jul 12 19:29:04.226279 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:04.226262 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d7jsl\" (UniqueName: \"kubernetes.io/projected/c3fb2e84-447c-4947-bcd0-22742cf99688-kube-api-access-d7jsl\") pod \"c3fb2e84-447c-4947-bcd0-22742cf99688\" (UID: \"c3fb2e84-447c-4947-bcd0-22742cf99688\") " Jul 12 19:29:04.226430 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:04.226389 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/934beef6-3f1f-4186-bf31-ed343437861c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "934beef6-3f1f-4186-bf31-ed343437861c" (UID: "934beef6-3f1f-4186-bf31-ed343437861c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:29:04.226546 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:04.226500 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c3fb2e84-447c-4947-bcd0-22742cf99688-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c3fb2e84-447c-4947-bcd0-22742cf99688" (UID: "c3fb2e84-447c-4947-bcd0-22742cf99688"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:29:04.226615 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:04.226568 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/934beef6-3f1f-4186-bf31-ed343437861c-extensions-socket-volume\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:29:04.226615 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:04.226589 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c3fb2e84-447c-4947-bcd0-22742cf99688-extensions-socket-volume\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:29:04.226615 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:04.226603 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pqdgf\" (UniqueName: \"kubernetes.io/projected/934beef6-3f1f-4186-bf31-ed343437861c-kube-api-access-pqdgf\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:29:04.228593 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:04.228568 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c3fb2e84-447c-4947-bcd0-22742cf99688-kube-api-access-d7jsl" (OuterVolumeSpecName: "kube-api-access-d7jsl") pod "c3fb2e84-447c-4947-bcd0-22742cf99688" (UID: "c3fb2e84-447c-4947-bcd0-22742cf99688"). InnerVolumeSpecName "kube-api-access-d7jsl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:29:04.250090 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:04.250065 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sc7wr" Jul 12 19:29:04.327964 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:04.327917 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d7jsl\" (UniqueName: \"kubernetes.io/projected/c3fb2e84-447c-4947-bcd0-22742cf99688-kube-api-access-d7jsl\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:29:05.085979 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:05.085945 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="934beef6-3f1f-4186-bf31-ed343437861c" path="/var/lib/kubelet/pods/934beef6-3f1f-4186-bf31-ed343437861c/volumes" Jul 12 19:29:05.101055 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:05.101031 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d4jp5" Jul 12 19:29:05.101183 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:05.101041 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447q9" Jul 12 19:29:05.107469 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:29:05.107435 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-d4jp5\" is forbidden: User \"system:node:ip-10-0-137-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-63.ec2.internal' and this object" podUID="934beef6-3f1f-4186-bf31-ed343437861c" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-d4jp5" Jul 12 19:29:05.137644 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:05.137614 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447q9"] Jul 12 19:29:05.151558 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:05.151519 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-447q9"] Jul 12 19:29:07.084770 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:07.084731 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c3fb2e84-447c-4947-bcd0-22742cf99688" path="/var/lib/kubelet/pods/c3fb2e84-447c-4947-bcd0-22742cf99688/volumes" Jul 12 19:29:16.192183 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:16.192150 2576 generic.go:356] "Generic (PLEG): container finished" podID="23d1cd89-15da-448f-a984-a7feffff329f" containerID="71ea9cdefb493e4652b170ac8c4c4506bd295bbc233d670c273b117d6c24d157" exitCode=0 Jul 12 19:29:16.192737 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:29:16.192407 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7db091d3_9823_4679_a6ae_dd931c812554.slice/crio-a34271e12a6cdaab184159b64cb7871172aa5f5ccdd0ab157ebc486be044c704 WatchSource:0}: Error finding container a34271e12a6cdaab184159b64cb7871172aa5f5ccdd0ab157ebc486be044c704: Status 404 returned error can't find the container with id a34271e12a6cdaab184159b64cb7871172aa5f5ccdd0ab157ebc486be044c704 Jul 12 19:29:16.192737 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:16.192534 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ldhc4"] Jul 12 19:29:16.195282 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:16.195261 2576 generic.go:356] "Generic (PLEG): container finished" podID="3a805721-6b78-467b-b934-e9aba4260dfc" containerID="a46b781976faafa2c3334c12b7f002f1eccf289249b043b57d6d209cb8b28208" exitCode=0 Jul 12 19:29:16.206059 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:16.206041 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jnb6" Jul 12 19:29:16.208260 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:29:16.208225 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7jnb6\" is forbidden: User \"system:node:ip-10-0-137-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-63.ec2.internal' and this object" podUID="23d1cd89-15da-448f-a984-a7feffff329f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jnb6" Jul 12 19:29:16.239516 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:16.239496 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5gm2c\" (UniqueName: \"kubernetes.io/projected/23d1cd89-15da-448f-a984-a7feffff329f-kube-api-access-5gm2c\") pod \"23d1cd89-15da-448f-a984-a7feffff329f\" (UID: \"23d1cd89-15da-448f-a984-a7feffff329f\") " Jul 12 19:29:16.241363 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:16.241334 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/23d1cd89-15da-448f-a984-a7feffff329f-kube-api-access-5gm2c" (OuterVolumeSpecName: "kube-api-access-5gm2c") pod "23d1cd89-15da-448f-a984-a7feffff329f" (UID: "23d1cd89-15da-448f-a984-a7feffff329f"). InnerVolumeSpecName "kube-api-access-5gm2c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:29:16.311651 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:16.311613 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4tz" Jul 12 19:29:16.315936 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:29:16.313659 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7jnb6\" is forbidden: User \"system:node:ip-10-0-137-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-63.ec2.internal' and this object" podUID="23d1cd89-15da-448f-a984-a7feffff329f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jnb6" Jul 12 19:29:16.315936 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:29:16.315344 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xz4tz\" is forbidden: User \"system:node:ip-10-0-137-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-63.ec2.internal' and this object" podUID="3a805721-6b78-467b-b934-e9aba4260dfc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4tz" Jul 12 19:29:16.340292 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:16.340258 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3a805721-6b78-467b-b934-e9aba4260dfc-extensions-socket-volume\") pod \"3a805721-6b78-467b-b934-e9aba4260dfc\" (UID: \"3a805721-6b78-467b-b934-e9aba4260dfc\") " Jul 12 19:29:16.340415 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:16.340316 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8p6cz\" (UniqueName: \"kubernetes.io/projected/3a805721-6b78-467b-b934-e9aba4260dfc-kube-api-access-8p6cz\") pod \"3a805721-6b78-467b-b934-e9aba4260dfc\" (UID: \"3a805721-6b78-467b-b934-e9aba4260dfc\") " Jul 12 19:29:16.340530 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:16.340515 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5gm2c\" (UniqueName: \"kubernetes.io/projected/23d1cd89-15da-448f-a984-a7feffff329f-kube-api-access-5gm2c\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:29:16.340808 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:16.340779 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a805721-6b78-467b-b934-e9aba4260dfc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3a805721-6b78-467b-b934-e9aba4260dfc" (UID: "3a805721-6b78-467b-b934-e9aba4260dfc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:29:16.342280 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:16.342258 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a805721-6b78-467b-b934-e9aba4260dfc-kube-api-access-8p6cz" (OuterVolumeSpecName: "kube-api-access-8p6cz") pod "3a805721-6b78-467b-b934-e9aba4260dfc" (UID: "3a805721-6b78-467b-b934-e9aba4260dfc"). InnerVolumeSpecName "kube-api-access-8p6cz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:29:16.435242 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:16.435202 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sc7wr"] Jul 12 19:29:16.436400 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:29:16.436368 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddab9a189_e4fe_45a9_a841_7f5052ebc607.slice/crio-54ab7dd2c6c91df18308c3109aa18dfe102e3570fc075eac091dabdafc5b8d78 WatchSource:0}: Error finding container 54ab7dd2c6c91df18308c3109aa18dfe102e3570fc075eac091dabdafc5b8d78: Status 404 returned error can't find the container with id 54ab7dd2c6c91df18308c3109aa18dfe102e3570fc075eac091dabdafc5b8d78 Jul 12 19:29:16.437129 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:29:16.437107 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeb058928_bf8e_42d4_820a_46438ccb6b09.slice/crio-c9fa4e5e2b7b0e51d4c2aaf3a9d1de4bcd31bbe434e47a61bd2da8f6158b99dd WatchSource:0}: Error finding container c9fa4e5e2b7b0e51d4c2aaf3a9d1de4bcd31bbe434e47a61bd2da8f6158b99dd: Status 404 returned error can't find the container with id c9fa4e5e2b7b0e51d4c2aaf3a9d1de4bcd31bbe434e47a61bd2da8f6158b99dd Jul 12 19:29:16.437568 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:16.437544 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jmlrw"] Jul 12 19:29:16.441657 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:16.441639 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3a805721-6b78-467b-b934-e9aba4260dfc-extensions-socket-volume\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:29:16.441657 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:16.441658 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8p6cz\" (UniqueName: \"kubernetes.io/projected/3a805721-6b78-467b-b934-e9aba4260dfc-kube-api-access-8p6cz\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:29:17.083863 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:17.083832 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="23d1cd89-15da-448f-a984-a7feffff329f" path="/var/lib/kubelet/pods/23d1cd89-15da-448f-a984-a7feffff329f/volumes" Jul 12 19:29:17.084290 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:17.084274 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a805721-6b78-467b-b934-e9aba4260dfc" path="/var/lib/kubelet/pods/3a805721-6b78-467b-b934-e9aba4260dfc/volumes" Jul 12 19:29:17.202349 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:17.202319 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jnb6" Jul 12 19:29:17.202814 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:17.202373 2576 scope.go:117] "RemoveContainer" containerID="71ea9cdefb493e4652b170ac8c4c4506bd295bbc233d670c273b117d6c24d157" Jul 12 19:29:17.203803 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:17.203786 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4tz" Jul 12 19:29:17.204498 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:29:17.204466 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7jnb6\" is forbidden: User \"system:node:ip-10-0-137-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-63.ec2.internal' and this object" podUID="23d1cd89-15da-448f-a984-a7feffff329f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jnb6" Jul 12 19:29:17.205667 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:17.205629 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-58nvv" event={"ID":"84eb4da4-7798-4a28-85e5-16369b69caeb","Type":"ContainerStarted","Data":"d925c9a8c07b56c46e2f47562601a3933cc643eb48bb8f2dd4a1f580ce5a2717"} Jul 12 19:29:17.206201 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:29:17.206145 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xz4tz\" is forbidden: User \"system:node:ip-10-0-137-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-63.ec2.internal' and this object" podUID="3a805721-6b78-467b-b934-e9aba4260dfc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4tz" Jul 12 19:29:17.207706 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:17.207684 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sc7wr" event={"ID":"eb058928-bf8e-42d4-820a-46438ccb6b09","Type":"ContainerStarted","Data":"df43f233c311df395cd4cb363afe38b6ecba3c62844ff6cf123145e48cb00bcd"} Jul 12 19:29:17.207808 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:17.207730 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sc7wr" event={"ID":"eb058928-bf8e-42d4-820a-46438ccb6b09","Type":"ContainerStarted","Data":"c9fa4e5e2b7b0e51d4c2aaf3a9d1de4bcd31bbe434e47a61bd2da8f6158b99dd"} Jul 12 19:29:17.207808 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:17.207762 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sc7wr" Jul 12 19:29:17.208053 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:29:17.208008 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7jnb6\" is forbidden: User \"system:node:ip-10-0-137-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-63.ec2.internal' and this object" podUID="23d1cd89-15da-448f-a984-a7feffff329f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jnb6" Jul 12 19:29:17.209224 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:17.209201 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jmlrw" event={"ID":"dab9a189-e4fe-45a9-a841-7f5052ebc607","Type":"ContainerStarted","Data":"9193880caffb25ab0c4ca9f6eb0f34af899dcdc356225f15422a99fdf4a0a220"} Jul 12 19:29:17.209309 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:17.209244 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jmlrw" event={"ID":"dab9a189-e4fe-45a9-a841-7f5052ebc607","Type":"ContainerStarted","Data":"54ab7dd2c6c91df18308c3109aa18dfe102e3570fc075eac091dabdafc5b8d78"} Jul 12 19:29:17.209376 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:17.209315 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jmlrw" Jul 12 19:29:17.209636 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:29:17.209615 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7jnb6\" is forbidden: User \"system:node:ip-10-0-137-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-63.ec2.internal' and this object" podUID="23d1cd89-15da-448f-a984-a7feffff329f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jnb6" Jul 12 19:29:17.210858 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:17.210839 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ldhc4" event={"ID":"7db091d3-9823-4679-a6ae-dd931c812554","Type":"ContainerStarted","Data":"58a0c9b403030935b0d4455a83245838444a539fb5258969db00c3e234c9d9c5"} Jul 12 19:29:17.210933 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:17.210877 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ldhc4" event={"ID":"7db091d3-9823-4679-a6ae-dd931c812554","Type":"ContainerStarted","Data":"a34271e12a6cdaab184159b64cb7871172aa5f5ccdd0ab157ebc486be044c704"} Jul 12 19:29:17.210933 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:17.210897 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ldhc4" Jul 12 19:29:17.212470 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:17.212455 2576 scope.go:117] "RemoveContainer" containerID="a46b781976faafa2c3334c12b7f002f1eccf289249b043b57d6d209cb8b28208" Jul 12 19:29:17.228065 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:17.228021 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sc7wr" podStartSLOduration=14.228004178 podStartE2EDuration="14.228004178s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:29:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:29:17.226822347 +0000 UTC m=+428.681415311" watchObservedRunningTime="2026-07-12 19:29:17.228004178 +0000 UTC m=+428.682597142" Jul 12 19:29:17.228726 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:29:17.228704 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xz4tz\" is forbidden: User \"system:node:ip-10-0-137-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-63.ec2.internal' and this object" podUID="3a805721-6b78-467b-b934-e9aba4260dfc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4tz" Jul 12 19:29:17.246753 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:17.246704 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-58nvv" podStartSLOduration=2.926234885 podStartE2EDuration="25.246689512s" totalImagesPullingTime="22.320454627s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:28:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:29:17.245087117 +0000 UTC m=+428.699680084" watchObservedRunningTime="2026-07-12 19:29:17.246689512 +0000 UTC m=+428.701282475" Jul 12 19:29:17.246753 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:29:17.246735 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7jnb6\" is forbidden: User \"system:node:ip-10-0-137-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-63.ec2.internal' and this object" podUID="23d1cd89-15da-448f-a984-a7feffff329f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jnb6" Jul 12 19:29:17.263357 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:29:17.263295 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xz4tz\" is forbidden: User \"system:node:ip-10-0-137-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-63.ec2.internal' and this object" podUID="3a805721-6b78-467b-b934-e9aba4260dfc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4tz" Jul 12 19:29:17.263488 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:17.263454 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jmlrw" podStartSLOduration=14.263442402999999 podStartE2EDuration="14.263442403s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:29:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:29:17.261656309 +0000 UTC m=+428.716249273" watchObservedRunningTime="2026-07-12 19:29:17.263442403 +0000 UTC m=+428.718035365" Jul 12 19:29:17.281062 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:17.281015 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ldhc4" podStartSLOduration=14.281002663 podStartE2EDuration="14.281002663s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:29:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:29:17.279211016 +0000 UTC m=+428.733803982" watchObservedRunningTime="2026-07-12 19:29:17.281002663 +0000 UTC m=+428.735595623" Jul 12 19:29:19.085903 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:29:19.085858 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-7jnb6\" is forbidden: User \"system:node:ip-10-0-137-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-63.ec2.internal' and this object" podUID="23d1cd89-15da-448f-a984-a7feffff329f" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-7jnb6" Jul 12 19:29:19.087641 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:29:19.087612 2576 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-xz4tz\" is forbidden: User \"system:node:ip-10-0-137-63.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-63.ec2.internal' and this object" podUID="3a805721-6b78-467b-b934-e9aba4260dfc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xz4tz" Jul 12 19:29:28.219941 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:28.219906 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ldhc4" Jul 12 19:29:28.220528 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:28.220021 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sc7wr" Jul 12 19:29:28.220528 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:28.220387 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jmlrw" Jul 12 19:29:28.372593 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:28.372563 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ldhc4"] Jul 12 19:29:28.372771 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:28.372748 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ldhc4" podUID="7db091d3-9823-4679-a6ae-dd931c812554" containerName="manager" containerID="cri-o://58a0c9b403030935b0d4455a83245838444a539fb5258969db00c3e234c9d9c5" gracePeriod=10 Jul 12 19:29:28.618031 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:28.618006 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ldhc4" Jul 12 19:29:28.741549 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:28.741470 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7db091d3-9823-4679-a6ae-dd931c812554-extensions-socket-volume\") pod \"7db091d3-9823-4679-a6ae-dd931c812554\" (UID: \"7db091d3-9823-4679-a6ae-dd931c812554\") " Jul 12 19:29:28.741699 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:28.741593 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tpqs6\" (UniqueName: \"kubernetes.io/projected/7db091d3-9823-4679-a6ae-dd931c812554-kube-api-access-tpqs6\") pod \"7db091d3-9823-4679-a6ae-dd931c812554\" (UID: \"7db091d3-9823-4679-a6ae-dd931c812554\") " Jul 12 19:29:28.741971 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:28.741944 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7db091d3-9823-4679-a6ae-dd931c812554-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7db091d3-9823-4679-a6ae-dd931c812554" (UID: "7db091d3-9823-4679-a6ae-dd931c812554"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:29:28.743769 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:28.743737 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7db091d3-9823-4679-a6ae-dd931c812554-kube-api-access-tpqs6" (OuterVolumeSpecName: "kube-api-access-tpqs6") pod "7db091d3-9823-4679-a6ae-dd931c812554" (UID: "7db091d3-9823-4679-a6ae-dd931c812554"). InnerVolumeSpecName "kube-api-access-tpqs6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:29:28.842171 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:28.842142 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tpqs6\" (UniqueName: \"kubernetes.io/projected/7db091d3-9823-4679-a6ae-dd931c812554-kube-api-access-tpqs6\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:29:28.842171 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:28.842169 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7db091d3-9823-4679-a6ae-dd931c812554-extensions-socket-volume\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:29:29.278014 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:29.277956 2576 generic.go:356] "Generic (PLEG): container finished" podID="7db091d3-9823-4679-a6ae-dd931c812554" containerID="58a0c9b403030935b0d4455a83245838444a539fb5258969db00c3e234c9d9c5" exitCode=0 Jul 12 19:29:29.278407 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:29.278030 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ldhc4" Jul 12 19:29:29.278407 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:29.278039 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ldhc4" event={"ID":"7db091d3-9823-4679-a6ae-dd931c812554","Type":"ContainerDied","Data":"58a0c9b403030935b0d4455a83245838444a539fb5258969db00c3e234c9d9c5"} Jul 12 19:29:29.278407 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:29.278101 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ldhc4" event={"ID":"7db091d3-9823-4679-a6ae-dd931c812554","Type":"ContainerDied","Data":"a34271e12a6cdaab184159b64cb7871172aa5f5ccdd0ab157ebc486be044c704"} Jul 12 19:29:29.278407 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:29.278124 2576 scope.go:117] "RemoveContainer" containerID="58a0c9b403030935b0d4455a83245838444a539fb5258969db00c3e234c9d9c5" Jul 12 19:29:29.287103 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:29.286973 2576 scope.go:117] "RemoveContainer" containerID="58a0c9b403030935b0d4455a83245838444a539fb5258969db00c3e234c9d9c5" Jul 12 19:29:29.287266 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:29:29.287246 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"58a0c9b403030935b0d4455a83245838444a539fb5258969db00c3e234c9d9c5\": container with ID starting with 58a0c9b403030935b0d4455a83245838444a539fb5258969db00c3e234c9d9c5 not found: ID does not exist" containerID="58a0c9b403030935b0d4455a83245838444a539fb5258969db00c3e234c9d9c5" Jul 12 19:29:29.287322 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:29.287277 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"58a0c9b403030935b0d4455a83245838444a539fb5258969db00c3e234c9d9c5"} err="failed to get container status \"58a0c9b403030935b0d4455a83245838444a539fb5258969db00c3e234c9d9c5\": rpc error: code = NotFound desc = could not find container \"58a0c9b403030935b0d4455a83245838444a539fb5258969db00c3e234c9d9c5\": container with ID starting with 58a0c9b403030935b0d4455a83245838444a539fb5258969db00c3e234c9d9c5 not found: ID does not exist" Jul 12 19:29:29.293877 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:29.293855 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ldhc4"] Jul 12 19:29:29.304627 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:29.304606 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-ldhc4"] Jul 12 19:29:31.084007 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:31.083955 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7db091d3-9823-4679-a6ae-dd931c812554" path="/var/lib/kubelet/pods/7db091d3-9823-4679-a6ae-dd931c812554/volumes" Jul 12 19:29:44.759806 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:44.759773 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7"] Jul 12 19:29:44.760384 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:44.760355 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7db091d3-9823-4679-a6ae-dd931c812554" containerName="manager" Jul 12 19:29:44.760384 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:44.760379 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="7db091d3-9823-4679-a6ae-dd931c812554" containerName="manager" Jul 12 19:29:44.760565 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:44.760516 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="7db091d3-9823-4679-a6ae-dd931c812554" containerName="manager" Jul 12 19:29:44.783144 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:44.783073 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7"] Jul 12 19:29:44.783310 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:44.783167 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" Jul 12 19:29:44.785534 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:44.785510 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 12 19:29:44.785681 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:44.785512 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-ww2dl\"" Jul 12 19:29:44.874919 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:44.874881 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5465dd47-b0dd-4a80-9db3-b93843ab360b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-888r7\" (UID: \"5465dd47-b0dd-4a80-9db3-b93843ab360b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" Jul 12 19:29:44.875108 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:44.874925 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5465dd47-b0dd-4a80-9db3-b93843ab360b-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-888r7\" (UID: \"5465dd47-b0dd-4a80-9db3-b93843ab360b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" Jul 12 19:29:44.875108 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:44.875026 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5465dd47-b0dd-4a80-9db3-b93843ab360b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-888r7\" (UID: \"5465dd47-b0dd-4a80-9db3-b93843ab360b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" Jul 12 19:29:44.875108 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:44.875069 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5465dd47-b0dd-4a80-9db3-b93843ab360b-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-888r7\" (UID: \"5465dd47-b0dd-4a80-9db3-b93843ab360b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" Jul 12 19:29:44.875108 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:44.875088 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssnzz\" (UniqueName: \"kubernetes.io/projected/5465dd47-b0dd-4a80-9db3-b93843ab360b-kube-api-access-ssnzz\") pod \"maas-default-gateway-openshift-default-5896d4dd49-888r7\" (UID: \"5465dd47-b0dd-4a80-9db3-b93843ab360b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" Jul 12 19:29:44.875264 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:44.875121 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5465dd47-b0dd-4a80-9db3-b93843ab360b-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-888r7\" (UID: \"5465dd47-b0dd-4a80-9db3-b93843ab360b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" Jul 12 19:29:44.875264 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:44.875136 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5465dd47-b0dd-4a80-9db3-b93843ab360b-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-888r7\" (UID: \"5465dd47-b0dd-4a80-9db3-b93843ab360b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" Jul 12 19:29:44.875264 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:44.875170 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5465dd47-b0dd-4a80-9db3-b93843ab360b-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-888r7\" (UID: \"5465dd47-b0dd-4a80-9db3-b93843ab360b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" Jul 12 19:29:44.875264 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:44.875204 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5465dd47-b0dd-4a80-9db3-b93843ab360b-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-888r7\" (UID: \"5465dd47-b0dd-4a80-9db3-b93843ab360b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" Jul 12 19:29:44.976032 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:44.975976 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5465dd47-b0dd-4a80-9db3-b93843ab360b-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-888r7\" (UID: \"5465dd47-b0dd-4a80-9db3-b93843ab360b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" Jul 12 19:29:44.976233 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:44.976044 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5465dd47-b0dd-4a80-9db3-b93843ab360b-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-888r7\" (UID: \"5465dd47-b0dd-4a80-9db3-b93843ab360b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" Jul 12 19:29:44.976233 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:44.976065 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5465dd47-b0dd-4a80-9db3-b93843ab360b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-888r7\" (UID: \"5465dd47-b0dd-4a80-9db3-b93843ab360b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" Jul 12 19:29:44.976233 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:44.976088 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5465dd47-b0dd-4a80-9db3-b93843ab360b-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-888r7\" (UID: \"5465dd47-b0dd-4a80-9db3-b93843ab360b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" Jul 12 19:29:44.976233 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:44.976120 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5465dd47-b0dd-4a80-9db3-b93843ab360b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-888r7\" (UID: \"5465dd47-b0dd-4a80-9db3-b93843ab360b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" Jul 12 19:29:44.976233 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:44.976152 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5465dd47-b0dd-4a80-9db3-b93843ab360b-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-888r7\" (UID: \"5465dd47-b0dd-4a80-9db3-b93843ab360b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" Jul 12 19:29:44.976632 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:44.976284 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssnzz\" (UniqueName: \"kubernetes.io/projected/5465dd47-b0dd-4a80-9db3-b93843ab360b-kube-api-access-ssnzz\") pod \"maas-default-gateway-openshift-default-5896d4dd49-888r7\" (UID: \"5465dd47-b0dd-4a80-9db3-b93843ab360b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" Jul 12 19:29:44.976632 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:44.976360 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5465dd47-b0dd-4a80-9db3-b93843ab360b-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-888r7\" (UID: \"5465dd47-b0dd-4a80-9db3-b93843ab360b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" Jul 12 19:29:44.976632 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:44.976386 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5465dd47-b0dd-4a80-9db3-b93843ab360b-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-888r7\" (UID: \"5465dd47-b0dd-4a80-9db3-b93843ab360b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" Jul 12 19:29:44.976632 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:44.976447 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5465dd47-b0dd-4a80-9db3-b93843ab360b-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-888r7\" (UID: \"5465dd47-b0dd-4a80-9db3-b93843ab360b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" Jul 12 19:29:44.976632 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:44.976457 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5465dd47-b0dd-4a80-9db3-b93843ab360b-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-888r7\" (UID: \"5465dd47-b0dd-4a80-9db3-b93843ab360b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" Jul 12 19:29:44.976632 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:44.976531 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5465dd47-b0dd-4a80-9db3-b93843ab360b-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-888r7\" (UID: \"5465dd47-b0dd-4a80-9db3-b93843ab360b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" Jul 12 19:29:44.976928 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:44.976716 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5465dd47-b0dd-4a80-9db3-b93843ab360b-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-888r7\" (UID: \"5465dd47-b0dd-4a80-9db3-b93843ab360b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" Jul 12 19:29:44.976928 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:44.976902 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5465dd47-b0dd-4a80-9db3-b93843ab360b-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-888r7\" (UID: \"5465dd47-b0dd-4a80-9db3-b93843ab360b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" Jul 12 19:29:44.978661 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:44.978638 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5465dd47-b0dd-4a80-9db3-b93843ab360b-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-888r7\" (UID: \"5465dd47-b0dd-4a80-9db3-b93843ab360b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" Jul 12 19:29:44.978816 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:44.978794 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5465dd47-b0dd-4a80-9db3-b93843ab360b-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-888r7\" (UID: \"5465dd47-b0dd-4a80-9db3-b93843ab360b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" Jul 12 19:29:44.983849 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:44.983825 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5465dd47-b0dd-4a80-9db3-b93843ab360b-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-888r7\" (UID: \"5465dd47-b0dd-4a80-9db3-b93843ab360b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" Jul 12 19:29:44.983960 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:44.983939 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssnzz\" (UniqueName: \"kubernetes.io/projected/5465dd47-b0dd-4a80-9db3-b93843ab360b-kube-api-access-ssnzz\") pod \"maas-default-gateway-openshift-default-5896d4dd49-888r7\" (UID: \"5465dd47-b0dd-4a80-9db3-b93843ab360b\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" Jul 12 19:29:45.095695 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:45.095609 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" Jul 12 19:29:45.300935 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:45.300907 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7"] Jul 12 19:29:45.302769 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:29:45.302745 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5465dd47_b0dd_4a80_9db3_b93843ab360b.slice/crio-1c027e6e42d0eee4236d8dbe95dff9e018835e0b17e0ba6c23d61a20e4de74b0 WatchSource:0}: Error finding container 1c027e6e42d0eee4236d8dbe95dff9e018835e0b17e0ba6c23d61a20e4de74b0: Status 404 returned error can't find the container with id 1c027e6e42d0eee4236d8dbe95dff9e018835e0b17e0ba6c23d61a20e4de74b0 Jul 12 19:29:45.370099 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:45.370014 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" event={"ID":"5465dd47-b0dd-4a80-9db3-b93843ab360b","Type":"ContainerStarted","Data":"1c027e6e42d0eee4236d8dbe95dff9e018835e0b17e0ba6c23d61a20e4de74b0"} Jul 12 19:29:48.002261 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:48.002228 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 12 19:29:48.002542 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:48.002295 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 12 19:29:48.002542 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:48.002323 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 12 19:29:48.389854 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:48.389755 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" event={"ID":"5465dd47-b0dd-4a80-9db3-b93843ab360b","Type":"ContainerStarted","Data":"7e413ecf91d83e1c8b58aa8bc9994f84114b15ef8d6360431a8c32ae9c1da381"} Jul 12 19:29:48.409566 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:48.409510 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" podStartSLOduration=1.712672946 podStartE2EDuration="4.409494539s" totalImagesPullingTime="2.696821593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:29:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:29:48.406834778 +0000 UTC m=+459.861427742" watchObservedRunningTime="2026-07-12 19:29:48.409494539 +0000 UTC m=+459.864087501" Jul 12 19:29:49.096461 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:49.096432 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" Jul 12 19:29:49.101214 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:49.101192 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" Jul 12 19:29:49.373269 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:49.373188 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7fnr5"] Jul 12 19:29:49.376745 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:49.376728 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-7fnr5" Jul 12 19:29:49.378825 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:49.378803 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 12 19:29:49.385758 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:49.385736 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7fnr5"] Jul 12 19:29:49.395317 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:49.395299 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" Jul 12 19:29:49.396406 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:49.396388 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" Jul 12 19:29:49.468201 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:49.468169 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7fnr5"] Jul 12 19:29:49.519768 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:49.519724 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5937f3fc-11ed-415e-ae37-4c091fdd56af-config-file\") pod \"limitador-limitador-64c94fd64f-7fnr5\" (UID: \"5937f3fc-11ed-415e-ae37-4c091fdd56af\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7fnr5" Jul 12 19:29:49.519956 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:49.519881 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xb7f5\" (UniqueName: \"kubernetes.io/projected/5937f3fc-11ed-415e-ae37-4c091fdd56af-kube-api-access-xb7f5\") pod \"limitador-limitador-64c94fd64f-7fnr5\" (UID: \"5937f3fc-11ed-415e-ae37-4c091fdd56af\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7fnr5" Jul 12 19:29:49.620801 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:49.620761 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5937f3fc-11ed-415e-ae37-4c091fdd56af-config-file\") pod \"limitador-limitador-64c94fd64f-7fnr5\" (UID: \"5937f3fc-11ed-415e-ae37-4c091fdd56af\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7fnr5" Jul 12 19:29:49.621033 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:49.620830 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xb7f5\" (UniqueName: \"kubernetes.io/projected/5937f3fc-11ed-415e-ae37-4c091fdd56af-kube-api-access-xb7f5\") pod \"limitador-limitador-64c94fd64f-7fnr5\" (UID: \"5937f3fc-11ed-415e-ae37-4c091fdd56af\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7fnr5" Jul 12 19:29:49.621439 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:49.621417 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5937f3fc-11ed-415e-ae37-4c091fdd56af-config-file\") pod \"limitador-limitador-64c94fd64f-7fnr5\" (UID: \"5937f3fc-11ed-415e-ae37-4c091fdd56af\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7fnr5" Jul 12 19:29:49.628281 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:49.628218 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xb7f5\" (UniqueName: \"kubernetes.io/projected/5937f3fc-11ed-415e-ae37-4c091fdd56af-kube-api-access-xb7f5\") pod \"limitador-limitador-64c94fd64f-7fnr5\" (UID: \"5937f3fc-11ed-415e-ae37-4c091fdd56af\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-7fnr5" Jul 12 19:29:49.687830 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:49.687795 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-7fnr5" Jul 12 19:29:49.823623 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:49.823601 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7fnr5"] Jul 12 19:29:49.825817 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:29:49.825794 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5937f3fc_11ed_415e_ae37_4c091fdd56af.slice/crio-e09c236f8add8a420f06f392fb29b5f5efdb93c072ef44683d86f7883032fe46 WatchSource:0}: Error finding container e09c236f8add8a420f06f392fb29b5f5efdb93c072ef44683d86f7883032fe46: Status 404 returned error can't find the container with id e09c236f8add8a420f06f392fb29b5f5efdb93c072ef44683d86f7883032fe46 Jul 12 19:29:50.153304 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:50.153271 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-xl7pt"] Jul 12 19:29:50.157682 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:50.157655 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xl7pt" Jul 12 19:29:50.159815 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:50.159788 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-x94t5\"" Jul 12 19:29:50.163601 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:50.163576 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-xl7pt"] Jul 12 19:29:50.227441 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:50.227402 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgq6p\" (UniqueName: \"kubernetes.io/projected/d2586bbd-5ea6-455b-bce0-6a6664ad152c-kube-api-access-fgq6p\") pod \"authorino-58cd955675-xl7pt\" (UID: \"d2586bbd-5ea6-455b-bce0-6a6664ad152c\") " pod="kuadrant-system/authorino-58cd955675-xl7pt" Jul 12 19:29:50.315872 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:50.315832 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-zz84p"] Jul 12 19:29:50.320036 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:50.320005 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zz84p" Jul 12 19:29:50.321336 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:50.321310 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zz84p"] Jul 12 19:29:50.328125 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:50.328100 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgq6p\" (UniqueName: \"kubernetes.io/projected/d2586bbd-5ea6-455b-bce0-6a6664ad152c-kube-api-access-fgq6p\") pod \"authorino-58cd955675-xl7pt\" (UID: \"d2586bbd-5ea6-455b-bce0-6a6664ad152c\") " pod="kuadrant-system/authorino-58cd955675-xl7pt" Jul 12 19:29:50.336814 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:50.336785 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgq6p\" (UniqueName: \"kubernetes.io/projected/d2586bbd-5ea6-455b-bce0-6a6664ad152c-kube-api-access-fgq6p\") pod \"authorino-58cd955675-xl7pt\" (UID: \"d2586bbd-5ea6-455b-bce0-6a6664ad152c\") " pod="kuadrant-system/authorino-58cd955675-xl7pt" Jul 12 19:29:50.401442 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:50.401413 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-7fnr5" event={"ID":"5937f3fc-11ed-415e-ae37-4c091fdd56af","Type":"ContainerStarted","Data":"e09c236f8add8a420f06f392fb29b5f5efdb93c072ef44683d86f7883032fe46"} Jul 12 19:29:50.428867 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:50.428803 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mz84\" (UniqueName: \"kubernetes.io/projected/51e32f12-c37f-41c3-9672-fe2d5c0efea5-kube-api-access-5mz84\") pod \"authorino-75d556bd77-zz84p\" (UID: \"51e32f12-c37f-41c3-9672-fe2d5c0efea5\") " pod="kuadrant-system/authorino-75d556bd77-zz84p" Jul 12 19:29:50.470193 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:50.470164 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xl7pt" Jul 12 19:29:50.530441 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:50.530089 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mz84\" (UniqueName: \"kubernetes.io/projected/51e32f12-c37f-41c3-9672-fe2d5c0efea5-kube-api-access-5mz84\") pod \"authorino-75d556bd77-zz84p\" (UID: \"51e32f12-c37f-41c3-9672-fe2d5c0efea5\") " pod="kuadrant-system/authorino-75d556bd77-zz84p" Jul 12 19:29:50.545108 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:50.544057 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mz84\" (UniqueName: \"kubernetes.io/projected/51e32f12-c37f-41c3-9672-fe2d5c0efea5-kube-api-access-5mz84\") pod \"authorino-75d556bd77-zz84p\" (UID: \"51e32f12-c37f-41c3-9672-fe2d5c0efea5\") " pod="kuadrant-system/authorino-75d556bd77-zz84p" Jul 12 19:29:50.630174 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:50.630137 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zz84p" Jul 12 19:29:50.644826 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:50.644798 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-xl7pt"] Jul 12 19:29:50.652299 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:29:50.652269 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2586bbd_5ea6_455b_bce0_6a6664ad152c.slice/crio-ae4124e35c79303a9f3f002a403b6f863289ae1527962f9b805c91df11537b85 WatchSource:0}: Error finding container ae4124e35c79303a9f3f002a403b6f863289ae1527962f9b805c91df11537b85: Status 404 returned error can't find the container with id ae4124e35c79303a9f3f002a403b6f863289ae1527962f9b805c91df11537b85 Jul 12 19:29:50.823944 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:50.823899 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zz84p"] Jul 12 19:29:50.826672 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:29:50.826641 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod51e32f12_c37f_41c3_9672_fe2d5c0efea5.slice/crio-ff3ae3d160cf7ed9749cea0fe76ba570ee19551f9a2b24d21c338c8a819bc63f WatchSource:0}: Error finding container ff3ae3d160cf7ed9749cea0fe76ba570ee19551f9a2b24d21c338c8a819bc63f: Status 404 returned error can't find the container with id ff3ae3d160cf7ed9749cea0fe76ba570ee19551f9a2b24d21c338c8a819bc63f Jul 12 19:29:51.414828 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:51.414739 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xl7pt" event={"ID":"d2586bbd-5ea6-455b-bce0-6a6664ad152c","Type":"ContainerStarted","Data":"ae4124e35c79303a9f3f002a403b6f863289ae1527962f9b805c91df11537b85"} Jul 12 19:29:51.421715 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:51.421647 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zz84p" event={"ID":"51e32f12-c37f-41c3-9672-fe2d5c0efea5","Type":"ContainerStarted","Data":"ff3ae3d160cf7ed9749cea0fe76ba570ee19551f9a2b24d21c338c8a819bc63f"} Jul 12 19:29:55.454021 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:55.453973 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xl7pt" event={"ID":"d2586bbd-5ea6-455b-bce0-6a6664ad152c","Type":"ContainerStarted","Data":"a005be0ac374956d89ef807140276093a7b707d89b66a4f43471d6af1df6cef4"} Jul 12 19:29:55.455539 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:55.455516 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-7fnr5" event={"ID":"5937f3fc-11ed-415e-ae37-4c091fdd56af","Type":"ContainerStarted","Data":"1eeae65e2ee24d7aa58a6057307f87dfee666768872b12f4663f00265dd00b79"} Jul 12 19:29:55.455619 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:55.455564 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-7fnr5" Jul 12 19:29:55.457076 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:55.457054 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zz84p" event={"ID":"51e32f12-c37f-41c3-9672-fe2d5c0efea5","Type":"ContainerStarted","Data":"3773919da71b68f7d7edf7115844d47da02bc1629bd4230d18cafbaf6ce55b55"} Jul 12 19:29:55.466591 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:55.466545 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-xl7pt" podStartSLOduration=1.088766232 podStartE2EDuration="5.466521524s" totalImagesPullingTime="4.377755292s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:29:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:29:55.465917448 +0000 UTC m=+466.920510412" watchObservedRunningTime="2026-07-12 19:29:55.466521524 +0000 UTC m=+466.921114547" Jul 12 19:29:55.481819 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:55.481779 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-7fnr5" podStartSLOduration=1.277739672 podStartE2EDuration="6.481765182s" totalImagesPullingTime="5.20402551s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:29:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:29:55.479755919 +0000 UTC m=+466.934348882" watchObservedRunningTime="2026-07-12 19:29:55.481765182 +0000 UTC m=+466.936358146" Jul 12 19:29:55.494075 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:55.494032 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-zz84p" podStartSLOduration=1.277812987 podStartE2EDuration="5.494019374s" totalImagesPullingTime="4.216206387s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:29:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:29:55.492071528 +0000 UTC m=+466.946664492" watchObservedRunningTime="2026-07-12 19:29:55.494019374 +0000 UTC m=+466.948612337" Jul 12 19:29:55.519300 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:55.519277 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-xl7pt"] Jul 12 19:29:57.467246 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:57.467209 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-xl7pt" podUID="d2586bbd-5ea6-455b-bce0-6a6664ad152c" containerName="authorino" containerID="cri-o://a005be0ac374956d89ef807140276093a7b707d89b66a4f43471d6af1df6cef4" gracePeriod=30 Jul 12 19:29:57.718615 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:57.718561 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xl7pt" Jul 12 19:29:57.820029 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:57.819981 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fgq6p\" (UniqueName: \"kubernetes.io/projected/d2586bbd-5ea6-455b-bce0-6a6664ad152c-kube-api-access-fgq6p\") pod \"d2586bbd-5ea6-455b-bce0-6a6664ad152c\" (UID: \"d2586bbd-5ea6-455b-bce0-6a6664ad152c\") " Jul 12 19:29:57.821799 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:57.821776 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2586bbd-5ea6-455b-bce0-6a6664ad152c-kube-api-access-fgq6p" (OuterVolumeSpecName: "kube-api-access-fgq6p") pod "d2586bbd-5ea6-455b-bce0-6a6664ad152c" (UID: "d2586bbd-5ea6-455b-bce0-6a6664ad152c"). InnerVolumeSpecName "kube-api-access-fgq6p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:29:57.921577 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:57.921520 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgq6p\" (UniqueName: \"kubernetes.io/projected/d2586bbd-5ea6-455b-bce0-6a6664ad152c-kube-api-access-fgq6p\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:29:58.473896 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:58.473861 2576 generic.go:356] "Generic (PLEG): container finished" podID="d2586bbd-5ea6-455b-bce0-6a6664ad152c" containerID="a005be0ac374956d89ef807140276093a7b707d89b66a4f43471d6af1df6cef4" exitCode=0 Jul 12 19:29:58.473896 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:58.473899 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-xl7pt" Jul 12 19:29:58.474416 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:58.473941 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xl7pt" event={"ID":"d2586bbd-5ea6-455b-bce0-6a6664ad152c","Type":"ContainerDied","Data":"a005be0ac374956d89ef807140276093a7b707d89b66a4f43471d6af1df6cef4"} Jul 12 19:29:58.474416 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:58.473975 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-xl7pt" event={"ID":"d2586bbd-5ea6-455b-bce0-6a6664ad152c","Type":"ContainerDied","Data":"ae4124e35c79303a9f3f002a403b6f863289ae1527962f9b805c91df11537b85"} Jul 12 19:29:58.474416 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:58.474008 2576 scope.go:117] "RemoveContainer" containerID="a005be0ac374956d89ef807140276093a7b707d89b66a4f43471d6af1df6cef4" Jul 12 19:29:58.483653 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:58.483640 2576 scope.go:117] "RemoveContainer" containerID="a005be0ac374956d89ef807140276093a7b707d89b66a4f43471d6af1df6cef4" Jul 12 19:29:58.483900 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:29:58.483880 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a005be0ac374956d89ef807140276093a7b707d89b66a4f43471d6af1df6cef4\": container with ID starting with a005be0ac374956d89ef807140276093a7b707d89b66a4f43471d6af1df6cef4 not found: ID does not exist" containerID="a005be0ac374956d89ef807140276093a7b707d89b66a4f43471d6af1df6cef4" Jul 12 19:29:58.483947 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:58.483909 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a005be0ac374956d89ef807140276093a7b707d89b66a4f43471d6af1df6cef4"} err="failed to get container status \"a005be0ac374956d89ef807140276093a7b707d89b66a4f43471d6af1df6cef4\": rpc error: code = NotFound desc = could not find container \"a005be0ac374956d89ef807140276093a7b707d89b66a4f43471d6af1df6cef4\": container with ID starting with a005be0ac374956d89ef807140276093a7b707d89b66a4f43471d6af1df6cef4 not found: ID does not exist" Jul 12 19:29:58.494395 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:58.494373 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-xl7pt"] Jul 12 19:29:58.496373 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:58.496356 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-xl7pt"] Jul 12 19:29:59.086568 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:29:59.086536 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2586bbd-5ea6-455b-bce0-6a6664ad152c" path="/var/lib/kubelet/pods/d2586bbd-5ea6-455b-bce0-6a6664ad152c/volumes" Jul 12 19:30:03.806510 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:03.806477 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7fnr5"] Jul 12 19:30:03.807130 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:03.806673 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-7fnr5" podUID="5937f3fc-11ed-415e-ae37-4c091fdd56af" containerName="limitador" containerID="cri-o://1eeae65e2ee24d7aa58a6057307f87dfee666768872b12f4663f00265dd00b79" gracePeriod=30 Jul 12 19:30:03.809005 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:03.808967 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-7fnr5" Jul 12 19:30:04.355892 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:04.355866 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-7fnr5" Jul 12 19:30:04.366966 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:04.366919 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xb7f5\" (UniqueName: \"kubernetes.io/projected/5937f3fc-11ed-415e-ae37-4c091fdd56af-kube-api-access-xb7f5\") pod \"5937f3fc-11ed-415e-ae37-4c091fdd56af\" (UID: \"5937f3fc-11ed-415e-ae37-4c091fdd56af\") " Jul 12 19:30:04.366966 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:04.366960 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5937f3fc-11ed-415e-ae37-4c091fdd56af-config-file\") pod \"5937f3fc-11ed-415e-ae37-4c091fdd56af\" (UID: \"5937f3fc-11ed-415e-ae37-4c091fdd56af\") " Jul 12 19:30:04.367322 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:04.367298 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5937f3fc-11ed-415e-ae37-4c091fdd56af-config-file" (OuterVolumeSpecName: "config-file") pod "5937f3fc-11ed-415e-ae37-4c091fdd56af" (UID: "5937f3fc-11ed-415e-ae37-4c091fdd56af"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 19:30:04.368864 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:04.368842 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5937f3fc-11ed-415e-ae37-4c091fdd56af-kube-api-access-xb7f5" (OuterVolumeSpecName: "kube-api-access-xb7f5") pod "5937f3fc-11ed-415e-ae37-4c091fdd56af" (UID: "5937f3fc-11ed-415e-ae37-4c091fdd56af"). InnerVolumeSpecName "kube-api-access-xb7f5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:30:04.468533 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:04.468509 2576 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/5937f3fc-11ed-415e-ae37-4c091fdd56af-config-file\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:30:04.468533 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:04.468531 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xb7f5\" (UniqueName: \"kubernetes.io/projected/5937f3fc-11ed-415e-ae37-4c091fdd56af-kube-api-access-xb7f5\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:30:04.508461 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:04.508432 2576 generic.go:356] "Generic (PLEG): container finished" podID="5937f3fc-11ed-415e-ae37-4c091fdd56af" containerID="1eeae65e2ee24d7aa58a6057307f87dfee666768872b12f4663f00265dd00b79" exitCode=0 Jul 12 19:30:04.508604 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:04.508471 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-7fnr5" Jul 12 19:30:04.508604 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:04.508519 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-7fnr5" event={"ID":"5937f3fc-11ed-415e-ae37-4c091fdd56af","Type":"ContainerDied","Data":"1eeae65e2ee24d7aa58a6057307f87dfee666768872b12f4663f00265dd00b79"} Jul 12 19:30:04.508604 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:04.508577 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-7fnr5" event={"ID":"5937f3fc-11ed-415e-ae37-4c091fdd56af","Type":"ContainerDied","Data":"e09c236f8add8a420f06f392fb29b5f5efdb93c072ef44683d86f7883032fe46"} Jul 12 19:30:04.508763 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:04.508608 2576 scope.go:117] "RemoveContainer" containerID="1eeae65e2ee24d7aa58a6057307f87dfee666768872b12f4663f00265dd00b79" Jul 12 19:30:04.520482 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:04.520464 2576 scope.go:117] "RemoveContainer" containerID="1eeae65e2ee24d7aa58a6057307f87dfee666768872b12f4663f00265dd00b79" Jul 12 19:30:04.520751 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:30:04.520731 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1eeae65e2ee24d7aa58a6057307f87dfee666768872b12f4663f00265dd00b79\": container with ID starting with 1eeae65e2ee24d7aa58a6057307f87dfee666768872b12f4663f00265dd00b79 not found: ID does not exist" containerID="1eeae65e2ee24d7aa58a6057307f87dfee666768872b12f4663f00265dd00b79" Jul 12 19:30:04.520790 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:04.520759 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1eeae65e2ee24d7aa58a6057307f87dfee666768872b12f4663f00265dd00b79"} err="failed to get container status \"1eeae65e2ee24d7aa58a6057307f87dfee666768872b12f4663f00265dd00b79\": rpc error: code = NotFound desc = could not find container \"1eeae65e2ee24d7aa58a6057307f87dfee666768872b12f4663f00265dd00b79\": container with ID starting with 1eeae65e2ee24d7aa58a6057307f87dfee666768872b12f4663f00265dd00b79 not found: ID does not exist" Jul 12 19:30:04.532139 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:04.532118 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7fnr5"] Jul 12 19:30:04.535591 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:04.535572 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-7fnr5"] Jul 12 19:30:05.083447 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:05.083414 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5937f3fc-11ed-415e-ae37-4c091fdd56af" path="/var/lib/kubelet/pods/5937f3fc-11ed-415e-ae37-4c091fdd56af/volumes" Jul 12 19:30:05.740564 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:05.740535 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-qsnfs"] Jul 12 19:30:05.740913 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:05.740900 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2586bbd-5ea6-455b-bce0-6a6664ad152c" containerName="authorino" Jul 12 19:30:05.740952 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:05.740914 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2586bbd-5ea6-455b-bce0-6a6664ad152c" containerName="authorino" Jul 12 19:30:05.740952 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:05.740928 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5937f3fc-11ed-415e-ae37-4c091fdd56af" containerName="limitador" Jul 12 19:30:05.740952 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:05.740936 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="5937f3fc-11ed-415e-ae37-4c091fdd56af" containerName="limitador" Jul 12 19:30:05.741063 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:05.741011 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="5937f3fc-11ed-415e-ae37-4c091fdd56af" containerName="limitador" Jul 12 19:30:05.741063 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:05.741021 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2586bbd-5ea6-455b-bce0-6a6664ad152c" containerName="authorino" Jul 12 19:30:05.745321 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:05.745299 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-qsnfs" Jul 12 19:30:05.748022 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:05.747979 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-xt2ml\"" Jul 12 19:30:05.748164 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:05.748048 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 12 19:30:05.751595 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:05.751574 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-qsnfs"] Jul 12 19:30:05.780261 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:05.780232 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zmvwc\" (UniqueName: \"kubernetes.io/projected/e25ac8bd-7a71-4a0a-8742-2acfd1e5d7c1-kube-api-access-zmvwc\") pod \"postgres-69fb4594cf-qsnfs\" (UID: \"e25ac8bd-7a71-4a0a-8742-2acfd1e5d7c1\") " pod="opendatahub/postgres-69fb4594cf-qsnfs" Jul 12 19:30:05.780395 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:05.780269 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e25ac8bd-7a71-4a0a-8742-2acfd1e5d7c1-data\") pod \"postgres-69fb4594cf-qsnfs\" (UID: \"e25ac8bd-7a71-4a0a-8742-2acfd1e5d7c1\") " pod="opendatahub/postgres-69fb4594cf-qsnfs" Jul 12 19:30:05.880900 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:05.880867 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zmvwc\" (UniqueName: \"kubernetes.io/projected/e25ac8bd-7a71-4a0a-8742-2acfd1e5d7c1-kube-api-access-zmvwc\") pod \"postgres-69fb4594cf-qsnfs\" (UID: \"e25ac8bd-7a71-4a0a-8742-2acfd1e5d7c1\") " pod="opendatahub/postgres-69fb4594cf-qsnfs" Jul 12 19:30:05.881096 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:05.880914 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e25ac8bd-7a71-4a0a-8742-2acfd1e5d7c1-data\") pod \"postgres-69fb4594cf-qsnfs\" (UID: \"e25ac8bd-7a71-4a0a-8742-2acfd1e5d7c1\") " pod="opendatahub/postgres-69fb4594cf-qsnfs" Jul 12 19:30:05.881313 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:05.881297 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/e25ac8bd-7a71-4a0a-8742-2acfd1e5d7c1-data\") pod \"postgres-69fb4594cf-qsnfs\" (UID: \"e25ac8bd-7a71-4a0a-8742-2acfd1e5d7c1\") " pod="opendatahub/postgres-69fb4594cf-qsnfs" Jul 12 19:30:05.888554 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:05.888531 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zmvwc\" (UniqueName: \"kubernetes.io/projected/e25ac8bd-7a71-4a0a-8742-2acfd1e5d7c1-kube-api-access-zmvwc\") pod \"postgres-69fb4594cf-qsnfs\" (UID: \"e25ac8bd-7a71-4a0a-8742-2acfd1e5d7c1\") " pod="opendatahub/postgres-69fb4594cf-qsnfs" Jul 12 19:30:06.056586 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:06.056499 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-qsnfs" Jul 12 19:30:06.185173 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:06.185150 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-qsnfs"] Jul 12 19:30:06.186797 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:30:06.186772 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode25ac8bd_7a71_4a0a_8742_2acfd1e5d7c1.slice/crio-02577c08b87aad6cfb0ffa672ade9689cc3892767a9aeeaa4fd43901276c6d66 WatchSource:0}: Error finding container 02577c08b87aad6cfb0ffa672ade9689cc3892767a9aeeaa4fd43901276c6d66: Status 404 returned error can't find the container with id 02577c08b87aad6cfb0ffa672ade9689cc3892767a9aeeaa4fd43901276c6d66 Jul 12 19:30:06.520443 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:06.520410 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-qsnfs" event={"ID":"e25ac8bd-7a71-4a0a-8742-2acfd1e5d7c1","Type":"ContainerStarted","Data":"02577c08b87aad6cfb0ffa672ade9689cc3892767a9aeeaa4fd43901276c6d66"} Jul 12 19:30:10.762977 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:10.762955 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 12 19:30:11.554355 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:11.554321 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-qsnfs" event={"ID":"e25ac8bd-7a71-4a0a-8742-2acfd1e5d7c1","Type":"ContainerStarted","Data":"f91b15d8f6e0c2bc8d175cbd074e4e71f0a5202a2287c978cdb22f2968bf647a"} Jul 12 19:30:11.554572 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:11.554385 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-qsnfs" Jul 12 19:30:11.569660 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:11.569610 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-qsnfs" podStartSLOduration=1.997136633 podStartE2EDuration="6.569596103s" totalImagesPullingTime="4.57245947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:30:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:30:11.567186123 +0000 UTC m=+483.021779086" watchObservedRunningTime="2026-07-12 19:30:11.569596103 +0000 UTC m=+483.024189066" Jul 12 19:30:17.589625 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:17.589594 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-qsnfs" Jul 12 19:30:19.006149 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:19.006112 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc25vsbv"] Jul 12 19:30:19.030252 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:19.030222 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc25vsbv"] Jul 12 19:30:19.030400 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:19.030338 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc25vsbv" Jul 12 19:30:19.032924 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:19.032890 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 12 19:30:19.032924 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:19.032915 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-jxbgx\"" Jul 12 19:30:19.033150 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:19.032890 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 12 19:30:19.106903 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:19.106876 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f61b056-3538-4f71-a36c-6b8433e7d3be-bundle\") pod \"2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc25vsbv\" (UID: \"3f61b056-3538-4f71-a36c-6b8433e7d3be\") " pod="openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc25vsbv" Jul 12 19:30:19.107061 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:19.106913 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f61b056-3538-4f71-a36c-6b8433e7d3be-util\") pod \"2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc25vsbv\" (UID: \"3f61b056-3538-4f71-a36c-6b8433e7d3be\") " pod="openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc25vsbv" Jul 12 19:30:19.107111 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:19.107059 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tsglv\" (UniqueName: \"kubernetes.io/projected/3f61b056-3538-4f71-a36c-6b8433e7d3be-kube-api-access-tsglv\") pod \"2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc25vsbv\" (UID: \"3f61b056-3538-4f71-a36c-6b8433e7d3be\") " pod="openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc25vsbv" Jul 12 19:30:19.208240 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:19.208213 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tsglv\" (UniqueName: \"kubernetes.io/projected/3f61b056-3538-4f71-a36c-6b8433e7d3be-kube-api-access-tsglv\") pod \"2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc25vsbv\" (UID: \"3f61b056-3538-4f71-a36c-6b8433e7d3be\") " pod="openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc25vsbv" Jul 12 19:30:19.208412 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:19.208263 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f61b056-3538-4f71-a36c-6b8433e7d3be-bundle\") pod \"2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc25vsbv\" (UID: \"3f61b056-3538-4f71-a36c-6b8433e7d3be\") " pod="openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc25vsbv" Jul 12 19:30:19.208412 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:19.208284 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f61b056-3538-4f71-a36c-6b8433e7d3be-util\") pod \"2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc25vsbv\" (UID: \"3f61b056-3538-4f71-a36c-6b8433e7d3be\") " pod="openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc25vsbv" Jul 12 19:30:19.208596 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:19.208580 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f61b056-3538-4f71-a36c-6b8433e7d3be-util\") pod \"2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc25vsbv\" (UID: \"3f61b056-3538-4f71-a36c-6b8433e7d3be\") " pod="openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc25vsbv" Jul 12 19:30:19.208639 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:19.208620 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f61b056-3538-4f71-a36c-6b8433e7d3be-bundle\") pod \"2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc25vsbv\" (UID: \"3f61b056-3538-4f71-a36c-6b8433e7d3be\") " pod="openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc25vsbv" Jul 12 19:30:19.215675 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:19.215649 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tsglv\" (UniqueName: \"kubernetes.io/projected/3f61b056-3538-4f71-a36c-6b8433e7d3be-kube-api-access-tsglv\") pod \"2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc25vsbv\" (UID: \"3f61b056-3538-4f71-a36c-6b8433e7d3be\") " pod="openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc25vsbv" Jul 12 19:30:19.340411 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:19.340335 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc25vsbv" Jul 12 19:30:19.498168 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:19.498126 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc25vsbv"] Jul 12 19:30:19.500375 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:30:19.500345 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f61b056_3538_4f71_a36c_6b8433e7d3be.slice/crio-2ff71c072ad8ceb3defa4784d8c1cf8ffcde6c864d44007beba8a70b609de3d6 WatchSource:0}: Error finding container 2ff71c072ad8ceb3defa4784d8c1cf8ffcde6c864d44007beba8a70b609de3d6: Status 404 returned error can't find the container with id 2ff71c072ad8ceb3defa4784d8c1cf8ffcde6c864d44007beba8a70b609de3d6 Jul 12 19:30:19.605504 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:19.605448 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc25vsbv" event={"ID":"3f61b056-3538-4f71-a36c-6b8433e7d3be","Type":"ContainerStarted","Data":"2ff71c072ad8ceb3defa4784d8c1cf8ffcde6c864d44007beba8a70b609de3d6"} Jul 12 19:30:20.612796 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:20.612717 2576 generic.go:356] "Generic (PLEG): container finished" podID="3f61b056-3538-4f71-a36c-6b8433e7d3be" containerID="eb7ae4e24b40d339c2b8ae6a946834709df9a1f1c159989b962b3249e092f532" exitCode=0 Jul 12 19:30:20.613163 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:20.612812 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc25vsbv" event={"ID":"3f61b056-3538-4f71-a36c-6b8433e7d3be","Type":"ContainerDied","Data":"eb7ae4e24b40d339c2b8ae6a946834709df9a1f1c159989b962b3249e092f532"} Jul 12 19:30:22.625542 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:22.625507 2576 generic.go:356] "Generic (PLEG): container finished" podID="3f61b056-3538-4f71-a36c-6b8433e7d3be" containerID="964c05f5999c3b67ad1618f2cda512920bff14cacd1c595e5fcbb2a862c8a395" exitCode=0 Jul 12 19:30:22.625936 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:22.625589 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc25vsbv" event={"ID":"3f61b056-3538-4f71-a36c-6b8433e7d3be","Type":"ContainerDied","Data":"964c05f5999c3b67ad1618f2cda512920bff14cacd1c595e5fcbb2a862c8a395"} Jul 12 19:30:23.633286 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:23.633254 2576 generic.go:356] "Generic (PLEG): container finished" podID="3f61b056-3538-4f71-a36c-6b8433e7d3be" containerID="9a2d8b42a716061e03994e8e6a0e927f54c67d6551b339b1789defb3a51e4eb2" exitCode=0 Jul 12 19:30:23.633674 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:23.633343 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc25vsbv" event={"ID":"3f61b056-3538-4f71-a36c-6b8433e7d3be","Type":"ContainerDied","Data":"9a2d8b42a716061e03994e8e6a0e927f54c67d6551b339b1789defb3a51e4eb2"} Jul 12 19:30:24.824848 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:24.824820 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc25vsbv" Jul 12 19:30:24.958617 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:24.958590 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f61b056-3538-4f71-a36c-6b8433e7d3be-bundle\") pod \"3f61b056-3538-4f71-a36c-6b8433e7d3be\" (UID: \"3f61b056-3538-4f71-a36c-6b8433e7d3be\") " Jul 12 19:30:24.958800 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:24.958627 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tsglv\" (UniqueName: \"kubernetes.io/projected/3f61b056-3538-4f71-a36c-6b8433e7d3be-kube-api-access-tsglv\") pod \"3f61b056-3538-4f71-a36c-6b8433e7d3be\" (UID: \"3f61b056-3538-4f71-a36c-6b8433e7d3be\") " Jul 12 19:30:24.958800 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:24.958723 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f61b056-3538-4f71-a36c-6b8433e7d3be-util\") pod \"3f61b056-3538-4f71-a36c-6b8433e7d3be\" (UID: \"3f61b056-3538-4f71-a36c-6b8433e7d3be\") " Jul 12 19:30:24.959217 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:24.959193 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f61b056-3538-4f71-a36c-6b8433e7d3be-bundle" (OuterVolumeSpecName: "bundle") pod "3f61b056-3538-4f71-a36c-6b8433e7d3be" (UID: "3f61b056-3538-4f71-a36c-6b8433e7d3be"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:30:24.960780 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:24.960757 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f61b056-3538-4f71-a36c-6b8433e7d3be-kube-api-access-tsglv" (OuterVolumeSpecName: "kube-api-access-tsglv") pod "3f61b056-3538-4f71-a36c-6b8433e7d3be" (UID: "3f61b056-3538-4f71-a36c-6b8433e7d3be"). InnerVolumeSpecName "kube-api-access-tsglv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:30:25.059904 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:25.059875 2576 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/3f61b056-3538-4f71-a36c-6b8433e7d3be-bundle\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:30:25.059904 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:25.059898 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tsglv\" (UniqueName: \"kubernetes.io/projected/3f61b056-3538-4f71-a36c-6b8433e7d3be-kube-api-access-tsglv\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:30:25.303681 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:25.303600 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f61b056-3538-4f71-a36c-6b8433e7d3be-util" (OuterVolumeSpecName: "util") pod "3f61b056-3538-4f71-a36c-6b8433e7d3be" (UID: "3f61b056-3538-4f71-a36c-6b8433e7d3be"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:30:25.362523 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:25.362488 2576 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/3f61b056-3538-4f71-a36c-6b8433e7d3be-util\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:30:25.645474 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:25.645395 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc25vsbv" Jul 12 19:30:25.645474 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:25.645425 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/2d80345626a6f031a751137ed3b37d75aafa28e61d87069d3be6c52fc25vsbv" event={"ID":"3f61b056-3538-4f71-a36c-6b8433e7d3be","Type":"ContainerDied","Data":"2ff71c072ad8ceb3defa4784d8c1cf8ffcde6c864d44007beba8a70b609de3d6"} Jul 12 19:30:25.645474 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:25.645470 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2ff71c072ad8ceb3defa4784d8c1cf8ffcde6c864d44007beba8a70b609de3d6" Jul 12 19:30:31.865459 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:31.865423 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-5c644dc57d-xzsll"] Jul 12 19:30:31.865846 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:31.865807 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f61b056-3538-4f71-a36c-6b8433e7d3be" containerName="pull" Jul 12 19:30:31.865846 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:31.865817 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f61b056-3538-4f71-a36c-6b8433e7d3be" containerName="pull" Jul 12 19:30:31.865846 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:31.865832 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f61b056-3538-4f71-a36c-6b8433e7d3be" containerName="extract" Jul 12 19:30:31.865846 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:31.865838 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f61b056-3538-4f71-a36c-6b8433e7d3be" containerName="extract" Jul 12 19:30:31.865977 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:31.865853 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f61b056-3538-4f71-a36c-6b8433e7d3be" containerName="util" Jul 12 19:30:31.865977 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:31.865859 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f61b056-3538-4f71-a36c-6b8433e7d3be" containerName="util" Jul 12 19:30:31.865977 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:31.865916 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f61b056-3538-4f71-a36c-6b8433e7d3be" containerName="extract" Jul 12 19:30:31.868321 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:31.868302 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-5c644dc57d-xzsll" Jul 12 19:30:31.870386 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:31.870359 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jul 12 19:30:31.871148 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:31.871133 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-kckqq\"" Jul 12 19:30:31.871215 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:31.871161 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jul 12 19:30:31.877867 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:31.877843 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-5c644dc57d-xzsll"] Jul 12 19:30:32.020361 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:32.020332 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dn97c\" (UniqueName: \"kubernetes.io/projected/2b871d27-5168-49e2-aeca-2c2c825fce90-kube-api-access-dn97c\") pod \"keycloak-operator-5c644dc57d-xzsll\" (UID: \"2b871d27-5168-49e2-aeca-2c2c825fce90\") " pod="keycloak-system/keycloak-operator-5c644dc57d-xzsll" Jul 12 19:30:32.121094 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:32.121017 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dn97c\" (UniqueName: \"kubernetes.io/projected/2b871d27-5168-49e2-aeca-2c2c825fce90-kube-api-access-dn97c\") pod \"keycloak-operator-5c644dc57d-xzsll\" (UID: \"2b871d27-5168-49e2-aeca-2c2c825fce90\") " pod="keycloak-system/keycloak-operator-5c644dc57d-xzsll" Jul 12 19:30:32.128318 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:32.128284 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dn97c\" (UniqueName: \"kubernetes.io/projected/2b871d27-5168-49e2-aeca-2c2c825fce90-kube-api-access-dn97c\") pod \"keycloak-operator-5c644dc57d-xzsll\" (UID: \"2b871d27-5168-49e2-aeca-2c2c825fce90\") " pod="keycloak-system/keycloak-operator-5c644dc57d-xzsll" Jul 12 19:30:32.179999 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:32.179971 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-5c644dc57d-xzsll" Jul 12 19:30:32.303705 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:32.303684 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-5c644dc57d-xzsll"] Jul 12 19:30:32.306057 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:30:32.306029 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b871d27_5168_49e2_aeca_2c2c825fce90.slice/crio-4f7ca025aa66e5800ff7f39a34293df9c8e03bfb180d3ad5a37452ff295e428a WatchSource:0}: Error finding container 4f7ca025aa66e5800ff7f39a34293df9c8e03bfb180d3ad5a37452ff295e428a: Status 404 returned error can't find the container with id 4f7ca025aa66e5800ff7f39a34293df9c8e03bfb180d3ad5a37452ff295e428a Jul 12 19:30:32.682777 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:32.682748 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-5c644dc57d-xzsll" event={"ID":"2b871d27-5168-49e2-aeca-2c2c825fce90","Type":"ContainerStarted","Data":"4f7ca025aa66e5800ff7f39a34293df9c8e03bfb180d3ad5a37452ff295e428a"} Jul 12 19:30:38.731294 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:38.731249 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-5c644dc57d-xzsll" event={"ID":"2b871d27-5168-49e2-aeca-2c2c825fce90","Type":"ContainerStarted","Data":"729bfdc637506f88f49c7a6adcfa85f1d501bc112d2d11bd30bc9eb60c1e37f8"} Jul 12 19:30:38.746667 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:30:38.746619 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-5c644dc57d-xzsll" podStartSLOduration=2.054747615 podStartE2EDuration="7.746603368s" totalImagesPullingTime="5.691855753s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:30:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:30:38.745320752 +0000 UTC m=+510.199913716" watchObservedRunningTime="2026-07-12 19:30:38.746603368 +0000 UTC m=+510.201196331" Jul 12 19:31:18.146161 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:18.146075 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4b5l2"] Jul 12 19:31:18.153243 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:18.153216 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4b5l2" Jul 12 19:31:18.155629 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:18.155599 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4b5l2"] Jul 12 19:31:18.242028 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:18.241971 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cthqn\" (UniqueName: \"kubernetes.io/projected/c088ccae-4087-446b-8054-614e9551c949-kube-api-access-cthqn\") pod \"authorino-5d4b67c446-4b5l2\" (UID: \"c088ccae-4087-446b-8054-614e9551c949\") " pod="kuadrant-system/authorino-5d4b67c446-4b5l2" Jul 12 19:31:18.323541 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:18.323503 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4b5l2"] Jul 12 19:31:18.323812 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:31:18.323790 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-cthqn], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-4b5l2" podUID="c088ccae-4087-446b-8054-614e9551c949" Jul 12 19:31:18.343063 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:18.343032 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cthqn\" (UniqueName: \"kubernetes.io/projected/c088ccae-4087-446b-8054-614e9551c949-kube-api-access-cthqn\") pod \"authorino-5d4b67c446-4b5l2\" (UID: \"c088ccae-4087-446b-8054-614e9551c949\") " pod="kuadrant-system/authorino-5d4b67c446-4b5l2" Jul 12 19:31:18.344426 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:18.344405 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-76877994-mtdcv"] Jul 12 19:31:18.346793 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:18.346773 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-mtdcv" Jul 12 19:31:18.349036 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:18.349013 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 12 19:31:18.352570 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:18.352548 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cthqn\" (UniqueName: \"kubernetes.io/projected/c088ccae-4087-446b-8054-614e9551c949-kube-api-access-cthqn\") pod \"authorino-5d4b67c446-4b5l2\" (UID: \"c088ccae-4087-446b-8054-614e9551c949\") " pod="kuadrant-system/authorino-5d4b67c446-4b5l2" Jul 12 19:31:18.354974 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:18.354952 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-76877994-mtdcv"] Jul 12 19:31:18.401533 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:18.401459 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-mtdcv"] Jul 12 19:31:18.401733 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:31:18.401715 2576 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-wq4qx tls-cert], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-76877994-mtdcv" podUID="150cdaef-811c-4a9d-877f-cdac3cb890aa" Jul 12 19:31:18.428215 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:18.428187 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7b57ddb64b-bb54p"] Jul 12 19:31:18.430396 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:18.430378 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b57ddb64b-bb54p" Jul 12 19:31:18.440339 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:18.440316 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b57ddb64b-bb54p"] Jul 12 19:31:18.443621 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:18.443598 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/150cdaef-811c-4a9d-877f-cdac3cb890aa-tls-cert\") pod \"authorino-76877994-mtdcv\" (UID: \"150cdaef-811c-4a9d-877f-cdac3cb890aa\") " pod="kuadrant-system/authorino-76877994-mtdcv" Jul 12 19:31:18.443704 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:18.443692 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wq4qx\" (UniqueName: \"kubernetes.io/projected/150cdaef-811c-4a9d-877f-cdac3cb890aa-kube-api-access-wq4qx\") pod \"authorino-76877994-mtdcv\" (UID: \"150cdaef-811c-4a9d-877f-cdac3cb890aa\") " pod="kuadrant-system/authorino-76877994-mtdcv" Jul 12 19:31:18.544931 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:18.544892 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/150cdaef-811c-4a9d-877f-cdac3cb890aa-tls-cert\") pod \"authorino-76877994-mtdcv\" (UID: \"150cdaef-811c-4a9d-877f-cdac3cb890aa\") " pod="kuadrant-system/authorino-76877994-mtdcv" Jul 12 19:31:18.545116 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:18.544978 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/07bd600a-3377-4d51-babc-ec1f7665ef51-tls-cert\") pod \"authorino-7b57ddb64b-bb54p\" (UID: \"07bd600a-3377-4d51-babc-ec1f7665ef51\") " pod="kuadrant-system/authorino-7b57ddb64b-bb54p" Jul 12 19:31:18.545116 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:18.545031 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wq4qx\" (UniqueName: \"kubernetes.io/projected/150cdaef-811c-4a9d-877f-cdac3cb890aa-kube-api-access-wq4qx\") pod \"authorino-76877994-mtdcv\" (UID: \"150cdaef-811c-4a9d-877f-cdac3cb890aa\") " pod="kuadrant-system/authorino-76877994-mtdcv" Jul 12 19:31:18.545116 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:18.545055 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfjpp\" (UniqueName: \"kubernetes.io/projected/07bd600a-3377-4d51-babc-ec1f7665ef51-kube-api-access-gfjpp\") pod \"authorino-7b57ddb64b-bb54p\" (UID: \"07bd600a-3377-4d51-babc-ec1f7665ef51\") " pod="kuadrant-system/authorino-7b57ddb64b-bb54p" Jul 12 19:31:18.547434 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:18.547402 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/150cdaef-811c-4a9d-877f-cdac3cb890aa-tls-cert\") pod \"authorino-76877994-mtdcv\" (UID: \"150cdaef-811c-4a9d-877f-cdac3cb890aa\") " pod="kuadrant-system/authorino-76877994-mtdcv" Jul 12 19:31:18.552820 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:18.552798 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wq4qx\" (UniqueName: \"kubernetes.io/projected/150cdaef-811c-4a9d-877f-cdac3cb890aa-kube-api-access-wq4qx\") pod \"authorino-76877994-mtdcv\" (UID: \"150cdaef-811c-4a9d-877f-cdac3cb890aa\") " pod="kuadrant-system/authorino-76877994-mtdcv" Jul 12 19:31:18.645510 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:18.645471 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/07bd600a-3377-4d51-babc-ec1f7665ef51-tls-cert\") pod \"authorino-7b57ddb64b-bb54p\" (UID: \"07bd600a-3377-4d51-babc-ec1f7665ef51\") " pod="kuadrant-system/authorino-7b57ddb64b-bb54p" Jul 12 19:31:18.645510 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:18.645511 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfjpp\" (UniqueName: \"kubernetes.io/projected/07bd600a-3377-4d51-babc-ec1f7665ef51-kube-api-access-gfjpp\") pod \"authorino-7b57ddb64b-bb54p\" (UID: \"07bd600a-3377-4d51-babc-ec1f7665ef51\") " pod="kuadrant-system/authorino-7b57ddb64b-bb54p" Jul 12 19:31:18.647921 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:18.647891 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/07bd600a-3377-4d51-babc-ec1f7665ef51-tls-cert\") pod \"authorino-7b57ddb64b-bb54p\" (UID: \"07bd600a-3377-4d51-babc-ec1f7665ef51\") " pod="kuadrant-system/authorino-7b57ddb64b-bb54p" Jul 12 19:31:18.652890 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:18.652830 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfjpp\" (UniqueName: \"kubernetes.io/projected/07bd600a-3377-4d51-babc-ec1f7665ef51-kube-api-access-gfjpp\") pod \"authorino-7b57ddb64b-bb54p\" (UID: \"07bd600a-3377-4d51-babc-ec1f7665ef51\") " pod="kuadrant-system/authorino-7b57ddb64b-bb54p" Jul 12 19:31:18.739838 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:18.739804 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b57ddb64b-bb54p" Jul 12 19:31:18.868421 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:18.868396 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7b57ddb64b-bb54p"] Jul 12 19:31:18.870026 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:31:18.870000 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod07bd600a_3377_4d51_babc_ec1f7665ef51.slice/crio-90097c468e726947a34d5567e8bd8445d58a88629c8ffc487c27f4894382d2ea WatchSource:0}: Error finding container 90097c468e726947a34d5567e8bd8445d58a88629c8ffc487c27f4894382d2ea: Status 404 returned error can't find the container with id 90097c468e726947a34d5567e8bd8445d58a88629c8ffc487c27f4894382d2ea Jul 12 19:31:18.954590 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:18.954550 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b57ddb64b-bb54p" event={"ID":"07bd600a-3377-4d51-babc-ec1f7665ef51","Type":"ContainerStarted","Data":"90097c468e726947a34d5567e8bd8445d58a88629c8ffc487c27f4894382d2ea"} Jul 12 19:31:18.954590 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:18.954580 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-mtdcv" Jul 12 19:31:18.954828 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:18.954581 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4b5l2" Jul 12 19:31:18.961607 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:18.961586 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-mtdcv" Jul 12 19:31:18.964027 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:18.964010 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4b5l2" Jul 12 19:31:19.049511 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:19.049477 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cthqn\" (UniqueName: \"kubernetes.io/projected/c088ccae-4087-446b-8054-614e9551c949-kube-api-access-cthqn\") pod \"c088ccae-4087-446b-8054-614e9551c949\" (UID: \"c088ccae-4087-446b-8054-614e9551c949\") " Jul 12 19:31:19.049713 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:19.049573 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/150cdaef-811c-4a9d-877f-cdac3cb890aa-tls-cert\") pod \"150cdaef-811c-4a9d-877f-cdac3cb890aa\" (UID: \"150cdaef-811c-4a9d-877f-cdac3cb890aa\") " Jul 12 19:31:19.049713 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:19.049660 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wq4qx\" (UniqueName: \"kubernetes.io/projected/150cdaef-811c-4a9d-877f-cdac3cb890aa-kube-api-access-wq4qx\") pod \"150cdaef-811c-4a9d-877f-cdac3cb890aa\" (UID: \"150cdaef-811c-4a9d-877f-cdac3cb890aa\") " Jul 12 19:31:19.051663 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:19.051632 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/150cdaef-811c-4a9d-877f-cdac3cb890aa-kube-api-access-wq4qx" (OuterVolumeSpecName: "kube-api-access-wq4qx") pod "150cdaef-811c-4a9d-877f-cdac3cb890aa" (UID: "150cdaef-811c-4a9d-877f-cdac3cb890aa"). InnerVolumeSpecName "kube-api-access-wq4qx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:31:19.051767 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:19.051639 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/150cdaef-811c-4a9d-877f-cdac3cb890aa-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "150cdaef-811c-4a9d-877f-cdac3cb890aa" (UID: "150cdaef-811c-4a9d-877f-cdac3cb890aa"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 19:31:19.051767 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:19.051690 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c088ccae-4087-446b-8054-614e9551c949-kube-api-access-cthqn" (OuterVolumeSpecName: "kube-api-access-cthqn") pod "c088ccae-4087-446b-8054-614e9551c949" (UID: "c088ccae-4087-446b-8054-614e9551c949"). InnerVolumeSpecName "kube-api-access-cthqn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:31:19.151222 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:19.151195 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wq4qx\" (UniqueName: \"kubernetes.io/projected/150cdaef-811c-4a9d-877f-cdac3cb890aa-kube-api-access-wq4qx\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:31:19.151222 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:19.151219 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cthqn\" (UniqueName: \"kubernetes.io/projected/c088ccae-4087-446b-8054-614e9551c949-kube-api-access-cthqn\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:31:19.151611 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:19.151233 2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/150cdaef-811c-4a9d-877f-cdac3cb890aa-tls-cert\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:31:19.961470 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:19.961435 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b57ddb64b-bb54p" event={"ID":"07bd600a-3377-4d51-babc-ec1f7665ef51","Type":"ContainerStarted","Data":"21c3399794c438bbfe396a0907d3c224e1a0f7fc15751d2b186025bb169dac54"} Jul 12 19:31:19.961470 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:19.961455 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-4b5l2" Jul 12 19:31:19.961684 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:19.961627 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-76877994-mtdcv" Jul 12 19:31:19.980013 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:19.977594 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7b57ddb64b-bb54p" podStartSLOduration=1.400880766 podStartE2EDuration="1.9775764s" totalImagesPullingTime="576.695634ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:31:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:31:19.974119996 +0000 UTC m=+551.428712959" watchObservedRunningTime="2026-07-12 19:31:19.9775764 +0000 UTC m=+551.432169364" Jul 12 19:31:19.998975 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:19.998943 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zz84p"] Jul 12 19:31:19.999185 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:19.999156 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-zz84p" podUID="51e32f12-c37f-41c3-9672-fe2d5c0efea5" containerName="authorino" containerID="cri-o://3773919da71b68f7d7edf7115844d47da02bc1629bd4230d18cafbaf6ce55b55" gracePeriod=30 Jul 12 19:31:20.007382 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:20.007354 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4b5l2"] Jul 12 19:31:20.009904 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:20.009881 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-4b5l2"] Jul 12 19:31:20.030336 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:20.030314 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-76877994-mtdcv"] Jul 12 19:31:20.032438 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:20.032416 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-76877994-mtdcv"] Jul 12 19:31:20.239625 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:20.239602 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zz84p" Jul 12 19:31:20.362244 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:20.362217 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mz84\" (UniqueName: \"kubernetes.io/projected/51e32f12-c37f-41c3-9672-fe2d5c0efea5-kube-api-access-5mz84\") pod \"51e32f12-c37f-41c3-9672-fe2d5c0efea5\" (UID: \"51e32f12-c37f-41c3-9672-fe2d5c0efea5\") " Jul 12 19:31:20.364303 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:20.364281 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51e32f12-c37f-41c3-9672-fe2d5c0efea5-kube-api-access-5mz84" (OuterVolumeSpecName: "kube-api-access-5mz84") pod "51e32f12-c37f-41c3-9672-fe2d5c0efea5" (UID: "51e32f12-c37f-41c3-9672-fe2d5c0efea5"). InnerVolumeSpecName "kube-api-access-5mz84". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:31:20.463846 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:20.463816 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mz84\" (UniqueName: \"kubernetes.io/projected/51e32f12-c37f-41c3-9672-fe2d5c0efea5-kube-api-access-5mz84\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:31:20.968115 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:20.968085 2576 generic.go:356] "Generic (PLEG): container finished" podID="51e32f12-c37f-41c3-9672-fe2d5c0efea5" containerID="3773919da71b68f7d7edf7115844d47da02bc1629bd4230d18cafbaf6ce55b55" exitCode=0 Jul 12 19:31:20.968289 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:20.968139 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zz84p" Jul 12 19:31:20.968289 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:20.968157 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zz84p" event={"ID":"51e32f12-c37f-41c3-9672-fe2d5c0efea5","Type":"ContainerDied","Data":"3773919da71b68f7d7edf7115844d47da02bc1629bd4230d18cafbaf6ce55b55"} Jul 12 19:31:20.968289 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:20.968205 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zz84p" event={"ID":"51e32f12-c37f-41c3-9672-fe2d5c0efea5","Type":"ContainerDied","Data":"ff3ae3d160cf7ed9749cea0fe76ba570ee19551f9a2b24d21c338c8a819bc63f"} Jul 12 19:31:20.968289 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:20.968227 2576 scope.go:117] "RemoveContainer" containerID="3773919da71b68f7d7edf7115844d47da02bc1629bd4230d18cafbaf6ce55b55" Jul 12 19:31:20.979761 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:20.979739 2576 scope.go:117] "RemoveContainer" containerID="3773919da71b68f7d7edf7115844d47da02bc1629bd4230d18cafbaf6ce55b55" Jul 12 19:31:20.980033 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:31:20.980012 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3773919da71b68f7d7edf7115844d47da02bc1629bd4230d18cafbaf6ce55b55\": container with ID starting with 3773919da71b68f7d7edf7115844d47da02bc1629bd4230d18cafbaf6ce55b55 not found: ID does not exist" containerID="3773919da71b68f7d7edf7115844d47da02bc1629bd4230d18cafbaf6ce55b55" Jul 12 19:31:20.980098 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:20.980042 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3773919da71b68f7d7edf7115844d47da02bc1629bd4230d18cafbaf6ce55b55"} err="failed to get container status \"3773919da71b68f7d7edf7115844d47da02bc1629bd4230d18cafbaf6ce55b55\": rpc error: code = NotFound desc = could not find container \"3773919da71b68f7d7edf7115844d47da02bc1629bd4230d18cafbaf6ce55b55\": container with ID starting with 3773919da71b68f7d7edf7115844d47da02bc1629bd4230d18cafbaf6ce55b55 not found: ID does not exist" Jul 12 19:31:20.989040 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:20.989020 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zz84p"] Jul 12 19:31:20.992074 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:20.992054 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zz84p"] Jul 12 19:31:21.083935 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:21.083906 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="150cdaef-811c-4a9d-877f-cdac3cb890aa" path="/var/lib/kubelet/pods/150cdaef-811c-4a9d-877f-cdac3cb890aa/volumes" Jul 12 19:31:21.084160 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:21.084146 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51e32f12-c37f-41c3-9672-fe2d5c0efea5" path="/var/lib/kubelet/pods/51e32f12-c37f-41c3-9672-fe2d5c0efea5/volumes" Jul 12 19:31:21.084433 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:21.084421 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c088ccae-4087-446b-8054-614e9551c949" path="/var/lib/kubelet/pods/c088ccae-4087-446b-8054-614e9551c949/volumes" Jul 12 19:31:58.017467 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:58.017429 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-8vnxf"] Jul 12 19:31:58.018180 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:58.018061 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51e32f12-c37f-41c3-9672-fe2d5c0efea5" containerName="authorino" Jul 12 19:31:58.018180 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:58.018085 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="51e32f12-c37f-41c3-9672-fe2d5c0efea5" containerName="authorino" Jul 12 19:31:58.018330 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:58.018183 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="51e32f12-c37f-41c3-9672-fe2d5c0efea5" containerName="authorino" Jul 12 19:31:58.021515 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:58.021494 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-8vnxf" Jul 12 19:31:58.023520 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:58.023494 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 12 19:31:58.029265 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:58.029233 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-8vnxf"] Jul 12 19:31:58.077265 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:58.077232 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-slbvp"] Jul 12 19:31:58.080960 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:58.080938 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bbcb654f4-slbvp" Jul 12 19:31:58.083064 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:58.083040 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-4gvvp\"" Jul 12 19:31:58.088595 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:58.088571 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-slbvp"] Jul 12 19:31:58.100817 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:58.100794 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87f2d86e-ac38-4086-a8b9-0eb0ed99c444-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-8vnxf\" (UID: \"87f2d86e-ac38-4086-a8b9-0eb0ed99c444\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-8vnxf" Jul 12 19:31:58.100933 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:58.100838 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m82v6\" (UniqueName: \"kubernetes.io/projected/87f2d86e-ac38-4086-a8b9-0eb0ed99c444-kube-api-access-m82v6\") pod \"payload-pre-processing-59f49fd4f6-8vnxf\" (UID: \"87f2d86e-ac38-4086-a8b9-0eb0ed99c444\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-8vnxf" Jul 12 19:31:58.202395 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:58.202362 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87f2d86e-ac38-4086-a8b9-0eb0ed99c444-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-8vnxf\" (UID: \"87f2d86e-ac38-4086-a8b9-0eb0ed99c444\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-8vnxf" Jul 12 19:31:58.202395 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:58.202401 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/afe113f3-d8a5-42b9-a0d6-11d267c72959-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-slbvp\" (UID: \"afe113f3-d8a5-42b9-a0d6-11d267c72959\") " pod="openshift-ingress/payload-processing-7bbcb654f4-slbvp" Jul 12 19:31:58.202662 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:58.202442 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m82v6\" (UniqueName: \"kubernetes.io/projected/87f2d86e-ac38-4086-a8b9-0eb0ed99c444-kube-api-access-m82v6\") pod \"payload-pre-processing-59f49fd4f6-8vnxf\" (UID: \"87f2d86e-ac38-4086-a8b9-0eb0ed99c444\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-8vnxf" Jul 12 19:31:58.202662 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:58.202471 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ff8l7\" (UniqueName: \"kubernetes.io/projected/afe113f3-d8a5-42b9-a0d6-11d267c72959-kube-api-access-ff8l7\") pod \"payload-processing-7bbcb654f4-slbvp\" (UID: \"afe113f3-d8a5-42b9-a0d6-11d267c72959\") " pod="openshift-ingress/payload-processing-7bbcb654f4-slbvp" Jul 12 19:31:58.203489 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:58.203462 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/87f2d86e-ac38-4086-a8b9-0eb0ed99c444-plugins-config-volume\") pod \"payload-pre-processing-59f49fd4f6-8vnxf\" (UID: \"87f2d86e-ac38-4086-a8b9-0eb0ed99c444\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-8vnxf" Jul 12 19:31:58.209806 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:58.209781 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m82v6\" (UniqueName: \"kubernetes.io/projected/87f2d86e-ac38-4086-a8b9-0eb0ed99c444-kube-api-access-m82v6\") pod \"payload-pre-processing-59f49fd4f6-8vnxf\" (UID: \"87f2d86e-ac38-4086-a8b9-0eb0ed99c444\") " pod="openshift-ingress/payload-pre-processing-59f49fd4f6-8vnxf" Jul 12 19:31:58.304016 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:58.303895 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/afe113f3-d8a5-42b9-a0d6-11d267c72959-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-slbvp\" (UID: \"afe113f3-d8a5-42b9-a0d6-11d267c72959\") " pod="openshift-ingress/payload-processing-7bbcb654f4-slbvp" Jul 12 19:31:58.304016 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:58.303971 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ff8l7\" (UniqueName: \"kubernetes.io/projected/afe113f3-d8a5-42b9-a0d6-11d267c72959-kube-api-access-ff8l7\") pod \"payload-processing-7bbcb654f4-slbvp\" (UID: \"afe113f3-d8a5-42b9-a0d6-11d267c72959\") " pod="openshift-ingress/payload-processing-7bbcb654f4-slbvp" Jul 12 19:31:58.304730 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:58.304709 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/afe113f3-d8a5-42b9-a0d6-11d267c72959-plugins-config-volume\") pod \"payload-processing-7bbcb654f4-slbvp\" (UID: \"afe113f3-d8a5-42b9-a0d6-11d267c72959\") " pod="openshift-ingress/payload-processing-7bbcb654f4-slbvp" Jul 12 19:31:58.311581 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:58.311555 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ff8l7\" (UniqueName: \"kubernetes.io/projected/afe113f3-d8a5-42b9-a0d6-11d267c72959-kube-api-access-ff8l7\") pod \"payload-processing-7bbcb654f4-slbvp\" (UID: \"afe113f3-d8a5-42b9-a0d6-11d267c72959\") " pod="openshift-ingress/payload-processing-7bbcb654f4-slbvp" Jul 12 19:31:58.335291 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:58.335261 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-8vnxf" Jul 12 19:31:58.392412 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:58.392380 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-7bbcb654f4-slbvp" Jul 12 19:31:58.481767 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:31:58.481729 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87f2d86e_ac38_4086_a8b9_0eb0ed99c444.slice/crio-599522a2d4b6e2d2d319d414e589b17b2105d207e1e0c201a1ef9e65e2c67b4e WatchSource:0}: Error finding container 599522a2d4b6e2d2d319d414e589b17b2105d207e1e0c201a1ef9e65e2c67b4e: Status 404 returned error can't find the container with id 599522a2d4b6e2d2d319d414e589b17b2105d207e1e0c201a1ef9e65e2c67b4e Jul 12 19:31:58.482181 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:58.482149 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-59f49fd4f6-8vnxf"] Jul 12 19:31:58.556774 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:58.556741 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-7bbcb654f4-slbvp"] Jul 12 19:31:58.558901 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:31:58.558874 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podafe113f3_d8a5_42b9_a0d6_11d267c72959.slice/crio-75114a17b55a31eee511ee0edee25fca7f42fc6b14152f53a3c04b0aa54e3b63 WatchSource:0}: Error finding container 75114a17b55a31eee511ee0edee25fca7f42fc6b14152f53a3c04b0aa54e3b63: Status 404 returned error can't find the container with id 75114a17b55a31eee511ee0edee25fca7f42fc6b14152f53a3c04b0aa54e3b63 Jul 12 19:31:59.177844 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:59.177751 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-8vnxf" event={"ID":"87f2d86e-ac38-4086-a8b9-0eb0ed99c444","Type":"ContainerStarted","Data":"599522a2d4b6e2d2d319d414e589b17b2105d207e1e0c201a1ef9e65e2c67b4e"} Jul 12 19:31:59.180341 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:31:59.180269 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-slbvp" event={"ID":"afe113f3-d8a5-42b9-a0d6-11d267c72959","Type":"ContainerStarted","Data":"75114a17b55a31eee511ee0edee25fca7f42fc6b14152f53a3c04b0aa54e3b63"} Jul 12 19:32:02.200945 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:02.200913 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-7bbcb654f4-slbvp" event={"ID":"afe113f3-d8a5-42b9-a0d6-11d267c72959","Type":"ContainerStarted","Data":"c3e16d5ddf9cc198fd9707a339a6ddb121d05cf0a5173794b7df6684540b2938"} Jul 12 19:32:02.201349 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:02.201319 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-7bbcb654f4-slbvp" Jul 12 19:32:02.202827 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:02.202801 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-8vnxf" event={"ID":"87f2d86e-ac38-4086-a8b9-0eb0ed99c444","Type":"ContainerStarted","Data":"4ff0ccd850c263666313386d6caae2ce5a5f8330e765a2b2c4d0e0da15aaa422"} Jul 12 19:32:02.203075 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:02.203033 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-8vnxf" Jul 12 19:32:02.216025 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:02.215958 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-7bbcb654f4-slbvp" podStartSLOduration=0.920511466 podStartE2EDuration="4.215941372s" totalImagesPullingTime="3.295429906s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:31:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:32:02.214298337 +0000 UTC m=+593.668891300" watchObservedRunningTime="2026-07-12 19:32:02.215941372 +0000 UTC m=+593.670534337" Jul 12 19:32:02.229971 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:02.229919 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-8vnxf" podStartSLOduration=0.863350208 podStartE2EDuration="4.229906939s" totalImagesPullingTime="3.366556731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:31:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:32:02.229477442 +0000 UTC m=+593.684070406" watchObservedRunningTime="2026-07-12 19:32:02.229906939 +0000 UTC m=+593.684499902" Jul 12 19:32:05.438411 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:05.437108 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-888r7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 12 19:32:05.438411 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:05.437182 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" podUID="5465dd47-b0dd-4a80-9db3-b93843ab360b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 12 19:32:06.230142 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:06.230108 2576 generic.go:356] "Generic (PLEG): container finished" podID="5465dd47-b0dd-4a80-9db3-b93843ab360b" containerID="7e413ecf91d83e1c8b58aa8bc9994f84114b15ef8d6360431a8c32ae9c1da381" exitCode=0 Jul 12 19:32:06.230313 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:06.230182 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" event={"ID":"5465dd47-b0dd-4a80-9db3-b93843ab360b","Type":"ContainerDied","Data":"7e413ecf91d83e1c8b58aa8bc9994f84114b15ef8d6360431a8c32ae9c1da381"} Jul 12 19:32:06.230581 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:06.230566 2576 scope.go:117] "RemoveContainer" containerID="7e413ecf91d83e1c8b58aa8bc9994f84114b15ef8d6360431a8c32ae9c1da381" Jul 12 19:32:06.231637 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:06.231605 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 12 19:32:06.231701 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:06.231676 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 12 19:32:06.231741 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:06.231708 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 12 19:32:07.242762 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:07.241844 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" event={"ID":"5465dd47-b0dd-4a80-9db3-b93843ab360b","Type":"ContainerStarted","Data":"1225beea13f72226ea4a4458d511cd8076be785257a56749ab9967551a13f811"} Jul 12 19:32:08.096771 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:08.096738 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" Jul 12 19:32:08.097035 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:08.097013 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-888r7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 12 19:32:08.097128 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:08.097067 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" podUID="5465dd47-b0dd-4a80-9db3-b93843ab360b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 12 19:32:09.074956 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:09.074931 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mj4zs_888aafef-f377-46e3-a36b-58cbabc198f8/ovn-acl-logging/0.log" Jul 12 19:32:09.079256 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:09.079227 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mj4zs_888aafef-f377-46e3-a36b-58cbabc198f8/ovn-acl-logging/0.log" Jul 12 19:32:09.096697 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:09.096672 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-888r7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 12 19:32:09.096829 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:09.096724 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" podUID="5465dd47-b0dd-4a80-9db3-b93843ab360b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 12 19:32:10.096665 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:10.096629 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-888r7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 12 19:32:10.097074 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:10.096695 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" podUID="5465dd47-b0dd-4a80-9db3-b93843ab360b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 12 19:32:11.096216 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:11.096179 2576 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-888r7 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" start-of-body= Jul 12 19:32:11.096386 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:11.096229 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" podUID="5465dd47-b0dd-4a80-9db3-b93843ab360b" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.42:15021/healthz/ready\": dial tcp 10.133.0.42:15021: connect: connection refused" Jul 12 19:32:12.099972 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:12.099943 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" Jul 12 19:32:12.100351 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:12.100221 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" Jul 12 19:32:12.100947 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:12.100933 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-888r7" Jul 12 19:32:13.210962 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:13.210914 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-8vnxf" podUID="87f2d86e-ac38-4086-a8b9-0eb0ed99c444" containerName="payload-pre-processing" probeResult="failure" output="dial tcp 10.133.0.52:9004: connect: connection refused" Jul 12 19:32:13.211399 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:13.211379 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-7bbcb654f4-slbvp" Jul 12 19:32:23.211197 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:23.211164 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-59f49fd4f6-8vnxf" Jul 12 19:32:46.603385 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:46.603355 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-74fb557ddd-zh794"] Jul 12 19:32:46.606924 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:46.606906 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74fb557ddd-zh794" Jul 12 19:32:46.609043 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:46.609026 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jul 12 19:32:46.613890 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:46.613868 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-74fb557ddd-zh794"] Jul 12 19:32:46.763242 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:46.763201 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/9429409f-efcf-46f2-995d-7e41216c86f3-oidc-ca\") pod \"authorino-74fb557ddd-zh794\" (UID: \"9429409f-efcf-46f2-995d-7e41216c86f3\") " pod="kuadrant-system/authorino-74fb557ddd-zh794" Jul 12 19:32:46.763242 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:46.763239 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2rwkh\" (UniqueName: \"kubernetes.io/projected/9429409f-efcf-46f2-995d-7e41216c86f3-kube-api-access-2rwkh\") pod \"authorino-74fb557ddd-zh794\" (UID: \"9429409f-efcf-46f2-995d-7e41216c86f3\") " pod="kuadrant-system/authorino-74fb557ddd-zh794" Jul 12 19:32:46.763432 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:46.763396 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9429409f-efcf-46f2-995d-7e41216c86f3-tls-cert\") pod \"authorino-74fb557ddd-zh794\" (UID: \"9429409f-efcf-46f2-995d-7e41216c86f3\") " pod="kuadrant-system/authorino-74fb557ddd-zh794" Jul 12 19:32:46.864657 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:46.864581 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/9429409f-efcf-46f2-995d-7e41216c86f3-oidc-ca\") pod \"authorino-74fb557ddd-zh794\" (UID: \"9429409f-efcf-46f2-995d-7e41216c86f3\") " pod="kuadrant-system/authorino-74fb557ddd-zh794" Jul 12 19:32:46.864657 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:46.864612 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2rwkh\" (UniqueName: \"kubernetes.io/projected/9429409f-efcf-46f2-995d-7e41216c86f3-kube-api-access-2rwkh\") pod \"authorino-74fb557ddd-zh794\" (UID: \"9429409f-efcf-46f2-995d-7e41216c86f3\") " pod="kuadrant-system/authorino-74fb557ddd-zh794" Jul 12 19:32:46.864829 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:46.864671 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9429409f-efcf-46f2-995d-7e41216c86f3-tls-cert\") pod \"authorino-74fb557ddd-zh794\" (UID: \"9429409f-efcf-46f2-995d-7e41216c86f3\") " pod="kuadrant-system/authorino-74fb557ddd-zh794" Jul 12 19:32:46.865216 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:46.865197 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/9429409f-efcf-46f2-995d-7e41216c86f3-oidc-ca\") pod \"authorino-74fb557ddd-zh794\" (UID: \"9429409f-efcf-46f2-995d-7e41216c86f3\") " pod="kuadrant-system/authorino-74fb557ddd-zh794" Jul 12 19:32:46.866949 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:46.866931 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9429409f-efcf-46f2-995d-7e41216c86f3-tls-cert\") pod \"authorino-74fb557ddd-zh794\" (UID: \"9429409f-efcf-46f2-995d-7e41216c86f3\") " pod="kuadrant-system/authorino-74fb557ddd-zh794" Jul 12 19:32:46.874808 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:46.874758 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2rwkh\" (UniqueName: \"kubernetes.io/projected/9429409f-efcf-46f2-995d-7e41216c86f3-kube-api-access-2rwkh\") pod \"authorino-74fb557ddd-zh794\" (UID: \"9429409f-efcf-46f2-995d-7e41216c86f3\") " pod="kuadrant-system/authorino-74fb557ddd-zh794" Jul 12 19:32:46.917412 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:46.917389 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74fb557ddd-zh794" Jul 12 19:32:47.050317 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:47.050294 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-74fb557ddd-zh794"] Jul 12 19:32:47.052096 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:32:47.052069 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9429409f_efcf_46f2_995d_7e41216c86f3.slice/crio-4542eb9fb9574f256304ba8d0e9c0b18ce66418817d849797950c4542fe13383 WatchSource:0}: Error finding container 4542eb9fb9574f256304ba8d0e9c0b18ce66418817d849797950c4542fe13383: Status 404 returned error can't find the container with id 4542eb9fb9574f256304ba8d0e9c0b18ce66418817d849797950c4542fe13383 Jul 12 19:32:47.480491 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:47.480453 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74fb557ddd-zh794" event={"ID":"9429409f-efcf-46f2-995d-7e41216c86f3","Type":"ContainerStarted","Data":"80e6d62f22a7c85d671f1c366678d63a70493f33ad2ccfb08c071d8d4595022b"} Jul 12 19:32:47.480694 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:47.480509 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74fb557ddd-zh794" event={"ID":"9429409f-efcf-46f2-995d-7e41216c86f3","Type":"ContainerStarted","Data":"4542eb9fb9574f256304ba8d0e9c0b18ce66418817d849797950c4542fe13383"} Jul 12 19:32:47.495709 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:47.495667 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-74fb557ddd-zh794" podStartSLOduration=1.171324772 podStartE2EDuration="1.495652843s" totalImagesPullingTime="324.328071ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:32:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:32:47.492931166 +0000 UTC m=+638.947524130" watchObservedRunningTime="2026-07-12 19:32:47.495652843 +0000 UTC m=+638.950245813" Jul 12 19:32:47.522228 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:47.522198 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7b57ddb64b-bb54p"] Jul 12 19:32:47.522409 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:47.522371 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-7b57ddb64b-bb54p" podUID="07bd600a-3377-4d51-babc-ec1f7665ef51" containerName="authorino" containerID="cri-o://21c3399794c438bbfe396a0907d3c224e1a0f7fc15751d2b186025bb169dac54" gracePeriod=30 Jul 12 19:32:47.760444 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:47.760418 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b57ddb64b-bb54p" Jul 12 19:32:47.874681 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:47.874650 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/07bd600a-3377-4d51-babc-ec1f7665ef51-tls-cert\") pod \"07bd600a-3377-4d51-babc-ec1f7665ef51\" (UID: \"07bd600a-3377-4d51-babc-ec1f7665ef51\") " Jul 12 19:32:47.874852 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:47.874706 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gfjpp\" (UniqueName: \"kubernetes.io/projected/07bd600a-3377-4d51-babc-ec1f7665ef51-kube-api-access-gfjpp\") pod \"07bd600a-3377-4d51-babc-ec1f7665ef51\" (UID: \"07bd600a-3377-4d51-babc-ec1f7665ef51\") " Jul 12 19:32:47.876657 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:47.876633 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/07bd600a-3377-4d51-babc-ec1f7665ef51-kube-api-access-gfjpp" (OuterVolumeSpecName: "kube-api-access-gfjpp") pod "07bd600a-3377-4d51-babc-ec1f7665ef51" (UID: "07bd600a-3377-4d51-babc-ec1f7665ef51"). InnerVolumeSpecName "kube-api-access-gfjpp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:32:47.886490 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:47.886460 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/07bd600a-3377-4d51-babc-ec1f7665ef51-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "07bd600a-3377-4d51-babc-ec1f7665ef51" (UID: "07bd600a-3377-4d51-babc-ec1f7665ef51"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 19:32:47.975937 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:47.975903 2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/07bd600a-3377-4d51-babc-ec1f7665ef51-tls-cert\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:32:47.975937 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:47.975937 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gfjpp\" (UniqueName: \"kubernetes.io/projected/07bd600a-3377-4d51-babc-ec1f7665ef51-kube-api-access-gfjpp\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:32:48.492163 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:48.492016 2576 generic.go:356] "Generic (PLEG): container finished" podID="07bd600a-3377-4d51-babc-ec1f7665ef51" containerID="21c3399794c438bbfe396a0907d3c224e1a0f7fc15751d2b186025bb169dac54" exitCode=0 Jul 12 19:32:48.492376 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:48.492223 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7b57ddb64b-bb54p" Jul 12 19:32:48.492524 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:48.491978 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b57ddb64b-bb54p" event={"ID":"07bd600a-3377-4d51-babc-ec1f7665ef51","Type":"ContainerDied","Data":"21c3399794c438bbfe396a0907d3c224e1a0f7fc15751d2b186025bb169dac54"} Jul 12 19:32:48.492524 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:48.492498 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7b57ddb64b-bb54p" event={"ID":"07bd600a-3377-4d51-babc-ec1f7665ef51","Type":"ContainerDied","Data":"90097c468e726947a34d5567e8bd8445d58a88629c8ffc487c27f4894382d2ea"} Jul 12 19:32:48.492645 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:48.492538 2576 scope.go:117] "RemoveContainer" containerID="21c3399794c438bbfe396a0907d3c224e1a0f7fc15751d2b186025bb169dac54" Jul 12 19:32:48.501945 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:48.501928 2576 scope.go:117] "RemoveContainer" containerID="21c3399794c438bbfe396a0907d3c224e1a0f7fc15751d2b186025bb169dac54" Jul 12 19:32:48.502232 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:32:48.502213 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"21c3399794c438bbfe396a0907d3c224e1a0f7fc15751d2b186025bb169dac54\": container with ID starting with 21c3399794c438bbfe396a0907d3c224e1a0f7fc15751d2b186025bb169dac54 not found: ID does not exist" containerID="21c3399794c438bbfe396a0907d3c224e1a0f7fc15751d2b186025bb169dac54" Jul 12 19:32:48.502291 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:48.502240 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"21c3399794c438bbfe396a0907d3c224e1a0f7fc15751d2b186025bb169dac54"} err="failed to get container status \"21c3399794c438bbfe396a0907d3c224e1a0f7fc15751d2b186025bb169dac54\": rpc error: code = NotFound desc = could not find container \"21c3399794c438bbfe396a0907d3c224e1a0f7fc15751d2b186025bb169dac54\": container with ID starting with 21c3399794c438bbfe396a0907d3c224e1a0f7fc15751d2b186025bb169dac54 not found: ID does not exist" Jul 12 19:32:48.513113 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:48.513091 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7b57ddb64b-bb54p"] Jul 12 19:32:48.515263 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:48.515246 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7b57ddb64b-bb54p"] Jul 12 19:32:49.083749 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:32:49.083718 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="07bd600a-3377-4d51-babc-ec1f7665ef51" path="/var/lib/kubelet/pods/07bd600a-3377-4d51-babc-ec1f7665ef51/volumes" Jul 12 19:33:32.126089 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:33:32.126049 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-pcm7h"] Jul 12 19:33:32.126513 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:33:32.126454 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="07bd600a-3377-4d51-babc-ec1f7665ef51" containerName="authorino" Jul 12 19:33:32.126513 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:33:32.126465 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="07bd600a-3377-4d51-babc-ec1f7665ef51" containerName="authorino" Jul 12 19:33:32.126594 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:33:32.126541 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="07bd600a-3377-4d51-babc-ec1f7665ef51" containerName="authorino" Jul 12 19:33:32.130853 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:33:32.130835 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pcm7h" Jul 12 19:33:32.134092 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:33:32.134061 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 12 19:33:32.134092 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:33:32.134090 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 12 19:33:32.134275 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:33:32.134088 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 12 19:33:32.134275 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:33:32.134068 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-48spd\"" Jul 12 19:33:32.139526 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:33:32.139503 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-pcm7h"] Jul 12 19:33:32.256272 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:33:32.256245 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdd04f9f-ce0d-4bd6-9255-c2da857c2d8e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pcm7h\" (UID: \"bdd04f9f-ce0d-4bd6-9255-c2da857c2d8e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pcm7h" Jul 12 19:33:32.256407 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:33:32.256301 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zvnb4\" (UniqueName: \"kubernetes.io/projected/bdd04f9f-ce0d-4bd6-9255-c2da857c2d8e-kube-api-access-zvnb4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pcm7h\" (UID: \"bdd04f9f-ce0d-4bd6-9255-c2da857c2d8e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pcm7h" Jul 12 19:33:32.256407 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:33:32.256355 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdd04f9f-ce0d-4bd6-9255-c2da857c2d8e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pcm7h\" (UID: \"bdd04f9f-ce0d-4bd6-9255-c2da857c2d8e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pcm7h" Jul 12 19:33:32.256407 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:33:32.256391 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdd04f9f-ce0d-4bd6-9255-c2da857c2d8e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pcm7h\" (UID: \"bdd04f9f-ce0d-4bd6-9255-c2da857c2d8e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pcm7h" Jul 12 19:33:32.256538 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:33:32.256427 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdd04f9f-ce0d-4bd6-9255-c2da857c2d8e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pcm7h\" (UID: \"bdd04f9f-ce0d-4bd6-9255-c2da857c2d8e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pcm7h" Jul 12 19:33:32.256538 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:33:32.256442 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdd04f9f-ce0d-4bd6-9255-c2da857c2d8e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pcm7h\" (UID: \"bdd04f9f-ce0d-4bd6-9255-c2da857c2d8e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pcm7h" Jul 12 19:33:32.357480 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:33:32.357448 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zvnb4\" (UniqueName: \"kubernetes.io/projected/bdd04f9f-ce0d-4bd6-9255-c2da857c2d8e-kube-api-access-zvnb4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pcm7h\" (UID: \"bdd04f9f-ce0d-4bd6-9255-c2da857c2d8e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pcm7h" Jul 12 19:33:32.357641 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:33:32.357489 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdd04f9f-ce0d-4bd6-9255-c2da857c2d8e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pcm7h\" (UID: \"bdd04f9f-ce0d-4bd6-9255-c2da857c2d8e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pcm7h" Jul 12 19:33:32.357708 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:33:32.357692 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdd04f9f-ce0d-4bd6-9255-c2da857c2d8e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pcm7h\" (UID: \"bdd04f9f-ce0d-4bd6-9255-c2da857c2d8e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pcm7h" Jul 12 19:33:32.357765 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:33:32.357746 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdd04f9f-ce0d-4bd6-9255-c2da857c2d8e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pcm7h\" (UID: \"bdd04f9f-ce0d-4bd6-9255-c2da857c2d8e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pcm7h" Jul 12 19:33:32.357823 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:33:32.357770 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdd04f9f-ce0d-4bd6-9255-c2da857c2d8e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pcm7h\" (UID: \"bdd04f9f-ce0d-4bd6-9255-c2da857c2d8e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pcm7h" Jul 12 19:33:32.357823 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:33:32.357804 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdd04f9f-ce0d-4bd6-9255-c2da857c2d8e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pcm7h\" (UID: \"bdd04f9f-ce0d-4bd6-9255-c2da857c2d8e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pcm7h" Jul 12 19:33:32.358014 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:33:32.357952 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdd04f9f-ce0d-4bd6-9255-c2da857c2d8e-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pcm7h\" (UID: \"bdd04f9f-ce0d-4bd6-9255-c2da857c2d8e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pcm7h" Jul 12 19:33:32.358200 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:33:32.358178 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdd04f9f-ce0d-4bd6-9255-c2da857c2d8e-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pcm7h\" (UID: \"bdd04f9f-ce0d-4bd6-9255-c2da857c2d8e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pcm7h" Jul 12 19:33:32.358306 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:33:32.358195 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdd04f9f-ce0d-4bd6-9255-c2da857c2d8e-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pcm7h\" (UID: \"bdd04f9f-ce0d-4bd6-9255-c2da857c2d8e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pcm7h" Jul 12 19:33:32.360081 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:33:32.360053 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdd04f9f-ce0d-4bd6-9255-c2da857c2d8e-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pcm7h\" (UID: \"bdd04f9f-ce0d-4bd6-9255-c2da857c2d8e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pcm7h" Jul 12 19:33:32.360421 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:33:32.360401 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdd04f9f-ce0d-4bd6-9255-c2da857c2d8e-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pcm7h\" (UID: \"bdd04f9f-ce0d-4bd6-9255-c2da857c2d8e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pcm7h" Jul 12 19:33:32.364816 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:33:32.364793 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zvnb4\" (UniqueName: \"kubernetes.io/projected/bdd04f9f-ce0d-4bd6-9255-c2da857c2d8e-kube-api-access-zvnb4\") pod \"e2e-trlp-test-simulated-kserve-598466548d-pcm7h\" (UID: \"bdd04f9f-ce0d-4bd6-9255-c2da857c2d8e\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pcm7h" Jul 12 19:33:32.442791 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:33:32.442770 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pcm7h" Jul 12 19:33:32.575188 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:33:32.575161 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-pcm7h"] Jul 12 19:33:32.575525 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:33:32.575501 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbdd04f9f_ce0d_4bd6_9255_c2da857c2d8e.slice/crio-48755dc1f3c57cc43484fd0412f130ff57dfc603661010e19489785c56b47da3 WatchSource:0}: Error finding container 48755dc1f3c57cc43484fd0412f130ff57dfc603661010e19489785c56b47da3: Status 404 returned error can't find the container with id 48755dc1f3c57cc43484fd0412f130ff57dfc603661010e19489785c56b47da3 Jul 12 19:33:32.576847 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:33:32.576830 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 12 19:33:32.739065 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:33:32.738970 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pcm7h" event={"ID":"bdd04f9f-ce0d-4bd6-9255-c2da857c2d8e","Type":"ContainerStarted","Data":"48755dc1f3c57cc43484fd0412f130ff57dfc603661010e19489785c56b47da3"} Jul 12 19:33:33.745928 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:33:33.745892 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pcm7h" event={"ID":"bdd04f9f-ce0d-4bd6-9255-c2da857c2d8e","Type":"ContainerStarted","Data":"9b8cf1fa2e8eb65868cd58fbdf6bde773899566342f68d8615c781606b61d59e"} Jul 12 19:33:33.762401 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:33:33.762353 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pcm7h" podStartSLOduration=0.781845868 podStartE2EDuration="1.762337281s" totalImagesPullingTime="980.491413ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:33:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:33:33.760231442 +0000 UTC m=+685.214824429" watchObservedRunningTime="2026-07-12 19:33:33.762337281 +0000 UTC m=+685.216930243" Jul 12 19:33:42.443877 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:33:42.443836 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pcm7h" Jul 12 19:33:42.444300 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:33:42.443895 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pcm7h" Jul 12 19:33:42.456637 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:33:42.456614 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pcm7h" Jul 12 19:33:42.806979 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:33:42.806906 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-pcm7h" Jul 12 19:34:06.832541 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:06.832469 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd"] Jul 12 19:34:06.837216 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:06.837200 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd" Jul 12 19:34:06.839639 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:06.839618 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 12 19:34:06.845406 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:06.845383 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd"] Jul 12 19:34:06.957939 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:06.957913 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c296436-24d1-4a7c-900a-7b2f5bb5c399-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd\" (UID: \"1c296436-24d1-4a7c-900a-7b2f5bb5c399\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd" Jul 12 19:34:06.958135 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:06.957963 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c296436-24d1-4a7c-900a-7b2f5bb5c399-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd\" (UID: \"1c296436-24d1-4a7c-900a-7b2f5bb5c399\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd" Jul 12 19:34:06.958135 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:06.958003 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c296436-24d1-4a7c-900a-7b2f5bb5c399-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd\" (UID: \"1c296436-24d1-4a7c-900a-7b2f5bb5c399\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd" Jul 12 19:34:06.958135 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:06.958055 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c296436-24d1-4a7c-900a-7b2f5bb5c399-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd\" (UID: \"1c296436-24d1-4a7c-900a-7b2f5bb5c399\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd" Jul 12 19:34:06.958135 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:06.958076 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tlvsp\" (UniqueName: \"kubernetes.io/projected/1c296436-24d1-4a7c-900a-7b2f5bb5c399-kube-api-access-tlvsp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd\" (UID: \"1c296436-24d1-4a7c-900a-7b2f5bb5c399\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd" Jul 12 19:34:06.958135 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:06.958110 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c296436-24d1-4a7c-900a-7b2f5bb5c399-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd\" (UID: \"1c296436-24d1-4a7c-900a-7b2f5bb5c399\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd" Jul 12 19:34:07.059114 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:07.059082 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c296436-24d1-4a7c-900a-7b2f5bb5c399-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd\" (UID: \"1c296436-24d1-4a7c-900a-7b2f5bb5c399\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd" Jul 12 19:34:07.059276 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:07.059134 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c296436-24d1-4a7c-900a-7b2f5bb5c399-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd\" (UID: \"1c296436-24d1-4a7c-900a-7b2f5bb5c399\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd" Jul 12 19:34:07.059276 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:07.059184 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c296436-24d1-4a7c-900a-7b2f5bb5c399-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd\" (UID: \"1c296436-24d1-4a7c-900a-7b2f5bb5c399\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd" Jul 12 19:34:07.059276 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:07.059202 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c296436-24d1-4a7c-900a-7b2f5bb5c399-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd\" (UID: \"1c296436-24d1-4a7c-900a-7b2f5bb5c399\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd" Jul 12 19:34:07.059276 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:07.059230 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c296436-24d1-4a7c-900a-7b2f5bb5c399-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd\" (UID: \"1c296436-24d1-4a7c-900a-7b2f5bb5c399\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd" Jul 12 19:34:07.059276 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:07.059259 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tlvsp\" (UniqueName: \"kubernetes.io/projected/1c296436-24d1-4a7c-900a-7b2f5bb5c399-kube-api-access-tlvsp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd\" (UID: \"1c296436-24d1-4a7c-900a-7b2f5bb5c399\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd" Jul 12 19:34:07.059562 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:07.059539 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1c296436-24d1-4a7c-900a-7b2f5bb5c399-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd\" (UID: \"1c296436-24d1-4a7c-900a-7b2f5bb5c399\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd" Jul 12 19:34:07.059627 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:07.059582 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1c296436-24d1-4a7c-900a-7b2f5bb5c399-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd\" (UID: \"1c296436-24d1-4a7c-900a-7b2f5bb5c399\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd" Jul 12 19:34:07.059627 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:07.059618 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1c296436-24d1-4a7c-900a-7b2f5bb5c399-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd\" (UID: \"1c296436-24d1-4a7c-900a-7b2f5bb5c399\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd" Jul 12 19:34:07.061534 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:07.061505 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1c296436-24d1-4a7c-900a-7b2f5bb5c399-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd\" (UID: \"1c296436-24d1-4a7c-900a-7b2f5bb5c399\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd" Jul 12 19:34:07.061959 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:07.061941 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1c296436-24d1-4a7c-900a-7b2f5bb5c399-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd\" (UID: \"1c296436-24d1-4a7c-900a-7b2f5bb5c399\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd" Jul 12 19:34:07.067482 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:07.067456 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tlvsp\" (UniqueName: \"kubernetes.io/projected/1c296436-24d1-4a7c-900a-7b2f5bb5c399-kube-api-access-tlvsp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd\" (UID: \"1c296436-24d1-4a7c-900a-7b2f5bb5c399\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd" Jul 12 19:34:07.149077 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:07.149004 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd" Jul 12 19:34:07.284027 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:07.284000 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd"] Jul 12 19:34:07.285423 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:34:07.285395 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c296436_24d1_4a7c_900a_7b2f5bb5c399.slice/crio-bf6c081869eed1443a4bbd5d195aa7fa42179abc88ebefb436325e09467497c8 WatchSource:0}: Error finding container bf6c081869eed1443a4bbd5d195aa7fa42179abc88ebefb436325e09467497c8: Status 404 returned error can't find the container with id bf6c081869eed1443a4bbd5d195aa7fa42179abc88ebefb436325e09467497c8 Jul 12 19:34:07.938477 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:07.938437 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd" event={"ID":"1c296436-24d1-4a7c-900a-7b2f5bb5c399","Type":"ContainerStarted","Data":"31c7ec6af56a028bf065fe4556a5dd6a6427da8633a6aed61bf170a336f3014e"} Jul 12 19:34:07.938859 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:07.938517 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd" event={"ID":"1c296436-24d1-4a7c-900a-7b2f5bb5c399","Type":"ContainerStarted","Data":"bf6c081869eed1443a4bbd5d195aa7fa42179abc88ebefb436325e09467497c8"} Jul 12 19:34:07.953324 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:07.953279 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd" podStartSLOduration=1.779219711 podStartE2EDuration="1.95326499s" totalImagesPullingTime="174.045279ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:34:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:34:07.952529101 +0000 UTC m=+719.407122064" watchObservedRunningTime="2026-07-12 19:34:07.95326499 +0000 UTC m=+719.407857952" Jul 12 19:34:17.149422 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:17.149390 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd" Jul 12 19:34:17.149900 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:17.149447 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd" Jul 12 19:34:17.161898 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:17.161874 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd" Jul 12 19:34:18.012501 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:18.012467 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd" Jul 12 19:34:27.418260 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:27.418230 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z"] Jul 12 19:34:27.423278 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:27.423255 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z" Jul 12 19:34:27.425591 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:27.425565 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jul 12 19:34:27.433957 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:27.433927 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z"] Jul 12 19:34:27.543768 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:27.543735 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dcd90ba-b7b6-49ac-8bb1-a272b95383df-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z\" (UID: \"6dcd90ba-b7b6-49ac-8bb1-a272b95383df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z" Jul 12 19:34:27.543768 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:27.543776 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dcd90ba-b7b6-49ac-8bb1-a272b95383df-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z\" (UID: \"6dcd90ba-b7b6-49ac-8bb1-a272b95383df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z" Jul 12 19:34:27.544012 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:27.543801 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dcd90ba-b7b6-49ac-8bb1-a272b95383df-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z\" (UID: \"6dcd90ba-b7b6-49ac-8bb1-a272b95383df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z" Jul 12 19:34:27.544012 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:27.543917 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dcd90ba-b7b6-49ac-8bb1-a272b95383df-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z\" (UID: \"6dcd90ba-b7b6-49ac-8bb1-a272b95383df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z" Jul 12 19:34:27.544012 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:27.543957 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dcd90ba-b7b6-49ac-8bb1-a272b95383df-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z\" (UID: \"6dcd90ba-b7b6-49ac-8bb1-a272b95383df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z" Jul 12 19:34:27.544012 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:27.543997 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jjgtx\" (UniqueName: \"kubernetes.io/projected/6dcd90ba-b7b6-49ac-8bb1-a272b95383df-kube-api-access-jjgtx\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z\" (UID: \"6dcd90ba-b7b6-49ac-8bb1-a272b95383df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z" Jul 12 19:34:27.645298 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:27.645255 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jjgtx\" (UniqueName: \"kubernetes.io/projected/6dcd90ba-b7b6-49ac-8bb1-a272b95383df-kube-api-access-jjgtx\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z\" (UID: \"6dcd90ba-b7b6-49ac-8bb1-a272b95383df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z" Jul 12 19:34:27.645491 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:27.645325 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dcd90ba-b7b6-49ac-8bb1-a272b95383df-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z\" (UID: \"6dcd90ba-b7b6-49ac-8bb1-a272b95383df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z" Jul 12 19:34:27.645491 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:27.645351 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dcd90ba-b7b6-49ac-8bb1-a272b95383df-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z\" (UID: \"6dcd90ba-b7b6-49ac-8bb1-a272b95383df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z" Jul 12 19:34:27.645491 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:27.645380 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dcd90ba-b7b6-49ac-8bb1-a272b95383df-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z\" (UID: \"6dcd90ba-b7b6-49ac-8bb1-a272b95383df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z" Jul 12 19:34:27.645491 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:27.645422 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dcd90ba-b7b6-49ac-8bb1-a272b95383df-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z\" (UID: \"6dcd90ba-b7b6-49ac-8bb1-a272b95383df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z" Jul 12 19:34:27.645727 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:27.645537 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dcd90ba-b7b6-49ac-8bb1-a272b95383df-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z\" (UID: \"6dcd90ba-b7b6-49ac-8bb1-a272b95383df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z" Jul 12 19:34:27.645807 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:27.645788 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6dcd90ba-b7b6-49ac-8bb1-a272b95383df-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z\" (UID: \"6dcd90ba-b7b6-49ac-8bb1-a272b95383df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z" Jul 12 19:34:27.645869 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:27.645843 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6dcd90ba-b7b6-49ac-8bb1-a272b95383df-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z\" (UID: \"6dcd90ba-b7b6-49ac-8bb1-a272b95383df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z" Jul 12 19:34:27.645920 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:27.645913 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6dcd90ba-b7b6-49ac-8bb1-a272b95383df-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z\" (UID: \"6dcd90ba-b7b6-49ac-8bb1-a272b95383df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z" Jul 12 19:34:27.647606 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:27.647583 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6dcd90ba-b7b6-49ac-8bb1-a272b95383df-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z\" (UID: \"6dcd90ba-b7b6-49ac-8bb1-a272b95383df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z" Jul 12 19:34:27.647900 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:27.647882 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6dcd90ba-b7b6-49ac-8bb1-a272b95383df-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z\" (UID: \"6dcd90ba-b7b6-49ac-8bb1-a272b95383df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z" Jul 12 19:34:27.652509 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:27.652483 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jjgtx\" (UniqueName: \"kubernetes.io/projected/6dcd90ba-b7b6-49ac-8bb1-a272b95383df-kube-api-access-jjgtx\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z\" (UID: \"6dcd90ba-b7b6-49ac-8bb1-a272b95383df\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z" Jul 12 19:34:27.740057 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:27.740023 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z" Jul 12 19:34:27.873683 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:27.873661 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z"] Jul 12 19:34:27.875800 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:34:27.875773 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6dcd90ba_b7b6_49ac_8bb1_a272b95383df.slice/crio-b1f8b1c26ee1afa18472354c402f55fdbd0bacffde77955fc216bfdfd4dc3267 WatchSource:0}: Error finding container b1f8b1c26ee1afa18472354c402f55fdbd0bacffde77955fc216bfdfd4dc3267: Status 404 returned error can't find the container with id b1f8b1c26ee1afa18472354c402f55fdbd0bacffde77955fc216bfdfd4dc3267 Jul 12 19:34:28.062947 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:28.062916 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z" event={"ID":"6dcd90ba-b7b6-49ac-8bb1-a272b95383df","Type":"ContainerStarted","Data":"b1f8b1c26ee1afa18472354c402f55fdbd0bacffde77955fc216bfdfd4dc3267"} Jul 12 19:34:29.070650 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:29.070602 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z" event={"ID":"6dcd90ba-b7b6-49ac-8bb1-a272b95383df","Type":"ContainerStarted","Data":"9b300af8f5c122061f907cd3da6a632b2c35acc7df36d5f5bbf3fe42dd114f4a"} Jul 12 19:34:29.086727 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:29.086678 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z" podStartSLOduration=1.9106574589999998 podStartE2EDuration="2.086662324s" totalImagesPullingTime="176.004865ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:34:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:34:29.0846912 +0000 UTC m=+740.539284162" watchObservedRunningTime="2026-07-12 19:34:29.086662324 +0000 UTC m=+740.541255286" Jul 12 19:34:37.740596 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:37.740565 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z" Jul 12 19:34:37.741072 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:37.740607 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z" Jul 12 19:34:37.753129 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:37.753105 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z" Jul 12 19:34:38.131963 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:34:38.131881 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z" Jul 12 19:35:21.797461 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:35:21.797427 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5b6599d77-7njlq"] Jul 12 19:35:21.801210 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:35:21.801188 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b6599d77-7njlq" Jul 12 19:35:21.807392 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:35:21.807363 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b6599d77-7njlq"] Jul 12 19:35:21.921588 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:35:21.921560 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a5bad969-641b-4d6a-84fc-db7731d83f70-tls-cert\") pod \"authorino-5b6599d77-7njlq\" (UID: \"a5bad969-641b-4d6a-84fc-db7731d83f70\") " pod="kuadrant-system/authorino-5b6599d77-7njlq" Jul 12 19:35:21.921741 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:35:21.921606 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a5bad969-641b-4d6a-84fc-db7731d83f70-oidc-ca\") pod \"authorino-5b6599d77-7njlq\" (UID: \"a5bad969-641b-4d6a-84fc-db7731d83f70\") " pod="kuadrant-system/authorino-5b6599d77-7njlq" Jul 12 19:35:21.921806 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:35:21.921783 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w8hkl\" (UniqueName: \"kubernetes.io/projected/a5bad969-641b-4d6a-84fc-db7731d83f70-kube-api-access-w8hkl\") pod \"authorino-5b6599d77-7njlq\" (UID: \"a5bad969-641b-4d6a-84fc-db7731d83f70\") " pod="kuadrant-system/authorino-5b6599d77-7njlq" Jul 12 19:35:22.022892 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:35:22.022851 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w8hkl\" (UniqueName: \"kubernetes.io/projected/a5bad969-641b-4d6a-84fc-db7731d83f70-kube-api-access-w8hkl\") pod \"authorino-5b6599d77-7njlq\" (UID: \"a5bad969-641b-4d6a-84fc-db7731d83f70\") " pod="kuadrant-system/authorino-5b6599d77-7njlq" Jul 12 19:35:22.023094 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:35:22.022901 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a5bad969-641b-4d6a-84fc-db7731d83f70-tls-cert\") pod \"authorino-5b6599d77-7njlq\" (UID: \"a5bad969-641b-4d6a-84fc-db7731d83f70\") " pod="kuadrant-system/authorino-5b6599d77-7njlq" Jul 12 19:35:22.023094 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:35:22.022945 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a5bad969-641b-4d6a-84fc-db7731d83f70-oidc-ca\") pod \"authorino-5b6599d77-7njlq\" (UID: \"a5bad969-641b-4d6a-84fc-db7731d83f70\") " pod="kuadrant-system/authorino-5b6599d77-7njlq" Jul 12 19:35:22.023582 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:35:22.023558 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/a5bad969-641b-4d6a-84fc-db7731d83f70-oidc-ca\") pod \"authorino-5b6599d77-7njlq\" (UID: \"a5bad969-641b-4d6a-84fc-db7731d83f70\") " pod="kuadrant-system/authorino-5b6599d77-7njlq" Jul 12 19:35:22.025413 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:35:22.025382 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/a5bad969-641b-4d6a-84fc-db7731d83f70-tls-cert\") pod \"authorino-5b6599d77-7njlq\" (UID: \"a5bad969-641b-4d6a-84fc-db7731d83f70\") " pod="kuadrant-system/authorino-5b6599d77-7njlq" Jul 12 19:35:22.030451 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:35:22.030429 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w8hkl\" (UniqueName: \"kubernetes.io/projected/a5bad969-641b-4d6a-84fc-db7731d83f70-kube-api-access-w8hkl\") pod \"authorino-5b6599d77-7njlq\" (UID: \"a5bad969-641b-4d6a-84fc-db7731d83f70\") " pod="kuadrant-system/authorino-5b6599d77-7njlq" Jul 12 19:35:22.111965 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:35:22.111910 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5b6599d77-7njlq" Jul 12 19:35:22.244530 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:35:22.244506 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5b6599d77-7njlq"] Jul 12 19:35:22.246234 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:35:22.246207 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda5bad969_641b_4d6a_84fc_db7731d83f70.slice/crio-a0cac968833b1f50a5984257798235e93b53bdadcd28bcc7e0275fbddb8fca61 WatchSource:0}: Error finding container a0cac968833b1f50a5984257798235e93b53bdadcd28bcc7e0275fbddb8fca61: Status 404 returned error can't find the container with id a0cac968833b1f50a5984257798235e93b53bdadcd28bcc7e0275fbddb8fca61 Jul 12 19:35:22.361042 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:35:22.361009 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b6599d77-7njlq" event={"ID":"a5bad969-641b-4d6a-84fc-db7731d83f70","Type":"ContainerStarted","Data":"a0cac968833b1f50a5984257798235e93b53bdadcd28bcc7e0275fbddb8fca61"} Jul 12 19:35:23.370412 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:35:23.370370 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5b6599d77-7njlq" event={"ID":"a5bad969-641b-4d6a-84fc-db7731d83f70","Type":"ContainerStarted","Data":"d332ce52ac34f4edfda8762861f40fb39bb8b143587c42a1589b4defb7253c38"} Jul 12 19:35:23.387070 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:35:23.387006 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5b6599d77-7njlq" podStartSLOduration=2.005449397 podStartE2EDuration="2.386967884s" totalImagesPullingTime="381.518487ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:35:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:35:23.384946151 +0000 UTC m=+794.839539115" watchObservedRunningTime="2026-07-12 19:35:23.386967884 +0000 UTC m=+794.841560850" Jul 12 19:35:23.413789 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:35:23.413681 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-74fb557ddd-zh794"] Jul 12 19:35:23.413979 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:35:23.413938 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-74fb557ddd-zh794" podUID="9429409f-efcf-46f2-995d-7e41216c86f3" containerName="authorino" containerID="cri-o://80e6d62f22a7c85d671f1c366678d63a70493f33ad2ccfb08c071d8d4595022b" gracePeriod=30 Jul 12 19:35:23.674396 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:35:23.674374 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74fb557ddd-zh794" Jul 12 19:35:23.841642 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:35:23.841602 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2rwkh\" (UniqueName: \"kubernetes.io/projected/9429409f-efcf-46f2-995d-7e41216c86f3-kube-api-access-2rwkh\") pod \"9429409f-efcf-46f2-995d-7e41216c86f3\" (UID: \"9429409f-efcf-46f2-995d-7e41216c86f3\") " Jul 12 19:35:23.841835 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:35:23.841713 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9429409f-efcf-46f2-995d-7e41216c86f3-tls-cert\") pod \"9429409f-efcf-46f2-995d-7e41216c86f3\" (UID: \"9429409f-efcf-46f2-995d-7e41216c86f3\") " Jul 12 19:35:23.841835 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:35:23.841746 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/9429409f-efcf-46f2-995d-7e41216c86f3-oidc-ca\") pod \"9429409f-efcf-46f2-995d-7e41216c86f3\" (UID: \"9429409f-efcf-46f2-995d-7e41216c86f3\") " Jul 12 19:35:23.843910 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:35:23.843866 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9429409f-efcf-46f2-995d-7e41216c86f3-kube-api-access-2rwkh" (OuterVolumeSpecName: "kube-api-access-2rwkh") pod "9429409f-efcf-46f2-995d-7e41216c86f3" (UID: "9429409f-efcf-46f2-995d-7e41216c86f3"). InnerVolumeSpecName "kube-api-access-2rwkh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:35:23.847111 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:35:23.847081 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9429409f-efcf-46f2-995d-7e41216c86f3-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "9429409f-efcf-46f2-995d-7e41216c86f3" (UID: "9429409f-efcf-46f2-995d-7e41216c86f3"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 19:35:23.853599 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:35:23.853569 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9429409f-efcf-46f2-995d-7e41216c86f3-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "9429409f-efcf-46f2-995d-7e41216c86f3" (UID: "9429409f-efcf-46f2-995d-7e41216c86f3"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 12 19:35:23.943221 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:35:23.943170 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2rwkh\" (UniqueName: \"kubernetes.io/projected/9429409f-efcf-46f2-995d-7e41216c86f3-kube-api-access-2rwkh\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:35:23.943221 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:35:23.943210 2576 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/9429409f-efcf-46f2-995d-7e41216c86f3-tls-cert\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:35:23.943221 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:35:23.943222 2576 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/9429409f-efcf-46f2-995d-7e41216c86f3-oidc-ca\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:35:24.378127 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:35:24.378036 2576 generic.go:356] "Generic (PLEG): container finished" podID="9429409f-efcf-46f2-995d-7e41216c86f3" containerID="80e6d62f22a7c85d671f1c366678d63a70493f33ad2ccfb08c071d8d4595022b" exitCode=0 Jul 12 19:35:24.378127 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:35:24.378083 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-74fb557ddd-zh794" Jul 12 19:35:24.378635 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:35:24.378139 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74fb557ddd-zh794" event={"ID":"9429409f-efcf-46f2-995d-7e41216c86f3","Type":"ContainerDied","Data":"80e6d62f22a7c85d671f1c366678d63a70493f33ad2ccfb08c071d8d4595022b"} Jul 12 19:35:24.378635 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:35:24.378192 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-74fb557ddd-zh794" event={"ID":"9429409f-efcf-46f2-995d-7e41216c86f3","Type":"ContainerDied","Data":"4542eb9fb9574f256304ba8d0e9c0b18ce66418817d849797950c4542fe13383"} Jul 12 19:35:24.378635 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:35:24.378212 2576 scope.go:117] "RemoveContainer" containerID="80e6d62f22a7c85d671f1c366678d63a70493f33ad2ccfb08c071d8d4595022b" Jul 12 19:35:24.387868 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:35:24.387851 2576 scope.go:117] "RemoveContainer" containerID="80e6d62f22a7c85d671f1c366678d63a70493f33ad2ccfb08c071d8d4595022b" Jul 12 19:35:24.388150 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:35:24.388133 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80e6d62f22a7c85d671f1c366678d63a70493f33ad2ccfb08c071d8d4595022b\": container with ID starting with 80e6d62f22a7c85d671f1c366678d63a70493f33ad2ccfb08c071d8d4595022b not found: ID does not exist" containerID="80e6d62f22a7c85d671f1c366678d63a70493f33ad2ccfb08c071d8d4595022b" Jul 12 19:35:24.388214 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:35:24.388157 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80e6d62f22a7c85d671f1c366678d63a70493f33ad2ccfb08c071d8d4595022b"} err="failed to get container status \"80e6d62f22a7c85d671f1c366678d63a70493f33ad2ccfb08c071d8d4595022b\": rpc error: code = NotFound desc = could not find container \"80e6d62f22a7c85d671f1c366678d63a70493f33ad2ccfb08c071d8d4595022b\": container with ID starting with 80e6d62f22a7c85d671f1c366678d63a70493f33ad2ccfb08c071d8d4595022b not found: ID does not exist" Jul 12 19:35:24.399041 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:35:24.399018 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-74fb557ddd-zh794"] Jul 12 19:35:24.406710 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:35:24.406685 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-74fb557ddd-zh794"] Jul 12 19:35:25.084878 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:35:25.084834 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9429409f-efcf-46f2-995d-7e41216c86f3" path="/var/lib/kubelet/pods/9429409f-efcf-46f2-995d-7e41216c86f3/volumes" Jul 12 19:37:09.118309 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:37:09.118284 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mj4zs_888aafef-f377-46e3-a36b-58cbabc198f8/ovn-acl-logging/0.log" Jul 12 19:37:09.120900 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:37:09.119226 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mj4zs_888aafef-f377-46e3-a36b-58cbabc198f8/ovn-acl-logging/0.log" Jul 12 19:41:20.162256 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:41:20.162224 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sc7wr"] Jul 12 19:41:20.162747 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:41:20.162427 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sc7wr" podUID="eb058928-bf8e-42d4-820a-46438ccb6b09" containerName="manager" containerID="cri-o://df43f233c311df395cd4cb363afe38b6ecba3c62844ff6cf123145e48cb00bcd" gracePeriod=10 Jul 12 19:41:24.412146 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:41:24.412123 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sc7wr" Jul 12 19:41:24.419028 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:41:24.419001 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bxp87\" (UniqueName: \"kubernetes.io/projected/eb058928-bf8e-42d4-820a-46438ccb6b09-kube-api-access-bxp87\") pod \"eb058928-bf8e-42d4-820a-46438ccb6b09\" (UID: \"eb058928-bf8e-42d4-820a-46438ccb6b09\") " Jul 12 19:41:24.419146 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:41:24.419089 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eb058928-bf8e-42d4-820a-46438ccb6b09-extensions-socket-volume\") pod \"eb058928-bf8e-42d4-820a-46438ccb6b09\" (UID: \"eb058928-bf8e-42d4-820a-46438ccb6b09\") " Jul 12 19:41:24.419424 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:41:24.419405 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/eb058928-bf8e-42d4-820a-46438ccb6b09-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "eb058928-bf8e-42d4-820a-46438ccb6b09" (UID: "eb058928-bf8e-42d4-820a-46438ccb6b09"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:41:24.420818 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:41:24.420790 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/eb058928-bf8e-42d4-820a-46438ccb6b09-kube-api-access-bxp87" (OuterVolumeSpecName: "kube-api-access-bxp87") pod "eb058928-bf8e-42d4-820a-46438ccb6b09" (UID: "eb058928-bf8e-42d4-820a-46438ccb6b09"). InnerVolumeSpecName "kube-api-access-bxp87". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:41:24.495882 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:41:24.495848 2576 generic.go:356] "Generic (PLEG): container finished" podID="eb058928-bf8e-42d4-820a-46438ccb6b09" containerID="df43f233c311df395cd4cb363afe38b6ecba3c62844ff6cf123145e48cb00bcd" exitCode=0 Jul 12 19:41:24.496082 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:41:24.495905 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sc7wr" Jul 12 19:41:24.496082 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:41:24.495915 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sc7wr" event={"ID":"eb058928-bf8e-42d4-820a-46438ccb6b09","Type":"ContainerDied","Data":"df43f233c311df395cd4cb363afe38b6ecba3c62844ff6cf123145e48cb00bcd"} Jul 12 19:41:24.496082 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:41:24.496003 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sc7wr" event={"ID":"eb058928-bf8e-42d4-820a-46438ccb6b09","Type":"ContainerDied","Data":"c9fa4e5e2b7b0e51d4c2aaf3a9d1de4bcd31bbe434e47a61bd2da8f6158b99dd"} Jul 12 19:41:24.496082 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:41:24.496027 2576 scope.go:117] "RemoveContainer" containerID="df43f233c311df395cd4cb363afe38b6ecba3c62844ff6cf123145e48cb00bcd" Jul 12 19:41:24.506081 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:41:24.506061 2576 scope.go:117] "RemoveContainer" containerID="df43f233c311df395cd4cb363afe38b6ecba3c62844ff6cf123145e48cb00bcd" Jul 12 19:41:24.506312 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:41:24.506295 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"df43f233c311df395cd4cb363afe38b6ecba3c62844ff6cf123145e48cb00bcd\": container with ID starting with df43f233c311df395cd4cb363afe38b6ecba3c62844ff6cf123145e48cb00bcd not found: ID does not exist" containerID="df43f233c311df395cd4cb363afe38b6ecba3c62844ff6cf123145e48cb00bcd" Jul 12 19:41:24.506359 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:41:24.506319 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"df43f233c311df395cd4cb363afe38b6ecba3c62844ff6cf123145e48cb00bcd"} err="failed to get container status \"df43f233c311df395cd4cb363afe38b6ecba3c62844ff6cf123145e48cb00bcd\": rpc error: code = NotFound desc = could not find container \"df43f233c311df395cd4cb363afe38b6ecba3c62844ff6cf123145e48cb00bcd\": container with ID starting with df43f233c311df395cd4cb363afe38b6ecba3c62844ff6cf123145e48cb00bcd not found: ID does not exist" Jul 12 19:41:24.517373 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:41:24.517348 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sc7wr"] Jul 12 19:41:24.520704 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:41:24.520680 2576 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/eb058928-bf8e-42d4-820a-46438ccb6b09-extensions-socket-volume\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:41:24.520798 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:41:24.520709 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bxp87\" (UniqueName: \"kubernetes.io/projected/eb058928-bf8e-42d4-820a-46438ccb6b09-kube-api-access-bxp87\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:41:24.521018 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:41:24.521002 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-sc7wr"] Jul 12 19:41:25.083685 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:41:25.083656 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="eb058928-bf8e-42d4-820a-46438ccb6b09" path="/var/lib/kubelet/pods/eb058928-bf8e-42d4-820a-46438ccb6b09/volumes" Jul 12 19:42:09.156528 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:42:09.156424 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mj4zs_888aafef-f377-46e3-a36b-58cbabc198f8/ovn-acl-logging/0.log" Jul 12 19:42:09.159674 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:42:09.158736 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mj4zs_888aafef-f377-46e3-a36b-58cbabc198f8/ovn-acl-logging/0.log" Jul 12 19:42:21.257167 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:42:21.257119 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-svqnf"] Jul 12 19:42:21.257568 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:42:21.257539 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="eb058928-bf8e-42d4-820a-46438ccb6b09" containerName="manager" Jul 12 19:42:21.257568 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:42:21.257549 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="eb058928-bf8e-42d4-820a-46438ccb6b09" containerName="manager" Jul 12 19:42:21.257650 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:42:21.257572 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9429409f-efcf-46f2-995d-7e41216c86f3" containerName="authorino" Jul 12 19:42:21.257650 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:42:21.257578 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="9429409f-efcf-46f2-995d-7e41216c86f3" containerName="authorino" Jul 12 19:42:21.257712 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:42:21.257653 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="9429409f-efcf-46f2-995d-7e41216c86f3" containerName="authorino" Jul 12 19:42:21.257712 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:42:21.257663 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="eb058928-bf8e-42d4-820a-46438ccb6b09" containerName="manager" Jul 12 19:42:21.262071 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:42:21.262050 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-svqnf" Jul 12 19:42:21.264793 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:42:21.264773 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-qz7q6\"" Jul 12 19:42:21.272233 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:42:21.272211 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-svqnf"] Jul 12 19:42:21.322974 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:42:21.322942 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aaca7341-8abd-4c8e-8d01-a318cf6f44d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-svqnf\" (UID: \"aaca7341-8abd-4c8e-8d01-a318cf6f44d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-svqnf" Jul 12 19:42:21.323147 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:42:21.323101 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vrqh7\" (UniqueName: \"kubernetes.io/projected/aaca7341-8abd-4c8e-8d01-a318cf6f44d7-kube-api-access-vrqh7\") pod \"kuadrant-operator-controller-manager-86878c769f-svqnf\" (UID: \"aaca7341-8abd-4c8e-8d01-a318cf6f44d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-svqnf" Jul 12 19:42:21.423492 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:42:21.423461 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aaca7341-8abd-4c8e-8d01-a318cf6f44d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-svqnf\" (UID: \"aaca7341-8abd-4c8e-8d01-a318cf6f44d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-svqnf" Jul 12 19:42:21.423664 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:42:21.423527 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vrqh7\" (UniqueName: \"kubernetes.io/projected/aaca7341-8abd-4c8e-8d01-a318cf6f44d7-kube-api-access-vrqh7\") pod \"kuadrant-operator-controller-manager-86878c769f-svqnf\" (UID: \"aaca7341-8abd-4c8e-8d01-a318cf6f44d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-svqnf" Jul 12 19:42:21.423861 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:42:21.423841 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/aaca7341-8abd-4c8e-8d01-a318cf6f44d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-svqnf\" (UID: \"aaca7341-8abd-4c8e-8d01-a318cf6f44d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-svqnf" Jul 12 19:42:21.436139 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:42:21.436115 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vrqh7\" (UniqueName: \"kubernetes.io/projected/aaca7341-8abd-4c8e-8d01-a318cf6f44d7-kube-api-access-vrqh7\") pod \"kuadrant-operator-controller-manager-86878c769f-svqnf\" (UID: \"aaca7341-8abd-4c8e-8d01-a318cf6f44d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-svqnf" Jul 12 19:42:21.573957 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:42:21.573867 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-svqnf" Jul 12 19:42:21.711645 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:42:21.711617 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-svqnf"] Jul 12 19:42:21.714138 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:42:21.714101 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaaca7341_8abd_4c8e_8d01_a318cf6f44d7.slice/crio-e8e968e05d41719245627c4808cddf294fc32165faa39aa211eae9bf38b88f6d WatchSource:0}: Error finding container e8e968e05d41719245627c4808cddf294fc32165faa39aa211eae9bf38b88f6d: Status 404 returned error can't find the container with id e8e968e05d41719245627c4808cddf294fc32165faa39aa211eae9bf38b88f6d Jul 12 19:42:21.831453 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:42:21.831374 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-svqnf" event={"ID":"aaca7341-8abd-4c8e-8d01-a318cf6f44d7","Type":"ContainerStarted","Data":"298630a5bc053551dc8a3265f783b8df70bd2b9368b1d1c144d133b07410919e"} Jul 12 19:42:21.831453 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:42:21.831443 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-svqnf" event={"ID":"aaca7341-8abd-4c8e-8d01-a318cf6f44d7","Type":"ContainerStarted","Data":"e8e968e05d41719245627c4808cddf294fc32165faa39aa211eae9bf38b88f6d"} Jul 12 19:42:21.831632 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:42:21.831507 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-svqnf" Jul 12 19:42:21.850975 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:42:21.850930 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-svqnf" podStartSLOduration=0.850915835 podStartE2EDuration="850.915835ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:42:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:42:21.849756843 +0000 UTC m=+1213.304349830" watchObservedRunningTime="2026-07-12 19:42:21.850915835 +0000 UTC m=+1213.305508798" Jul 12 19:42:32.840111 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:42:32.840079 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-svqnf" Jul 12 19:47:09.204898 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:47:09.204868 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mj4zs_888aafef-f377-46e3-a36b-58cbabc198f8/ovn-acl-logging/0.log" Jul 12 19:47:09.207223 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:47:09.206066 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mj4zs_888aafef-f377-46e3-a36b-58cbabc198f8/ovn-acl-logging/0.log" Jul 12 19:48:54.453906 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:54.453874 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7"] Jul 12 19:48:54.457890 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:54.457863 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" Jul 12 19:48:54.460818 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:54.460794 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ce5aeab4-openshift-default-dockercfg-wxnvd\"" Jul 12 19:48:54.470167 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:54.470139 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7"] Jul 12 19:48:54.612559 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:54.612530 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-istio-token\") pod \"e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7\" (UID: \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\") " pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" Jul 12 19:48:54.612559 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:54.612563 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-workload-certs\") pod \"e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7\" (UID: \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\") " pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" Jul 12 19:48:54.612785 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:54.612607 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cptn7\" (UniqueName: \"kubernetes.io/projected/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-kube-api-access-cptn7\") pod \"e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7\" (UID: \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\") " pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" Jul 12 19:48:54.612785 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:54.612652 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-workload-socket\") pod \"e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7\" (UID: \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\") " pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" Jul 12 19:48:54.612785 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:54.612668 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-istio-podinfo\") pod \"e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7\" (UID: \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\") " pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" Jul 12 19:48:54.612785 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:54.612683 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-istiod-ca-cert\") pod \"e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7\" (UID: \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\") " pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" Jul 12 19:48:54.612785 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:54.612721 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-istio-data\") pod \"e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7\" (UID: \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\") " pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" Jul 12 19:48:54.612785 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:54.612774 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-credential-socket\") pod \"e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7\" (UID: \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\") " pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" Jul 12 19:48:54.612785 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:54.612789 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-istio-envoy\") pod \"e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7\" (UID: \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\") " pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" Jul 12 19:48:54.714127 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:54.714036 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-workload-socket\") pod \"e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7\" (UID: \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\") " pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" Jul 12 19:48:54.714127 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:54.714073 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-istio-podinfo\") pod \"e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7\" (UID: \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\") " pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" Jul 12 19:48:54.714127 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:54.714094 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-istiod-ca-cert\") pod \"e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7\" (UID: \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\") " pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" Jul 12 19:48:54.714127 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:54.714126 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-istio-data\") pod \"e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7\" (UID: \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\") " pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" Jul 12 19:48:54.714456 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:54.714182 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-credential-socket\") pod \"e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7\" (UID: \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\") " pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" Jul 12 19:48:54.714456 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:54.714204 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-istio-envoy\") pod \"e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7\" (UID: \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\") " pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" Jul 12 19:48:54.714456 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:54.714276 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-istio-token\") pod \"e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7\" (UID: \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\") " pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" Jul 12 19:48:54.714456 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:54.714308 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-workload-certs\") pod \"e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7\" (UID: \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\") " pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" Jul 12 19:48:54.714456 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:54.714356 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cptn7\" (UniqueName: \"kubernetes.io/projected/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-kube-api-access-cptn7\") pod \"e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7\" (UID: \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\") " pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" Jul 12 19:48:54.714701 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:54.714491 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-workload-socket\") pod \"e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7\" (UID: \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\") " pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" Jul 12 19:48:54.714701 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:54.714555 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-credential-socket\") pod \"e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7\" (UID: \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\") " pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" Jul 12 19:48:54.714701 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:54.714681 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-istio-data\") pod \"e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7\" (UID: \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\") " pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" Jul 12 19:48:54.714824 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:54.714756 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-workload-certs\") pod \"e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7\" (UID: \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\") " pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" Jul 12 19:48:54.714947 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:54.714919 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-istiod-ca-cert\") pod \"e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7\" (UID: \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\") " pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" Jul 12 19:48:54.716563 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:54.716544 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-istio-envoy\") pod \"e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7\" (UID: \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\") " pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" Jul 12 19:48:54.716776 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:54.716758 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-istio-podinfo\") pod \"e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7\" (UID: \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\") " pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" Jul 12 19:48:54.722752 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:54.722728 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-istio-token\") pod \"e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7\" (UID: \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\") " pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" Jul 12 19:48:54.722874 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:54.722860 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cptn7\" (UniqueName: \"kubernetes.io/projected/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-kube-api-access-cptn7\") pod \"e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7\" (UID: \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\") " pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" Jul 12 19:48:54.770804 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:54.770773 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" Jul 12 19:48:54.914538 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:54.914505 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7"] Jul 12 19:48:54.915206 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:48:54.915178 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2e22c6d_6d5d_403a_ac0a_d97b73ca0cef.slice/crio-4d6303c9820d148a58fc8e710f2339a2c86ba99cfcc95049bd769a3ac23b4e09 WatchSource:0}: Error finding container 4d6303c9820d148a58fc8e710f2339a2c86ba99cfcc95049bd769a3ac23b4e09: Status 404 returned error can't find the container with id 4d6303c9820d148a58fc8e710f2339a2c86ba99cfcc95049bd769a3ac23b4e09 Jul 12 19:48:54.917223 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:54.917190 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 12 19:48:54.917323 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:54.917256 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 12 19:48:54.917323 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:54.917284 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 12 19:48:55.145064 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:55.145028 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" event={"ID":"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef","Type":"ContainerStarted","Data":"37d151f269d88b7c7529da174ea9b76fe0f6f3b55d5f52b48f773a3474c0888f"} Jul 12 19:48:55.145236 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:55.145094 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" event={"ID":"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef","Type":"ContainerStarted","Data":"4d6303c9820d148a58fc8e710f2339a2c86ba99cfcc95049bd769a3ac23b4e09"} Jul 12 19:48:55.166674 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:55.166611 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" podStartSLOduration=1.1665892549999999 podStartE2EDuration="1.166589255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:48:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:48:55.162199359 +0000 UTC m=+1606.616792323" watchObservedRunningTime="2026-07-12 19:48:55.166589255 +0000 UTC m=+1606.621182219" Jul 12 19:48:55.771137 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:55.771110 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" Jul 12 19:48:55.775372 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:55.775347 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" Jul 12 19:48:56.152019 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:56.151917 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" Jul 12 19:48:56.152821 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:48:56.152801 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" Jul 12 19:49:07.010515 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:07.010437 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7"] Jul 12 19:49:07.010883 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:07.010650 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" podUID="e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef" containerName="istio-proxy" containerID="cri-o://37d151f269d88b7c7529da174ea9b76fe0f6f3b55d5f52b48f773a3474c0888f" gracePeriod=30 Jul 12 19:49:11.154521 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:11.154481 2576 patch_prober.go:28] interesting pod/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=upstream connect error or disconnect/reset before headers. reset reason: remote connection failure, transport failure reason: delayed connect error: Connection refused Jul 12 19:49:11.154902 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:11.154545 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" podUID="e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 12 19:49:12.252196 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:12.252158 2576 generic.go:356] "Generic (PLEG): container finished" podID="e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef" containerID="37d151f269d88b7c7529da174ea9b76fe0f6f3b55d5f52b48f773a3474c0888f" exitCode=0 Jul 12 19:49:12.252596 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:12.252213 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" event={"ID":"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef","Type":"ContainerDied","Data":"37d151f269d88b7c7529da174ea9b76fe0f6f3b55d5f52b48f773a3474c0888f"} Jul 12 19:49:12.252596 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:12.252250 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" event={"ID":"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef","Type":"ContainerDied","Data":"4d6303c9820d148a58fc8e710f2339a2c86ba99cfcc95049bd769a3ac23b4e09"} Jul 12 19:49:12.252596 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:12.252268 2576 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d6303c9820d148a58fc8e710f2339a2c86ba99cfcc95049bd769a3ac23b4e09" Jul 12 19:49:12.256157 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:12.256135 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" Jul 12 19:49:12.373768 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:12.373700 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cptn7\" (UniqueName: \"kubernetes.io/projected/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-kube-api-access-cptn7\") pod \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\" (UID: \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\") " Jul 12 19:49:12.373768 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:12.373733 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-workload-socket\") pod \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\" (UID: \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\") " Jul 12 19:49:12.373768 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:12.373763 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-istio-token\") pod \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\" (UID: \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\") " Jul 12 19:49:12.374052 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:12.373784 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-istio-data\") pod \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\" (UID: \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\") " Jul 12 19:49:12.374052 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:12.373807 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-istio-envoy\") pod \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\" (UID: \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\") " Jul 12 19:49:12.374052 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:12.373841 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-workload-certs\") pod \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\" (UID: \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\") " Jul 12 19:49:12.374052 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:12.373925 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-istio-podinfo\") pod \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\" (UID: \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\") " Jul 12 19:49:12.374052 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:12.373955 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-credential-socket\") pod \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\" (UID: \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\") " Jul 12 19:49:12.374052 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:12.374011 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef" (UID: "e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:49:12.374364 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:12.374083 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-istio-data" (OuterVolumeSpecName: "istio-data") pod "e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef" (UID: "e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:49:12.374364 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:12.374197 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef" (UID: "e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:49:12.374364 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:12.374282 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef" (UID: "e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:49:12.374364 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:12.374288 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-istiod-ca-cert\") pod \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\" (UID: \"e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef\") " Jul 12 19:49:12.374596 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:12.374576 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-credential-socket\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:49:12.374657 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:12.374600 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-workload-socket\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:49:12.374657 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:12.374614 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-istio-data\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:49:12.374657 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:12.374621 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef" (UID: "e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 19:49:12.374657 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:12.374628 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-workload-certs\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:49:12.375933 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:12.375905 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-kube-api-access-cptn7" (OuterVolumeSpecName: "kube-api-access-cptn7") pod "e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef" (UID: "e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef"). InnerVolumeSpecName "kube-api-access-cptn7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:49:12.376062 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:12.375948 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef" (UID: "e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 12 19:49:12.376062 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:12.376037 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef" (UID: "e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:49:12.376170 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:12.376150 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-istio-token" (OuterVolumeSpecName: "istio-token") pod "e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef" (UID: "e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:49:12.475877 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:12.475848 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-istio-podinfo\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:49:12.475877 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:12.475873 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-istiod-ca-cert\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:49:12.475877 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:12.475883 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cptn7\" (UniqueName: \"kubernetes.io/projected/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-kube-api-access-cptn7\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:49:12.476090 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:12.475891 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-istio-token\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:49:12.476090 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:12.475900 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef-istio-envoy\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:49:13.257633 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:13.257604 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7" Jul 12 19:49:13.275149 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:13.275081 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7"] Jul 12 19:49:13.281694 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:13.281673 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ce5aeab4-openshift-default-799d5654d7-v8dv7"] Jul 12 19:49:15.084118 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:49:15.084082 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef" path="/var/lib/kubelet/pods/e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef/volumes" Jul 12 19:52:09.246296 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:52:09.246167 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mj4zs_888aafef-f377-46e3-a36b-58cbabc198f8/ovn-acl-logging/0.log" Jul 12 19:52:09.257414 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:52:09.247901 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mj4zs_888aafef-f377-46e3-a36b-58cbabc198f8/ovn-acl-logging/0.log" Jul 12 19:54:59.257400 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:54:59.257367 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b"] Jul 12 19:54:59.258016 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:54:59.258000 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef" containerName="istio-proxy" Jul 12 19:54:59.258016 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:54:59.258017 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef" containerName="istio-proxy" Jul 12 19:54:59.258115 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:54:59.258106 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="e2e22c6d-6d5d-403a-ac0a-d97b73ca0cef" containerName="istio-proxy" Jul 12 19:54:59.261238 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:54:59.261223 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" Jul 12 19:54:59.263362 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:54:59.263342 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-a78ace-openshift-default-dockercfg-p87zn\"" Jul 12 19:54:59.273090 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:54:59.273070 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b"] Jul 12 19:54:59.389976 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:54:59.389944 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/513c7ea9-a521-47a3-94d9-f1ee8be666c2-credential-socket\") pod \"e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b\" (UID: \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\") " pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" Jul 12 19:54:59.389976 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:54:59.389977 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/513c7ea9-a521-47a3-94d9-f1ee8be666c2-workload-certs\") pod \"e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b\" (UID: \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\") " pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" Jul 12 19:54:59.390207 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:54:59.390070 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/513c7ea9-a521-47a3-94d9-f1ee8be666c2-istio-envoy\") pod \"e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b\" (UID: \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\") " pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" Jul 12 19:54:59.390207 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:54:59.390141 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/513c7ea9-a521-47a3-94d9-f1ee8be666c2-istio-token\") pod \"e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b\" (UID: \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\") " pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" Jul 12 19:54:59.390207 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:54:59.390170 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bwlr\" (UniqueName: \"kubernetes.io/projected/513c7ea9-a521-47a3-94d9-f1ee8be666c2-kube-api-access-9bwlr\") pod \"e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b\" (UID: \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\") " pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" Jul 12 19:54:59.390207 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:54:59.390196 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/513c7ea9-a521-47a3-94d9-f1ee8be666c2-istio-podinfo\") pod \"e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b\" (UID: \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\") " pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" Jul 12 19:54:59.390332 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:54:59.390295 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/513c7ea9-a521-47a3-94d9-f1ee8be666c2-istio-data\") pod \"e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b\" (UID: \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\") " pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" Jul 12 19:54:59.390332 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:54:59.390322 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/513c7ea9-a521-47a3-94d9-f1ee8be666c2-workload-socket\") pod \"e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b\" (UID: \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\") " pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" Jul 12 19:54:59.390401 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:54:59.390339 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/513c7ea9-a521-47a3-94d9-f1ee8be666c2-istiod-ca-cert\") pod \"e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b\" (UID: \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\") " pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" Jul 12 19:54:59.492682 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:54:59.491683 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/513c7ea9-a521-47a3-94d9-f1ee8be666c2-istio-token\") pod \"e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b\" (UID: \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\") " pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" Jul 12 19:54:59.492682 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:54:59.491765 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bwlr\" (UniqueName: \"kubernetes.io/projected/513c7ea9-a521-47a3-94d9-f1ee8be666c2-kube-api-access-9bwlr\") pod \"e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b\" (UID: \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\") " pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" Jul 12 19:54:59.492682 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:54:59.491833 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/513c7ea9-a521-47a3-94d9-f1ee8be666c2-istio-podinfo\") pod \"e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b\" (UID: \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\") " pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" Jul 12 19:54:59.492682 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:54:59.491980 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/513c7ea9-a521-47a3-94d9-f1ee8be666c2-istio-data\") pod \"e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b\" (UID: \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\") " pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" Jul 12 19:54:59.492682 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:54:59.492055 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/513c7ea9-a521-47a3-94d9-f1ee8be666c2-workload-socket\") pod \"e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b\" (UID: \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\") " pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" Jul 12 19:54:59.492682 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:54:59.492093 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/513c7ea9-a521-47a3-94d9-f1ee8be666c2-istiod-ca-cert\") pod \"e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b\" (UID: \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\") " pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" Jul 12 19:54:59.492682 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:54:59.492168 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/513c7ea9-a521-47a3-94d9-f1ee8be666c2-credential-socket\") pod \"e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b\" (UID: \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\") " pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" Jul 12 19:54:59.492682 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:54:59.492198 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/513c7ea9-a521-47a3-94d9-f1ee8be666c2-workload-certs\") pod \"e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b\" (UID: \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\") " pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" Jul 12 19:54:59.492682 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:54:59.492257 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/513c7ea9-a521-47a3-94d9-f1ee8be666c2-istio-envoy\") pod \"e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b\" (UID: \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\") " pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" Jul 12 19:54:59.493270 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:54:59.493088 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/513c7ea9-a521-47a3-94d9-f1ee8be666c2-istiod-ca-cert\") pod \"e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b\" (UID: \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\") " pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" Jul 12 19:54:59.493810 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:54:59.493323 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/513c7ea9-a521-47a3-94d9-f1ee8be666c2-istio-data\") pod \"e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b\" (UID: \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\") " pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" Jul 12 19:54:59.493810 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:54:59.493537 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/513c7ea9-a521-47a3-94d9-f1ee8be666c2-workload-socket\") pod \"e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b\" (UID: \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\") " pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" Jul 12 19:54:59.493810 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:54:59.493736 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/513c7ea9-a521-47a3-94d9-f1ee8be666c2-credential-socket\") pod \"e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b\" (UID: \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\") " pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" Jul 12 19:54:59.493810 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:54:59.493767 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/513c7ea9-a521-47a3-94d9-f1ee8be666c2-workload-certs\") pod \"e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b\" (UID: \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\") " pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" Jul 12 19:54:59.498691 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:54:59.498662 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/513c7ea9-a521-47a3-94d9-f1ee8be666c2-istio-podinfo\") pod \"e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b\" (UID: \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\") " pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" Jul 12 19:54:59.501114 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:54:59.499981 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/513c7ea9-a521-47a3-94d9-f1ee8be666c2-istio-envoy\") pod \"e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b\" (UID: \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\") " pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" Jul 12 19:54:59.501900 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:54:59.501874 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bwlr\" (UniqueName: \"kubernetes.io/projected/513c7ea9-a521-47a3-94d9-f1ee8be666c2-kube-api-access-9bwlr\") pod \"e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b\" (UID: \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\") " pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" Jul 12 19:54:59.502027 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:54:59.501924 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/513c7ea9-a521-47a3-94d9-f1ee8be666c2-istio-token\") pod \"e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b\" (UID: \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\") " pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" Jul 12 19:54:59.573170 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:54:59.573104 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" Jul 12 19:54:59.714126 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:54:59.714098 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b"] Jul 12 19:54:59.715079 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:54:59.715049 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod513c7ea9_a521_47a3_94d9_f1ee8be666c2.slice/crio-de77c532bcf570d4ac1846d8f6b0d8e13200ac920f4de83f8db05e7d9eb91c37 WatchSource:0}: Error finding container de77c532bcf570d4ac1846d8f6b0d8e13200ac920f4de83f8db05e7d9eb91c37: Status 404 returned error can't find the container with id de77c532bcf570d4ac1846d8f6b0d8e13200ac920f4de83f8db05e7d9eb91c37 Jul 12 19:54:59.717226 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:54:59.717195 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 12 19:54:59.717299 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:54:59.717261 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 12 19:54:59.717299 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:54:59.717288 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 12 19:55:00.264861 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:55:00.264825 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" event={"ID":"513c7ea9-a521-47a3-94d9-f1ee8be666c2","Type":"ContainerStarted","Data":"413abdc40a427feb7c91ddeb2f9a53cbe49873e9d7d617740874cf2e1d5785ef"} Jul 12 19:55:00.265331 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:55:00.264877 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" event={"ID":"513c7ea9-a521-47a3-94d9-f1ee8be666c2","Type":"ContainerStarted","Data":"de77c532bcf570d4ac1846d8f6b0d8e13200ac920f4de83f8db05e7d9eb91c37"} Jul 12 19:55:00.287642 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:55:00.287583 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" podStartSLOduration=1.287567544 podStartE2EDuration="1.287567544s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:54:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:55:00.284804893 +0000 UTC m=+1971.739397869" watchObservedRunningTime="2026-07-12 19:55:00.287567544 +0000 UTC m=+1971.742160507" Jul 12 19:55:00.573378 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:55:00.573292 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" Jul 12 19:55:00.578065 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:55:00.578039 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" Jul 12 19:55:01.270747 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:55:01.270670 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" Jul 12 19:55:01.271867 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:55:01.271844 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" Jul 12 19:55:16.260683 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:55:16.260650 2576 scope.go:117] "RemoveContainer" containerID="37d151f269d88b7c7529da174ea9b76fe0f6f3b55d5f52b48f773a3474c0888f" Jul 12 19:55:16.272626 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:55:16.272601 2576 patch_prober.go:28] interesting pod/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body= Jul 12 19:55:16.272734 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:55:16.272648 2576 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" podUID="513c7ea9-a521-47a3-94d9-f1ee8be666c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" Jul 12 19:55:16.378963 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:55:16.378887 2576 generic.go:356] "Generic (PLEG): container finished" podID="513c7ea9-a521-47a3-94d9-f1ee8be666c2" containerID="413abdc40a427feb7c91ddeb2f9a53cbe49873e9d7d617740874cf2e1d5785ef" exitCode=0 Jul 12 19:55:16.379092 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:55:16.378962 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" event={"ID":"513c7ea9-a521-47a3-94d9-f1ee8be666c2","Type":"ContainerDied","Data":"413abdc40a427feb7c91ddeb2f9a53cbe49873e9d7d617740874cf2e1d5785ef"} Jul 12 19:55:16.379390 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:55:16.379376 2576 scope.go:117] "RemoveContainer" containerID="413abdc40a427feb7c91ddeb2f9a53cbe49873e9d7d617740874cf2e1d5785ef" Jul 12 19:55:16.380445 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:55:16.380414 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 12 19:55:16.380533 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:55:16.380496 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 12 19:55:16.380570 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:55:16.380542 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 12 19:55:17.387247 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:55:17.387213 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" event={"ID":"513c7ea9-a521-47a3-94d9-f1ee8be666c2","Type":"ContainerStarted","Data":"80892841913f279563a2b867821529ec7e6686c7def0ca96dc9ff1d01c25db56"} Jul 12 19:55:17.574223 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:55:17.574191 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" Jul 12 19:55:17.574467 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:55:17.574441 2576 patch_prober.go:28] interesting pod/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body= Jul 12 19:55:17.574517 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:55:17.574489 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" podUID="513c7ea9-a521-47a3-94d9-f1ee8be666c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" Jul 12 19:55:18.573627 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:55:18.573595 2576 patch_prober.go:28] interesting pod/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body= Jul 12 19:55:18.574063 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:55:18.573646 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" podUID="513c7ea9-a521-47a3-94d9-f1ee8be666c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" Jul 12 19:55:19.574336 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:55:19.574305 2576 patch_prober.go:28] interesting pod/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body= Jul 12 19:55:19.574712 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:55:19.574361 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" podUID="513c7ea9-a521-47a3-94d9-f1ee8be666c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" Jul 12 19:55:20.573821 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:55:20.573785 2576 patch_prober.go:28] interesting pod/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" start-of-body= Jul 12 19:55:20.574024 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:55:20.573852 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" podUID="513c7ea9-a521-47a3-94d9-f1ee8be666c2" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.61:15021/healthz/ready\": dial tcp 10.133.0.61:15021: connect: connection refused" Jul 12 19:55:21.577345 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:55:21.577314 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" Jul 12 19:55:21.577715 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:55:21.577569 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" Jul 12 19:55:21.578314 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:55:21.578295 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" Jul 12 19:56:55.280551 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:56:55.280513 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b"] Jul 12 19:56:55.281075 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:56:55.280729 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" podUID="513c7ea9-a521-47a3-94d9-f1ee8be666c2" containerName="istio-proxy" containerID="cri-o://80892841913f279563a2b867821529ec7e6686c7def0ca96dc9ff1d01c25db56" gracePeriod=30 Jul 12 19:57:00.544680 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:00.544619 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" Jul 12 19:57:00.631153 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:00.631120 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9bwlr\" (UniqueName: \"kubernetes.io/projected/513c7ea9-a521-47a3-94d9-f1ee8be666c2-kube-api-access-9bwlr\") pod \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\" (UID: \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\") " Jul 12 19:57:00.631348 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:00.631177 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/513c7ea9-a521-47a3-94d9-f1ee8be666c2-workload-certs\") pod \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\" (UID: \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\") " Jul 12 19:57:00.631348 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:00.631214 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/513c7ea9-a521-47a3-94d9-f1ee8be666c2-credential-socket\") pod \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\" (UID: \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\") " Jul 12 19:57:00.631466 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:00.631382 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/513c7ea9-a521-47a3-94d9-f1ee8be666c2-istio-envoy\") pod \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\" (UID: \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\") " Jul 12 19:57:00.631466 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:00.631442 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/513c7ea9-a521-47a3-94d9-f1ee8be666c2-istiod-ca-cert\") pod \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\" (UID: \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\") " Jul 12 19:57:00.631575 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:00.631485 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/513c7ea9-a521-47a3-94d9-f1ee8be666c2-istio-data\") pod \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\" (UID: \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\") " Jul 12 19:57:00.631575 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:00.631498 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/513c7ea9-a521-47a3-94d9-f1ee8be666c2-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "513c7ea9-a521-47a3-94d9-f1ee8be666c2" (UID: "513c7ea9-a521-47a3-94d9-f1ee8be666c2"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:57:00.631575 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:00.631506 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/513c7ea9-a521-47a3-94d9-f1ee8be666c2-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "513c7ea9-a521-47a3-94d9-f1ee8be666c2" (UID: "513c7ea9-a521-47a3-94d9-f1ee8be666c2"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:57:00.631575 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:00.631570 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/513c7ea9-a521-47a3-94d9-f1ee8be666c2-istio-podinfo\") pod \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\" (UID: \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\") " Jul 12 19:57:00.631793 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:00.631603 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/513c7ea9-a521-47a3-94d9-f1ee8be666c2-istio-token\") pod \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\" (UID: \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\") " Jul 12 19:57:00.631793 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:00.631636 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/513c7ea9-a521-47a3-94d9-f1ee8be666c2-workload-socket\") pod \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\" (UID: \"513c7ea9-a521-47a3-94d9-f1ee8be666c2\") " Jul 12 19:57:00.631910 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:00.631807 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/513c7ea9-a521-47a3-94d9-f1ee8be666c2-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "513c7ea9-a521-47a3-94d9-f1ee8be666c2" (UID: "513c7ea9-a521-47a3-94d9-f1ee8be666c2"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 19:57:00.632099 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:00.632063 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/513c7ea9-a521-47a3-94d9-f1ee8be666c2-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "513c7ea9-a521-47a3-94d9-f1ee8be666c2" (UID: "513c7ea9-a521-47a3-94d9-f1ee8be666c2"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:57:00.632238 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:00.632173 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/513c7ea9-a521-47a3-94d9-f1ee8be666c2-workload-certs\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:57:00.632238 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:00.632197 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/513c7ea9-a521-47a3-94d9-f1ee8be666c2-credential-socket\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:57:00.632238 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:00.632214 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/513c7ea9-a521-47a3-94d9-f1ee8be666c2-istiod-ca-cert\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:57:00.632238 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:00.632229 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/513c7ea9-a521-47a3-94d9-f1ee8be666c2-workload-socket\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:57:00.632469 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:00.632335 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/513c7ea9-a521-47a3-94d9-f1ee8be666c2-istio-data" (OuterVolumeSpecName: "istio-data") pod "513c7ea9-a521-47a3-94d9-f1ee8be666c2" (UID: "513c7ea9-a521-47a3-94d9-f1ee8be666c2"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:57:00.633605 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:00.633576 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/513c7ea9-a521-47a3-94d9-f1ee8be666c2-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "513c7ea9-a521-47a3-94d9-f1ee8be666c2" (UID: "513c7ea9-a521-47a3-94d9-f1ee8be666c2"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:57:00.633722 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:00.633676 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/513c7ea9-a521-47a3-94d9-f1ee8be666c2-kube-api-access-9bwlr" (OuterVolumeSpecName: "kube-api-access-9bwlr") pod "513c7ea9-a521-47a3-94d9-f1ee8be666c2" (UID: "513c7ea9-a521-47a3-94d9-f1ee8be666c2"). InnerVolumeSpecName "kube-api-access-9bwlr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:57:00.633782 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:00.633755 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/513c7ea9-a521-47a3-94d9-f1ee8be666c2-istio-token" (OuterVolumeSpecName: "istio-token") pod "513c7ea9-a521-47a3-94d9-f1ee8be666c2" (UID: "513c7ea9-a521-47a3-94d9-f1ee8be666c2"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:57:00.633837 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:00.633804 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/513c7ea9-a521-47a3-94d9-f1ee8be666c2-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "513c7ea9-a521-47a3-94d9-f1ee8be666c2" (UID: "513c7ea9-a521-47a3-94d9-f1ee8be666c2"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 12 19:57:00.733331 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:00.733287 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/513c7ea9-a521-47a3-94d9-f1ee8be666c2-istio-envoy\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:57:00.733331 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:00.733331 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/513c7ea9-a521-47a3-94d9-f1ee8be666c2-istio-data\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:57:00.733537 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:00.733343 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/513c7ea9-a521-47a3-94d9-f1ee8be666c2-istio-podinfo\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:57:00.733537 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:00.733355 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/513c7ea9-a521-47a3-94d9-f1ee8be666c2-istio-token\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:57:00.733537 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:00.733366 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9bwlr\" (UniqueName: \"kubernetes.io/projected/513c7ea9-a521-47a3-94d9-f1ee8be666c2-kube-api-access-9bwlr\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:57:00.995128 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:00.995094 2576 generic.go:356] "Generic (PLEG): container finished" podID="513c7ea9-a521-47a3-94d9-f1ee8be666c2" containerID="80892841913f279563a2b867821529ec7e6686c7def0ca96dc9ff1d01c25db56" exitCode=0 Jul 12 19:57:00.995326 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:00.995143 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" Jul 12 19:57:00.995326 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:00.995187 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" event={"ID":"513c7ea9-a521-47a3-94d9-f1ee8be666c2","Type":"ContainerDied","Data":"80892841913f279563a2b867821529ec7e6686c7def0ca96dc9ff1d01c25db56"} Jul 12 19:57:00.995326 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:00.995267 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b" event={"ID":"513c7ea9-a521-47a3-94d9-f1ee8be666c2","Type":"ContainerDied","Data":"de77c532bcf570d4ac1846d8f6b0d8e13200ac920f4de83f8db05e7d9eb91c37"} Jul 12 19:57:00.995326 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:00.995290 2576 scope.go:117] "RemoveContainer" containerID="80892841913f279563a2b867821529ec7e6686c7def0ca96dc9ff1d01c25db56" Jul 12 19:57:01.005069 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:01.005047 2576 scope.go:117] "RemoveContainer" containerID="413abdc40a427feb7c91ddeb2f9a53cbe49873e9d7d617740874cf2e1d5785ef" Jul 12 19:57:01.013381 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:01.013365 2576 scope.go:117] "RemoveContainer" containerID="80892841913f279563a2b867821529ec7e6686c7def0ca96dc9ff1d01c25db56" Jul 12 19:57:01.013681 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:57:01.013652 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"80892841913f279563a2b867821529ec7e6686c7def0ca96dc9ff1d01c25db56\": container with ID starting with 80892841913f279563a2b867821529ec7e6686c7def0ca96dc9ff1d01c25db56 not found: ID does not exist" containerID="80892841913f279563a2b867821529ec7e6686c7def0ca96dc9ff1d01c25db56" Jul 12 19:57:01.013794 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:01.013691 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"80892841913f279563a2b867821529ec7e6686c7def0ca96dc9ff1d01c25db56"} err="failed to get container status \"80892841913f279563a2b867821529ec7e6686c7def0ca96dc9ff1d01c25db56\": rpc error: code = NotFound desc = could not find container \"80892841913f279563a2b867821529ec7e6686c7def0ca96dc9ff1d01c25db56\": container with ID starting with 80892841913f279563a2b867821529ec7e6686c7def0ca96dc9ff1d01c25db56 not found: ID does not exist" Jul 12 19:57:01.013794 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:01.013782 2576 scope.go:117] "RemoveContainer" containerID="413abdc40a427feb7c91ddeb2f9a53cbe49873e9d7d617740874cf2e1d5785ef" Jul 12 19:57:01.014277 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:57:01.014254 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"413abdc40a427feb7c91ddeb2f9a53cbe49873e9d7d617740874cf2e1d5785ef\": container with ID starting with 413abdc40a427feb7c91ddeb2f9a53cbe49873e9d7d617740874cf2e1d5785ef not found: ID does not exist" containerID="413abdc40a427feb7c91ddeb2f9a53cbe49873e9d7d617740874cf2e1d5785ef" Jul 12 19:57:01.014385 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:01.014285 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"413abdc40a427feb7c91ddeb2f9a53cbe49873e9d7d617740874cf2e1d5785ef"} err="failed to get container status \"413abdc40a427feb7c91ddeb2f9a53cbe49873e9d7d617740874cf2e1d5785ef\": rpc error: code = NotFound desc = could not find container \"413abdc40a427feb7c91ddeb2f9a53cbe49873e9d7d617740874cf2e1d5785ef\": container with ID starting with 413abdc40a427feb7c91ddeb2f9a53cbe49873e9d7d617740874cf2e1d5785ef not found: ID does not exist" Jul 12 19:57:01.016928 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:01.016904 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b"] Jul 12 19:57:01.026570 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:01.026552 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-a78ace-openshift-default-78bbd7489c-zsw8b"] Jul 12 19:57:01.083893 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:01.083861 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="513c7ea9-a521-47a3-94d9-f1ee8be666c2" path="/var/lib/kubelet/pods/513c7ea9-a521-47a3-94d9-f1ee8be666c2/volumes" Jul 12 19:57:03.934820 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:03.934787 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4"] Jul 12 19:57:03.935445 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:03.935426 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="513c7ea9-a521-47a3-94d9-f1ee8be666c2" containerName="istio-proxy" Jul 12 19:57:03.935506 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:03.935447 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="513c7ea9-a521-47a3-94d9-f1ee8be666c2" containerName="istio-proxy" Jul 12 19:57:03.935506 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:03.935465 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="513c7ea9-a521-47a3-94d9-f1ee8be666c2" containerName="istio-proxy" Jul 12 19:57:03.935506 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:03.935471 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="513c7ea9-a521-47a3-94d9-f1ee8be666c2" containerName="istio-proxy" Jul 12 19:57:03.935613 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:03.935538 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="513c7ea9-a521-47a3-94d9-f1ee8be666c2" containerName="istio-proxy" Jul 12 19:57:03.935613 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:03.935548 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="513c7ea9-a521-47a3-94d9-f1ee8be666c2" containerName="istio-proxy" Jul 12 19:57:03.940023 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:03.940003 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" Jul 12 19:57:03.942316 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:03.942296 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-202584-openshift-default-dockercfg-tqbhh\"" Jul 12 19:57:03.948790 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:03.948768 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4"] Jul 12 19:57:04.067384 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:04.067351 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10f669f8-d466-40f4-863c-af2db4b227de-istio-envoy\") pod \"e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4\" (UID: \"10f669f8-d466-40f4-863c-af2db4b227de\") " pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" Jul 12 19:57:04.067384 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:04.067384 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10f669f8-d466-40f4-863c-af2db4b227de-istio-data\") pod \"e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4\" (UID: \"10f669f8-d466-40f4-863c-af2db4b227de\") " pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" Jul 12 19:57:04.067616 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:04.067409 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10f669f8-d466-40f4-863c-af2db4b227de-istiod-ca-cert\") pod \"e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4\" (UID: \"10f669f8-d466-40f4-863c-af2db4b227de\") " pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" Jul 12 19:57:04.067616 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:04.067432 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10f669f8-d466-40f4-863c-af2db4b227de-workload-certs\") pod \"e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4\" (UID: \"10f669f8-d466-40f4-863c-af2db4b227de\") " pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" Jul 12 19:57:04.067616 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:04.067503 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10f669f8-d466-40f4-863c-af2db4b227de-istio-podinfo\") pod \"e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4\" (UID: \"10f669f8-d466-40f4-863c-af2db4b227de\") " pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" Jul 12 19:57:04.067616 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:04.067593 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10f669f8-d466-40f4-863c-af2db4b227de-credential-socket\") pod \"e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4\" (UID: \"10f669f8-d466-40f4-863c-af2db4b227de\") " pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" Jul 12 19:57:04.067764 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:04.067644 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10f669f8-d466-40f4-863c-af2db4b227de-workload-socket\") pod \"e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4\" (UID: \"10f669f8-d466-40f4-863c-af2db4b227de\") " pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" Jul 12 19:57:04.067764 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:04.067666 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c7m8d\" (UniqueName: \"kubernetes.io/projected/10f669f8-d466-40f4-863c-af2db4b227de-kube-api-access-c7m8d\") pod \"e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4\" (UID: \"10f669f8-d466-40f4-863c-af2db4b227de\") " pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" Jul 12 19:57:04.067764 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:04.067688 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10f669f8-d466-40f4-863c-af2db4b227de-istio-token\") pod \"e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4\" (UID: \"10f669f8-d466-40f4-863c-af2db4b227de\") " pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" Jul 12 19:57:04.168643 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:04.168608 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10f669f8-d466-40f4-863c-af2db4b227de-credential-socket\") pod \"e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4\" (UID: \"10f669f8-d466-40f4-863c-af2db4b227de\") " pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" Jul 12 19:57:04.168793 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:04.168669 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10f669f8-d466-40f4-863c-af2db4b227de-workload-socket\") pod \"e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4\" (UID: \"10f669f8-d466-40f4-863c-af2db4b227de\") " pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" Jul 12 19:57:04.168793 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:04.168697 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c7m8d\" (UniqueName: \"kubernetes.io/projected/10f669f8-d466-40f4-863c-af2db4b227de-kube-api-access-c7m8d\") pod \"e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4\" (UID: \"10f669f8-d466-40f4-863c-af2db4b227de\") " pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" Jul 12 19:57:04.168793 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:04.168727 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10f669f8-d466-40f4-863c-af2db4b227de-istio-token\") pod \"e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4\" (UID: \"10f669f8-d466-40f4-863c-af2db4b227de\") " pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" Jul 12 19:57:04.168977 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:04.168801 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10f669f8-d466-40f4-863c-af2db4b227de-istio-envoy\") pod \"e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4\" (UID: \"10f669f8-d466-40f4-863c-af2db4b227de\") " pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" Jul 12 19:57:04.168977 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:04.168826 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10f669f8-d466-40f4-863c-af2db4b227de-istio-data\") pod \"e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4\" (UID: \"10f669f8-d466-40f4-863c-af2db4b227de\") " pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" Jul 12 19:57:04.168977 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:04.168850 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10f669f8-d466-40f4-863c-af2db4b227de-istiod-ca-cert\") pod \"e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4\" (UID: \"10f669f8-d466-40f4-863c-af2db4b227de\") " pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" Jul 12 19:57:04.168977 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:04.168880 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10f669f8-d466-40f4-863c-af2db4b227de-workload-certs\") pod \"e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4\" (UID: \"10f669f8-d466-40f4-863c-af2db4b227de\") " pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" Jul 12 19:57:04.168977 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:04.168908 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10f669f8-d466-40f4-863c-af2db4b227de-istio-podinfo\") pod \"e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4\" (UID: \"10f669f8-d466-40f4-863c-af2db4b227de\") " pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" Jul 12 19:57:04.169257 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:04.169017 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10f669f8-d466-40f4-863c-af2db4b227de-credential-socket\") pod \"e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4\" (UID: \"10f669f8-d466-40f4-863c-af2db4b227de\") " pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" Jul 12 19:57:04.169257 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:04.169078 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10f669f8-d466-40f4-863c-af2db4b227de-workload-socket\") pod \"e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4\" (UID: \"10f669f8-d466-40f4-863c-af2db4b227de\") " pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" Jul 12 19:57:04.169257 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:04.169153 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10f669f8-d466-40f4-863c-af2db4b227de-istio-data\") pod \"e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4\" (UID: \"10f669f8-d466-40f4-863c-af2db4b227de\") " pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" Jul 12 19:57:04.169412 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:04.169257 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10f669f8-d466-40f4-863c-af2db4b227de-workload-certs\") pod \"e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4\" (UID: \"10f669f8-d466-40f4-863c-af2db4b227de\") " pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" Jul 12 19:57:04.169513 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:04.169494 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10f669f8-d466-40f4-863c-af2db4b227de-istiod-ca-cert\") pod \"e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4\" (UID: \"10f669f8-d466-40f4-863c-af2db4b227de\") " pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" Jul 12 19:57:04.171099 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:04.171077 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10f669f8-d466-40f4-863c-af2db4b227de-istio-envoy\") pod \"e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4\" (UID: \"10f669f8-d466-40f4-863c-af2db4b227de\") " pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" Jul 12 19:57:04.171330 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:04.171311 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10f669f8-d466-40f4-863c-af2db4b227de-istio-podinfo\") pod \"e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4\" (UID: \"10f669f8-d466-40f4-863c-af2db4b227de\") " pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" Jul 12 19:57:04.177187 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:04.177163 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10f669f8-d466-40f4-863c-af2db4b227de-istio-token\") pod \"e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4\" (UID: \"10f669f8-d466-40f4-863c-af2db4b227de\") " pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" Jul 12 19:57:04.177573 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:04.177555 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c7m8d\" (UniqueName: \"kubernetes.io/projected/10f669f8-d466-40f4-863c-af2db4b227de-kube-api-access-c7m8d\") pod \"e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4\" (UID: \"10f669f8-d466-40f4-863c-af2db4b227de\") " pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" Jul 12 19:57:04.251716 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:04.251695 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" Jul 12 19:57:04.387267 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:04.387239 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4"] Jul 12 19:57:04.388902 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:57:04.388876 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10f669f8_d466_40f4_863c_af2db4b227de.slice/crio-a0fb3ea8daf66781d67baf61b83aa25a76b184167b953f2e3423d0da70786779 WatchSource:0}: Error finding container a0fb3ea8daf66781d67baf61b83aa25a76b184167b953f2e3423d0da70786779: Status 404 returned error can't find the container with id a0fb3ea8daf66781d67baf61b83aa25a76b184167b953f2e3423d0da70786779 Jul 12 19:57:04.391477 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:04.391447 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 12 19:57:04.391576 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:04.391511 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 12 19:57:04.391576 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:04.391540 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 12 19:57:05.021012 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:05.020962 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" event={"ID":"10f669f8-d466-40f4-863c-af2db4b227de","Type":"ContainerStarted","Data":"aa637d594f24cf7160174e98758c599d874ede93f331e7f7f80105a6142e0d14"} Jul 12 19:57:05.021474 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:05.021034 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" event={"ID":"10f669f8-d466-40f4-863c-af2db4b227de","Type":"ContainerStarted","Data":"a0fb3ea8daf66781d67baf61b83aa25a76b184167b953f2e3423d0da70786779"} Jul 12 19:57:05.039050 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:05.038960 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" podStartSLOduration=2.038945158 podStartE2EDuration="2.038945158s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:57:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:57:05.038414978 +0000 UTC m=+2096.493007942" watchObservedRunningTime="2026-07-12 19:57:05.038945158 +0000 UTC m=+2096.493538121" Jul 12 19:57:05.252622 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:05.252587 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" Jul 12 19:57:05.257977 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:05.257952 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" Jul 12 19:57:06.027375 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:06.027347 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" Jul 12 19:57:06.028418 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:06.028394 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" Jul 12 19:57:09.298943 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:09.298914 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mj4zs_888aafef-f377-46e3-a36b-58cbabc198f8/ovn-acl-logging/0.log" Jul 12 19:57:09.302117 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:09.302094 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mj4zs_888aafef-f377-46e3-a36b-58cbabc198f8/ovn-acl-logging/0.log" Jul 12 19:57:26.150479 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:26.150446 2576 generic.go:356] "Generic (PLEG): container finished" podID="10f669f8-d466-40f4-863c-af2db4b227de" containerID="aa637d594f24cf7160174e98758c599d874ede93f331e7f7f80105a6142e0d14" exitCode=0 Jul 12 19:57:26.150479 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:26.150486 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" event={"ID":"10f669f8-d466-40f4-863c-af2db4b227de","Type":"ContainerDied","Data":"aa637d594f24cf7160174e98758c599d874ede93f331e7f7f80105a6142e0d14"} Jul 12 19:57:26.151136 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:26.151006 2576 scope.go:117] "RemoveContainer" containerID="aa637d594f24cf7160174e98758c599d874ede93f331e7f7f80105a6142e0d14" Jul 12 19:57:26.152050 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:26.152022 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 12 19:57:26.152157 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:26.152088 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 12 19:57:26.152157 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:26.152118 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 12 19:57:27.157564 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:27.157533 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" event={"ID":"10f669f8-d466-40f4-863c-af2db4b227de","Type":"ContainerStarted","Data":"c1a59d9247946971a706a80a175eb517beda6fb93172b4642451090f3aaa6524"} Jul 12 19:57:27.252070 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:27.252028 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" Jul 12 19:57:27.252285 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:27.252263 2576 patch_prober.go:28] interesting pod/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body= Jul 12 19:57:27.252336 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:27.252311 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" podUID="10f669f8-d466-40f4-863c-af2db4b227de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" Jul 12 19:57:28.253054 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:28.253023 2576 patch_prober.go:28] interesting pod/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body= Jul 12 19:57:28.253458 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:28.253083 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" podUID="10f669f8-d466-40f4-863c-af2db4b227de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" Jul 12 19:57:29.252498 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:29.252464 2576 patch_prober.go:28] interesting pod/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body= Jul 12 19:57:29.252724 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:29.252525 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" podUID="10f669f8-d466-40f4-863c-af2db4b227de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" Jul 12 19:57:30.252200 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:30.252162 2576 patch_prober.go:28] interesting pod/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" start-of-body= Jul 12 19:57:30.252581 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:30.252224 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" podUID="10f669f8-d466-40f4-863c-af2db4b227de" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.62:15021/healthz/ready\": dial tcp 10.133.0.62:15021: connect: connection refused" Jul 12 19:57:31.255568 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:31.255540 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" Jul 12 19:57:31.256062 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:31.255907 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" Jul 12 19:57:31.256568 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:31.256548 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" Jul 12 19:57:32.429705 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:32.429675 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4"] Jul 12 19:57:33.193232 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:33.193199 2576 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" secret="" err="secret \"e2e-api-b-202584-openshift-default-dockercfg-tqbhh\" not found" Jul 12 19:57:34.198918 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:34.198873 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" podUID="10f669f8-d466-40f4-863c-af2db4b227de" containerName="istio-proxy" containerID="cri-o://c1a59d9247946971a706a80a175eb517beda6fb93172b4642451090f3aaa6524" gracePeriod=30 Jul 12 19:57:39.473581 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:39.473524 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" Jul 12 19:57:39.519776 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:39.519749 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10f669f8-d466-40f4-863c-af2db4b227de-istiod-ca-cert\") pod \"10f669f8-d466-40f4-863c-af2db4b227de\" (UID: \"10f669f8-d466-40f4-863c-af2db4b227de\") " Jul 12 19:57:39.519917 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:39.519807 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10f669f8-d466-40f4-863c-af2db4b227de-istio-envoy\") pod \"10f669f8-d466-40f4-863c-af2db4b227de\" (UID: \"10f669f8-d466-40f4-863c-af2db4b227de\") " Jul 12 19:57:39.519917 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:39.519836 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10f669f8-d466-40f4-863c-af2db4b227de-credential-socket\") pod \"10f669f8-d466-40f4-863c-af2db4b227de\" (UID: \"10f669f8-d466-40f4-863c-af2db4b227de\") " Jul 12 19:57:39.519917 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:39.519882 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10f669f8-d466-40f4-863c-af2db4b227de-workload-certs\") pod \"10f669f8-d466-40f4-863c-af2db4b227de\" (UID: \"10f669f8-d466-40f4-863c-af2db4b227de\") " Jul 12 19:57:39.519917 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:39.519911 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10f669f8-d466-40f4-863c-af2db4b227de-istio-token\") pod \"10f669f8-d466-40f4-863c-af2db4b227de\" (UID: \"10f669f8-d466-40f4-863c-af2db4b227de\") " Jul 12 19:57:39.520151 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:39.519967 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10f669f8-d466-40f4-863c-af2db4b227de-istio-data\") pod \"10f669f8-d466-40f4-863c-af2db4b227de\" (UID: \"10f669f8-d466-40f4-863c-af2db4b227de\") " Jul 12 19:57:39.520151 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:39.520033 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10f669f8-d466-40f4-863c-af2db4b227de-istio-podinfo\") pod \"10f669f8-d466-40f4-863c-af2db4b227de\" (UID: \"10f669f8-d466-40f4-863c-af2db4b227de\") " Jul 12 19:57:39.520151 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:39.520058 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10f669f8-d466-40f4-863c-af2db4b227de-workload-socket\") pod \"10f669f8-d466-40f4-863c-af2db4b227de\" (UID: \"10f669f8-d466-40f4-863c-af2db4b227de\") " Jul 12 19:57:39.520151 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:39.520086 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c7m8d\" (UniqueName: \"kubernetes.io/projected/10f669f8-d466-40f4-863c-af2db4b227de-kube-api-access-c7m8d\") pod \"10f669f8-d466-40f4-863c-af2db4b227de\" (UID: \"10f669f8-d466-40f4-863c-af2db4b227de\") " Jul 12 19:57:39.520151 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:39.520112 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/10f669f8-d466-40f4-863c-af2db4b227de-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "10f669f8-d466-40f4-863c-af2db4b227de" (UID: "10f669f8-d466-40f4-863c-af2db4b227de"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 19:57:39.520151 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:39.520142 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10f669f8-d466-40f4-863c-af2db4b227de-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "10f669f8-d466-40f4-863c-af2db4b227de" (UID: "10f669f8-d466-40f4-863c-af2db4b227de"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:57:39.520470 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:39.520324 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10f669f8-d466-40f4-863c-af2db4b227de-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "10f669f8-d466-40f4-863c-af2db4b227de" (UID: "10f669f8-d466-40f4-863c-af2db4b227de"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:57:39.520470 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:39.520452 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/10f669f8-d466-40f4-863c-af2db4b227de-istiod-ca-cert\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:57:39.520577 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:39.520471 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/10f669f8-d466-40f4-863c-af2db4b227de-credential-socket\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:57:39.520577 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:39.520486 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/10f669f8-d466-40f4-863c-af2db4b227de-workload-socket\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:57:39.520577 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:39.520518 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10f669f8-d466-40f4-863c-af2db4b227de-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "10f669f8-d466-40f4-863c-af2db4b227de" (UID: "10f669f8-d466-40f4-863c-af2db4b227de"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:57:39.520847 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:39.520822 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10f669f8-d466-40f4-863c-af2db4b227de-istio-data" (OuterVolumeSpecName: "istio-data") pod "10f669f8-d466-40f4-863c-af2db4b227de" (UID: "10f669f8-d466-40f4-863c-af2db4b227de"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:57:39.522320 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:39.522295 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/10f669f8-d466-40f4-863c-af2db4b227de-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "10f669f8-d466-40f4-863c-af2db4b227de" (UID: "10f669f8-d466-40f4-863c-af2db4b227de"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 12 19:57:39.522467 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:39.522439 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10f669f8-d466-40f4-863c-af2db4b227de-istio-token" (OuterVolumeSpecName: "istio-token") pod "10f669f8-d466-40f4-863c-af2db4b227de" (UID: "10f669f8-d466-40f4-863c-af2db4b227de"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:57:39.522589 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:39.522548 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/10f669f8-d466-40f4-863c-af2db4b227de-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "10f669f8-d466-40f4-863c-af2db4b227de" (UID: "10f669f8-d466-40f4-863c-af2db4b227de"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 19:57:39.522824 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:39.522802 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/10f669f8-d466-40f4-863c-af2db4b227de-kube-api-access-c7m8d" (OuterVolumeSpecName: "kube-api-access-c7m8d") pod "10f669f8-d466-40f4-863c-af2db4b227de" (UID: "10f669f8-d466-40f4-863c-af2db4b227de"). InnerVolumeSpecName "kube-api-access-c7m8d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 19:57:39.621318 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:39.621274 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/10f669f8-d466-40f4-863c-af2db4b227de-istio-envoy\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:57:39.621318 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:39.621317 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/10f669f8-d466-40f4-863c-af2db4b227de-workload-certs\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:57:39.621479 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:39.621330 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/10f669f8-d466-40f4-863c-af2db4b227de-istio-token\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:57:39.621479 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:39.621343 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/10f669f8-d466-40f4-863c-af2db4b227de-istio-data\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:57:39.621479 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:39.621355 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/10f669f8-d466-40f4-863c-af2db4b227de-istio-podinfo\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:57:39.621479 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:39.621367 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c7m8d\" (UniqueName: \"kubernetes.io/projected/10f669f8-d466-40f4-863c-af2db4b227de-kube-api-access-c7m8d\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 19:57:40.233637 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:40.233599 2576 generic.go:356] "Generic (PLEG): container finished" podID="10f669f8-d466-40f4-863c-af2db4b227de" containerID="c1a59d9247946971a706a80a175eb517beda6fb93172b4642451090f3aaa6524" exitCode=0 Jul 12 19:57:40.233800 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:40.233644 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" Jul 12 19:57:40.233800 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:40.233682 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" event={"ID":"10f669f8-d466-40f4-863c-af2db4b227de","Type":"ContainerDied","Data":"c1a59d9247946971a706a80a175eb517beda6fb93172b4642451090f3aaa6524"} Jul 12 19:57:40.233800 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:40.233735 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4" event={"ID":"10f669f8-d466-40f4-863c-af2db4b227de","Type":"ContainerDied","Data":"a0fb3ea8daf66781d67baf61b83aa25a76b184167b953f2e3423d0da70786779"} Jul 12 19:57:40.233800 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:40.233760 2576 scope.go:117] "RemoveContainer" containerID="c1a59d9247946971a706a80a175eb517beda6fb93172b4642451090f3aaa6524" Jul 12 19:57:40.243583 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:40.243563 2576 scope.go:117] "RemoveContainer" containerID="aa637d594f24cf7160174e98758c599d874ede93f331e7f7f80105a6142e0d14" Jul 12 19:57:40.251981 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:40.251965 2576 scope.go:117] "RemoveContainer" containerID="c1a59d9247946971a706a80a175eb517beda6fb93172b4642451090f3aaa6524" Jul 12 19:57:40.252265 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:57:40.252246 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c1a59d9247946971a706a80a175eb517beda6fb93172b4642451090f3aaa6524\": container with ID starting with c1a59d9247946971a706a80a175eb517beda6fb93172b4642451090f3aaa6524 not found: ID does not exist" containerID="c1a59d9247946971a706a80a175eb517beda6fb93172b4642451090f3aaa6524" Jul 12 19:57:40.252320 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:40.252273 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c1a59d9247946971a706a80a175eb517beda6fb93172b4642451090f3aaa6524"} err="failed to get container status \"c1a59d9247946971a706a80a175eb517beda6fb93172b4642451090f3aaa6524\": rpc error: code = NotFound desc = could not find container \"c1a59d9247946971a706a80a175eb517beda6fb93172b4642451090f3aaa6524\": container with ID starting with c1a59d9247946971a706a80a175eb517beda6fb93172b4642451090f3aaa6524 not found: ID does not exist" Jul 12 19:57:40.252320 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:40.252290 2576 scope.go:117] "RemoveContainer" containerID="aa637d594f24cf7160174e98758c599d874ede93f331e7f7f80105a6142e0d14" Jul 12 19:57:40.252502 ip-10-0-137-63 kubenswrapper[2576]: E0712 19:57:40.252477 2576 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"aa637d594f24cf7160174e98758c599d874ede93f331e7f7f80105a6142e0d14\": container with ID starting with aa637d594f24cf7160174e98758c599d874ede93f331e7f7f80105a6142e0d14 not found: ID does not exist" containerID="aa637d594f24cf7160174e98758c599d874ede93f331e7f7f80105a6142e0d14" Jul 12 19:57:40.252601 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:40.252506 2576 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"aa637d594f24cf7160174e98758c599d874ede93f331e7f7f80105a6142e0d14"} err="failed to get container status \"aa637d594f24cf7160174e98758c599d874ede93f331e7f7f80105a6142e0d14\": rpc error: code = NotFound desc = could not find container \"aa637d594f24cf7160174e98758c599d874ede93f331e7f7f80105a6142e0d14\": container with ID starting with aa637d594f24cf7160174e98758c599d874ede93f331e7f7f80105a6142e0d14 not found: ID does not exist" Jul 12 19:57:40.255710 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:40.255691 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4"] Jul 12 19:57:40.260165 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:40.260146 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-202584-openshift-default-6c7d888bd7-r9bp4"] Jul 12 19:57:40.956612 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:40.956584 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx"] Jul 12 19:57:40.957108 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:40.957068 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10f669f8-d466-40f4-863c-af2db4b227de" containerName="istio-proxy" Jul 12 19:57:40.957108 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:40.957080 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="10f669f8-d466-40f4-863c-af2db4b227de" containerName="istio-proxy" Jul 12 19:57:40.957108 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:40.957092 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="10f669f8-d466-40f4-863c-af2db4b227de" containerName="istio-proxy" Jul 12 19:57:40.957108 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:40.957101 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="10f669f8-d466-40f4-863c-af2db4b227de" containerName="istio-proxy" Jul 12 19:57:40.957332 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:40.957186 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="10f669f8-d466-40f4-863c-af2db4b227de" containerName="istio-proxy" Jul 12 19:57:40.957332 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:40.957198 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="10f669f8-d466-40f4-863c-af2db4b227de" containerName="istio-proxy" Jul 12 19:57:40.961878 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:40.961856 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 19:57:40.964114 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:40.964096 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-5865e5-openshift-default-dockercfg-czsdh\"" Jul 12 19:57:40.973011 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:40.972972 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx"] Jul 12 19:57:41.041171 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:41.041143 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85ab9f11-6823-4b2f-87eb-1b1aef045538-istio-envoy\") pod \"e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx\" (UID: \"85ab9f11-6823-4b2f-87eb-1b1aef045538\") " pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 19:57:41.041309 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:41.041234 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85ab9f11-6823-4b2f-87eb-1b1aef045538-credential-socket\") pod \"e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx\" (UID: \"85ab9f11-6823-4b2f-87eb-1b1aef045538\") " pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 19:57:41.041309 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:41.041266 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85ab9f11-6823-4b2f-87eb-1b1aef045538-istio-token\") pod \"e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx\" (UID: \"85ab9f11-6823-4b2f-87eb-1b1aef045538\") " pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 19:57:41.041309 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:41.041294 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw2jg\" (UniqueName: \"kubernetes.io/projected/85ab9f11-6823-4b2f-87eb-1b1aef045538-kube-api-access-pw2jg\") pod \"e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx\" (UID: \"85ab9f11-6823-4b2f-87eb-1b1aef045538\") " pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 19:57:41.041452 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:41.041427 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85ab9f11-6823-4b2f-87eb-1b1aef045538-istio-data\") pod \"e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx\" (UID: \"85ab9f11-6823-4b2f-87eb-1b1aef045538\") " pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 19:57:41.041542 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:41.041528 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85ab9f11-6823-4b2f-87eb-1b1aef045538-istio-podinfo\") pod \"e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx\" (UID: \"85ab9f11-6823-4b2f-87eb-1b1aef045538\") " pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 19:57:41.041614 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:41.041594 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85ab9f11-6823-4b2f-87eb-1b1aef045538-workload-socket\") pod \"e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx\" (UID: \"85ab9f11-6823-4b2f-87eb-1b1aef045538\") " pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 19:57:41.041659 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:41.041627 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85ab9f11-6823-4b2f-87eb-1b1aef045538-workload-certs\") pod \"e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx\" (UID: \"85ab9f11-6823-4b2f-87eb-1b1aef045538\") " pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 19:57:41.041659 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:41.041646 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85ab9f11-6823-4b2f-87eb-1b1aef045538-istiod-ca-cert\") pod \"e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx\" (UID: \"85ab9f11-6823-4b2f-87eb-1b1aef045538\") " pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 19:57:41.084749 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:41.084719 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="10f669f8-d466-40f4-863c-af2db4b227de" path="/var/lib/kubelet/pods/10f669f8-d466-40f4-863c-af2db4b227de/volumes" Jul 12 19:57:41.142499 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:41.142473 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85ab9f11-6823-4b2f-87eb-1b1aef045538-credential-socket\") pod \"e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx\" (UID: \"85ab9f11-6823-4b2f-87eb-1b1aef045538\") " pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 19:57:41.142499 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:41.142501 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85ab9f11-6823-4b2f-87eb-1b1aef045538-istio-token\") pod \"e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx\" (UID: \"85ab9f11-6823-4b2f-87eb-1b1aef045538\") " pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 19:57:41.142710 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:41.142519 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw2jg\" (UniqueName: \"kubernetes.io/projected/85ab9f11-6823-4b2f-87eb-1b1aef045538-kube-api-access-pw2jg\") pod \"e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx\" (UID: \"85ab9f11-6823-4b2f-87eb-1b1aef045538\") " pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 19:57:41.142710 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:41.142546 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85ab9f11-6823-4b2f-87eb-1b1aef045538-istio-data\") pod \"e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx\" (UID: \"85ab9f11-6823-4b2f-87eb-1b1aef045538\") " pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 19:57:41.142844 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:41.142778 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85ab9f11-6823-4b2f-87eb-1b1aef045538-istio-podinfo\") pod \"e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx\" (UID: \"85ab9f11-6823-4b2f-87eb-1b1aef045538\") " pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 19:57:41.142906 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:41.142844 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85ab9f11-6823-4b2f-87eb-1b1aef045538-workload-socket\") pod \"e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx\" (UID: \"85ab9f11-6823-4b2f-87eb-1b1aef045538\") " pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 19:57:41.142906 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:41.142878 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85ab9f11-6823-4b2f-87eb-1b1aef045538-workload-certs\") pod \"e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx\" (UID: \"85ab9f11-6823-4b2f-87eb-1b1aef045538\") " pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 19:57:41.142906 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:41.142887 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85ab9f11-6823-4b2f-87eb-1b1aef045538-credential-socket\") pod \"e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx\" (UID: \"85ab9f11-6823-4b2f-87eb-1b1aef045538\") " pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 19:57:41.143092 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:41.142902 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85ab9f11-6823-4b2f-87eb-1b1aef045538-istio-data\") pod \"e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx\" (UID: \"85ab9f11-6823-4b2f-87eb-1b1aef045538\") " pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 19:57:41.143092 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:41.142910 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85ab9f11-6823-4b2f-87eb-1b1aef045538-istiod-ca-cert\") pod \"e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx\" (UID: \"85ab9f11-6823-4b2f-87eb-1b1aef045538\") " pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 19:57:41.143092 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:41.143064 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85ab9f11-6823-4b2f-87eb-1b1aef045538-istio-envoy\") pod \"e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx\" (UID: \"85ab9f11-6823-4b2f-87eb-1b1aef045538\") " pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 19:57:41.143249 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:41.143163 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85ab9f11-6823-4b2f-87eb-1b1aef045538-workload-socket\") pod \"e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx\" (UID: \"85ab9f11-6823-4b2f-87eb-1b1aef045538\") " pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 19:57:41.143249 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:41.143182 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85ab9f11-6823-4b2f-87eb-1b1aef045538-workload-certs\") pod \"e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx\" (UID: \"85ab9f11-6823-4b2f-87eb-1b1aef045538\") " pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 19:57:41.143745 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:41.143720 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85ab9f11-6823-4b2f-87eb-1b1aef045538-istiod-ca-cert\") pod \"e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx\" (UID: \"85ab9f11-6823-4b2f-87eb-1b1aef045538\") " pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 19:57:41.145134 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:41.145116 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85ab9f11-6823-4b2f-87eb-1b1aef045538-istio-envoy\") pod \"e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx\" (UID: \"85ab9f11-6823-4b2f-87eb-1b1aef045538\") " pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 19:57:41.145273 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:41.145256 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85ab9f11-6823-4b2f-87eb-1b1aef045538-istio-podinfo\") pod \"e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx\" (UID: \"85ab9f11-6823-4b2f-87eb-1b1aef045538\") " pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 19:57:41.152103 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:41.152079 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85ab9f11-6823-4b2f-87eb-1b1aef045538-istio-token\") pod \"e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx\" (UID: \"85ab9f11-6823-4b2f-87eb-1b1aef045538\") " pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 19:57:41.152331 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:41.152311 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw2jg\" (UniqueName: \"kubernetes.io/projected/85ab9f11-6823-4b2f-87eb-1b1aef045538-kube-api-access-pw2jg\") pod \"e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx\" (UID: \"85ab9f11-6823-4b2f-87eb-1b1aef045538\") " pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 19:57:41.273657 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:41.273586 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 19:57:41.424558 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:41.424529 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx"] Jul 12 19:57:41.426526 ip-10-0-137-63 kubenswrapper[2576]: W0712 19:57:41.426494 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85ab9f11_6823_4b2f_87eb_1b1aef045538.slice/crio-8f741415aefbdfb31568672876c9dd01ede24c7ede30755e4c8f8ed3f06c4237 WatchSource:0}: Error finding container 8f741415aefbdfb31568672876c9dd01ede24c7ede30755e4c8f8ed3f06c4237: Status 404 returned error can't find the container with id 8f741415aefbdfb31568672876c9dd01ede24c7ede30755e4c8f8ed3f06c4237 Jul 12 19:57:41.428846 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:41.428815 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 12 19:57:41.428942 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:41.428893 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 12 19:57:41.429021 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:41.428939 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 12 19:57:42.250592 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:42.250556 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" event={"ID":"85ab9f11-6823-4b2f-87eb-1b1aef045538","Type":"ContainerStarted","Data":"128ab18f0fe433de8799bd6366ec6329341d9254ede8565ac48f905e79fce865"} Jul 12 19:57:42.251084 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:42.250611 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" event={"ID":"85ab9f11-6823-4b2f-87eb-1b1aef045538","Type":"ContainerStarted","Data":"8f741415aefbdfb31568672876c9dd01ede24c7ede30755e4c8f8ed3f06c4237"} Jul 12 19:57:42.269754 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:42.269701 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" podStartSLOduration=2.2696857169999998 podStartE2EDuration="2.269685717s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 19:57:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 19:57:42.266768741 +0000 UTC m=+2133.721361715" watchObservedRunningTime="2026-07-12 19:57:42.269685717 +0000 UTC m=+2133.724278681" Jul 12 19:57:42.274211 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:42.274180 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 19:57:42.275411 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:42.275392 2576 patch_prober.go:28] interesting pod/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body= Jul 12 19:57:42.275474 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:42.275434 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" podUID="85ab9f11-6823-4b2f-87eb-1b1aef045538" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" Jul 12 19:57:43.277842 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:43.277813 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 19:57:44.263863 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:44.263832 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 19:57:44.264800 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:44.264778 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 19:57:58.348529 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:58.348490 2576 generic.go:356] "Generic (PLEG): container finished" podID="85ab9f11-6823-4b2f-87eb-1b1aef045538" containerID="128ab18f0fe433de8799bd6366ec6329341d9254ede8565ac48f905e79fce865" exitCode=0 Jul 12 19:57:58.348948 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:58.348562 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" event={"ID":"85ab9f11-6823-4b2f-87eb-1b1aef045538","Type":"ContainerDied","Data":"128ab18f0fe433de8799bd6366ec6329341d9254ede8565ac48f905e79fce865"} Jul 12 19:57:58.349038 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:58.349018 2576 scope.go:117] "RemoveContainer" containerID="128ab18f0fe433de8799bd6366ec6329341d9254ede8565ac48f905e79fce865" Jul 12 19:57:58.356591 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:58.350512 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 12 19:57:58.356591 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:58.350708 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 12 19:57:58.356591 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:58.350804 2576 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 12 19:57:59.264746 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:59.264705 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 19:57:59.355980 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:57:59.355942 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" event={"ID":"85ab9f11-6823-4b2f-87eb-1b1aef045538","Type":"ContainerStarted","Data":"3cde5581cdf0bded0201ab1a7173482423b776056969f179490adcf274542d82"} Jul 12 19:58:00.274393 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:58:00.274357 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 19:58:00.275383 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:58:00.275359 2576 patch_prober.go:28] interesting pod/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body= Jul 12 19:58:00.275497 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:58:00.275408 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" podUID="85ab9f11-6823-4b2f-87eb-1b1aef045538" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" Jul 12 19:58:01.274344 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:58:01.274267 2576 patch_prober.go:28] interesting pod/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body= Jul 12 19:58:01.274344 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:58:01.274321 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" podUID="85ab9f11-6823-4b2f-87eb-1b1aef045538" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" Jul 12 19:58:02.274753 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:58:02.274718 2576 patch_prober.go:28] interesting pod/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" start-of-body= Jul 12 19:58:02.275182 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:58:02.274771 2576 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" podUID="85ab9f11-6823-4b2f-87eb-1b1aef045538" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.63:15021/healthz/ready\": dial tcp 10.133.0.63:15021: connect: connection refused" Jul 12 19:58:03.295558 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:58:03.295522 2576 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 19:58:03.296083 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:58:03.295951 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 19:58:03.296803 ip-10-0-137-63 kubenswrapper[2576]: I0712 19:58:03.296780 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 20:02:09.340580 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:02:09.340552 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mj4zs_888aafef-f377-46e3-a36b-58cbabc198f8/ovn-acl-logging/0.log" Jul 12 20:02:09.343727 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:02:09.343706 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-mj4zs_888aafef-f377-46e3-a36b-58cbabc198f8/ovn-acl-logging/0.log" Jul 12 20:04:11.422734 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:11.422649 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx"] Jul 12 20:04:11.423346 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:11.422901 2576 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" podUID="85ab9f11-6823-4b2f-87eb-1b1aef045538" containerName="istio-proxy" containerID="cri-o://3cde5581cdf0bded0201ab1a7173482423b776056969f179490adcf274542d82" gracePeriod=30 Jul 12 20:04:12.093853 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:12.093816 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5b6599d77-7njlq_a5bad969-641b-4d6a-84fc-db7731d83f70/authorino/0.log" Jul 12 20:04:16.549745 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:16.549716 2576 generic.go:356] "Generic (PLEG): container finished" podID="85ab9f11-6823-4b2f-87eb-1b1aef045538" containerID="3cde5581cdf0bded0201ab1a7173482423b776056969f179490adcf274542d82" exitCode=0 Jul 12 20:04:16.550098 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:16.549786 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" event={"ID":"85ab9f11-6823-4b2f-87eb-1b1aef045538","Type":"ContainerDied","Data":"3cde5581cdf0bded0201ab1a7173482423b776056969f179490adcf274542d82"} Jul 12 20:04:16.550098 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:16.549849 2576 scope.go:117] "RemoveContainer" containerID="128ab18f0fe433de8799bd6366ec6329341d9254ede8565ac48f905e79fce865" Jul 12 20:04:16.683253 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:16.683195 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 20:04:16.759849 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:16.759821 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85ab9f11-6823-4b2f-87eb-1b1aef045538-istio-token\") pod \"85ab9f11-6823-4b2f-87eb-1b1aef045538\" (UID: \"85ab9f11-6823-4b2f-87eb-1b1aef045538\") " Jul 12 20:04:16.760016 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:16.759873 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85ab9f11-6823-4b2f-87eb-1b1aef045538-istio-envoy\") pod \"85ab9f11-6823-4b2f-87eb-1b1aef045538\" (UID: \"85ab9f11-6823-4b2f-87eb-1b1aef045538\") " Jul 12 20:04:16.760016 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:16.759913 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85ab9f11-6823-4b2f-87eb-1b1aef045538-credential-socket\") pod \"85ab9f11-6823-4b2f-87eb-1b1aef045538\" (UID: \"85ab9f11-6823-4b2f-87eb-1b1aef045538\") " Jul 12 20:04:16.760016 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:16.759963 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85ab9f11-6823-4b2f-87eb-1b1aef045538-workload-socket\") pod \"85ab9f11-6823-4b2f-87eb-1b1aef045538\" (UID: \"85ab9f11-6823-4b2f-87eb-1b1aef045538\") " Jul 12 20:04:16.760016 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:16.760012 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pw2jg\" (UniqueName: \"kubernetes.io/projected/85ab9f11-6823-4b2f-87eb-1b1aef045538-kube-api-access-pw2jg\") pod \"85ab9f11-6823-4b2f-87eb-1b1aef045538\" (UID: \"85ab9f11-6823-4b2f-87eb-1b1aef045538\") " Jul 12 20:04:16.760219 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:16.760035 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85ab9f11-6823-4b2f-87eb-1b1aef045538-istiod-ca-cert\") pod \"85ab9f11-6823-4b2f-87eb-1b1aef045538\" (UID: \"85ab9f11-6823-4b2f-87eb-1b1aef045538\") " Jul 12 20:04:16.760219 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:16.760065 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85ab9f11-6823-4b2f-87eb-1b1aef045538-istio-podinfo\") pod \"85ab9f11-6823-4b2f-87eb-1b1aef045538\" (UID: \"85ab9f11-6823-4b2f-87eb-1b1aef045538\") " Jul 12 20:04:16.760219 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:16.760099 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85ab9f11-6823-4b2f-87eb-1b1aef045538-workload-certs\") pod \"85ab9f11-6823-4b2f-87eb-1b1aef045538\" (UID: \"85ab9f11-6823-4b2f-87eb-1b1aef045538\") " Jul 12 20:04:16.760219 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:16.760142 2576 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85ab9f11-6823-4b2f-87eb-1b1aef045538-istio-data\") pod \"85ab9f11-6823-4b2f-87eb-1b1aef045538\" (UID: \"85ab9f11-6823-4b2f-87eb-1b1aef045538\") " Jul 12 20:04:16.760442 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:16.760241 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85ab9f11-6823-4b2f-87eb-1b1aef045538-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "85ab9f11-6823-4b2f-87eb-1b1aef045538" (UID: "85ab9f11-6823-4b2f-87eb-1b1aef045538"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 20:04:16.760442 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:16.760309 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85ab9f11-6823-4b2f-87eb-1b1aef045538-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "85ab9f11-6823-4b2f-87eb-1b1aef045538" (UID: "85ab9f11-6823-4b2f-87eb-1b1aef045538"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 20:04:16.760442 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:16.760419 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/85ab9f11-6823-4b2f-87eb-1b1aef045538-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "85ab9f11-6823-4b2f-87eb-1b1aef045538" (UID: "85ab9f11-6823-4b2f-87eb-1b1aef045538"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 12 20:04:16.760442 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:16.760428 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85ab9f11-6823-4b2f-87eb-1b1aef045538-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "85ab9f11-6823-4b2f-87eb-1b1aef045538" (UID: "85ab9f11-6823-4b2f-87eb-1b1aef045538"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 20:04:16.760654 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:16.760498 2576 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/85ab9f11-6823-4b2f-87eb-1b1aef045538-workload-socket\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 20:04:16.760654 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:16.760517 2576 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/85ab9f11-6823-4b2f-87eb-1b1aef045538-istiod-ca-cert\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 20:04:16.760654 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:16.760532 2576 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/85ab9f11-6823-4b2f-87eb-1b1aef045538-workload-certs\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 20:04:16.760654 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:16.760545 2576 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/85ab9f11-6823-4b2f-87eb-1b1aef045538-credential-socket\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 20:04:16.761012 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:16.760981 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85ab9f11-6823-4b2f-87eb-1b1aef045538-istio-data" (OuterVolumeSpecName: "istio-data") pod "85ab9f11-6823-4b2f-87eb-1b1aef045538" (UID: "85ab9f11-6823-4b2f-87eb-1b1aef045538"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 20:04:16.762282 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:16.762255 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/85ab9f11-6823-4b2f-87eb-1b1aef045538-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "85ab9f11-6823-4b2f-87eb-1b1aef045538" (UID: "85ab9f11-6823-4b2f-87eb-1b1aef045538"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 12 20:04:16.762282 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:16.762274 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85ab9f11-6823-4b2f-87eb-1b1aef045538-kube-api-access-pw2jg" (OuterVolumeSpecName: "kube-api-access-pw2jg") pod "85ab9f11-6823-4b2f-87eb-1b1aef045538" (UID: "85ab9f11-6823-4b2f-87eb-1b1aef045538"). InnerVolumeSpecName "kube-api-access-pw2jg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 20:04:16.762463 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:16.762449 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/85ab9f11-6823-4b2f-87eb-1b1aef045538-istio-token" (OuterVolumeSpecName: "istio-token") pod "85ab9f11-6823-4b2f-87eb-1b1aef045538" (UID: "85ab9f11-6823-4b2f-87eb-1b1aef045538"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 12 20:04:16.762528 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:16.762507 2576 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/85ab9f11-6823-4b2f-87eb-1b1aef045538-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "85ab9f11-6823-4b2f-87eb-1b1aef045538" (UID: "85ab9f11-6823-4b2f-87eb-1b1aef045538"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 12 20:04:16.862060 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:16.862032 2576 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pw2jg\" (UniqueName: \"kubernetes.io/projected/85ab9f11-6823-4b2f-87eb-1b1aef045538-kube-api-access-pw2jg\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 20:04:16.862060 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:16.862059 2576 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/85ab9f11-6823-4b2f-87eb-1b1aef045538-istio-podinfo\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 20:04:16.862206 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:16.862074 2576 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/85ab9f11-6823-4b2f-87eb-1b1aef045538-istio-data\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 20:04:16.862206 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:16.862085 2576 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/85ab9f11-6823-4b2f-87eb-1b1aef045538-istio-token\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 20:04:16.862206 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:16.862095 2576 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/85ab9f11-6823-4b2f-87eb-1b1aef045538-istio-envoy\") on node \"ip-10-0-137-63.ec2.internal\" DevicePath \"\"" Jul 12 20:04:17.231212 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:17.231179 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9zsvq_fe75f8a7-055b-42b3-9120-95152115a284/manager/0.log" Jul 12 20:04:17.447259 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:17.447200 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5449d7969f-nwsdg_73a3c458-394e-4400-b7e8-c8d6855c85ba/copy-manifests/0.log" Jul 12 20:04:17.453963 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:17.453939 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5449d7969f-nwsdg_73a3c458-394e-4400-b7e8-c8d6855c85ba/manager/0.log" Jul 12 20:04:17.557757 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:17.557724 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" event={"ID":"85ab9f11-6823-4b2f-87eb-1b1aef045538","Type":"ContainerDied","Data":"8f741415aefbdfb31568672876c9dd01ede24c7ede30755e4c8f8ed3f06c4237"} Jul 12 20:04:17.557757 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:17.557747 2576 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx" Jul 12 20:04:17.558230 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:17.557790 2576 scope.go:117] "RemoveContainer" containerID="3cde5581cdf0bded0201ab1a7173482423b776056969f179490adcf274542d82" Jul 12 20:04:17.575114 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:17.575090 2576 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx"] Jul 12 20:04:17.583298 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:17.583274 2576 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-5865e5-openshift-default-94596bddc-f6gtx"] Jul 12 20:04:17.694965 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:17.694939 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-qsnfs_e25ac8bd-7a71-4a0a-8742-2acfd1e5d7c1/postgres/0.log" Jul 12 20:04:18.447782 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:18.447750 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sx5hm_1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d/util/0.log" Jul 12 20:04:18.454335 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:18.454286 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sx5hm_1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d/pull/0.log" Jul 12 20:04:18.460243 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:18.460222 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sx5hm_1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d/extract/0.log" Jul 12 20:04:18.567777 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:18.567754 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tdrhh_7ee204fe-56da-4083-b92e-6cee48404ad8/util/0.log" Jul 12 20:04:18.574149 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:18.574128 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tdrhh_7ee204fe-56da-4083-b92e-6cee48404ad8/pull/0.log" Jul 12 20:04:18.580243 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:18.580214 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tdrhh_7ee204fe-56da-4083-b92e-6cee48404ad8/extract/0.log" Jul 12 20:04:18.686621 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:18.686602 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g7trn_bf4a0806-1dc6-4850-924b-3ccecd65b997/pull/0.log" Jul 12 20:04:18.692692 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:18.692671 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g7trn_bf4a0806-1dc6-4850-924b-3ccecd65b997/extract/0.log" Jul 12 20:04:18.698367 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:18.698287 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g7trn_bf4a0806-1dc6-4850-924b-3ccecd65b997/util/0.log" Jul 12 20:04:18.804131 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:18.800699 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sn52n_14bade62-668c-4df2-a2d4-2ac60f1e6094/util/0.log" Jul 12 20:04:18.809975 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:18.809954 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sn52n_14bade62-668c-4df2-a2d4-2ac60f1e6094/pull/0.log" Jul 12 20:04:18.815800 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:18.815770 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sn52n_14bade62-668c-4df2-a2d4-2ac60f1e6094/extract/0.log" Jul 12 20:04:18.932217 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:18.932181 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5b6599d77-7njlq_a5bad969-641b-4d6a-84fc-db7731d83f70/authorino/0.log" Jul 12 20:04:19.046790 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:19.046709 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-wbwk8_e5b98265-fd90-4b00-a8fb-6aad2eda6308/manager/0.log" Jul 12 20:04:19.084296 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:19.084263 2576 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="85ab9f11-6823-4b2f-87eb-1b1aef045538" path="/var/lib/kubelet/pods/85ab9f11-6823-4b2f-87eb-1b1aef045538/volumes" Jul 12 20:04:19.157067 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:19.157013 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-tmxhm_cee282b2-f6e2-4180-95b4-521dcc13ecdf/manager/0.log" Jul 12 20:04:19.262286 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:19.262260 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-58nvv_84eb4da4-7798-4a28-85e5-16369b69caeb/kuadrant-console-plugin/0.log" Jul 12 20:04:19.379026 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:19.378938 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ptnpz_c39de0eb-143b-40d0-bdcc-f82958842e6e/registry-server/0.log" Jul 12 20:04:19.497487 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:19.497435 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-svqnf_aaca7341-8abd-4c8e-8d01-a318cf6f44d7/manager/0.log" Jul 12 20:04:19.725125 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:19.725102 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-jmlrw_dab9a189-e4fe-45a9-a841-7f5052ebc607/manager/0.log" Jul 12 20:04:20.383341 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:20.383309 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-654967888b-rnlk6_42d6a7be-2253-4d88-8992-8fe83e2ea727/kube-auth-proxy/0.log" Jul 12 20:04:20.498741 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:20.498711 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-888r7_5465dd47-b0dd-4a80-9db3-b93843ab360b/istio-proxy/1.log" Jul 12 20:04:20.614892 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:20.614865 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-8vnxf_87f2d86e-ac38-4086-a8b9-0eb0ed99c444/payload-pre-processing/0.log" Jul 12 20:04:20.731073 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:20.731031 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-slbvp_afe113f3-d8a5-42b9-a0d6-11d267c72959/payload-processing/0.log" Jul 12 20:04:21.378024 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:21.377970 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-pcm7h_bdd04f9f-ce0d-4bd6-9255-c2da857c2d8e/main/0.log" Jul 12 20:04:21.490338 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:21.490314 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbh7qtd_1c296436-24d1-4a7c-900a-7b2f5bb5c399/main/0.log" Jul 12 20:04:21.707742 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:21.707718 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-jzx9z_6dcd90ba-b7b6-49ac-8bb1-a272b95383df/main/0.log" Jul 12 20:04:26.067203 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:26.067169 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wqrhv/must-gather-kx6zw"] Jul 12 20:04:26.067830 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:26.067805 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85ab9f11-6823-4b2f-87eb-1b1aef045538" containerName="istio-proxy" Jul 12 20:04:26.067922 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:26.067833 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="85ab9f11-6823-4b2f-87eb-1b1aef045538" containerName="istio-proxy" Jul 12 20:04:26.068021 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:26.067980 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="85ab9f11-6823-4b2f-87eb-1b1aef045538" containerName="istio-proxy" Jul 12 20:04:26.068021 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:26.068019 2576 memory_manager.go:368] "RemoveStaleState removing state" podUID="85ab9f11-6823-4b2f-87eb-1b1aef045538" containerName="istio-proxy" Jul 12 20:04:26.068146 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:26.068132 2576 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="85ab9f11-6823-4b2f-87eb-1b1aef045538" containerName="istio-proxy" Jul 12 20:04:26.068210 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:26.068147 2576 state_mem.go:107] "Deleted CPUSet assignment" podUID="85ab9f11-6823-4b2f-87eb-1b1aef045538" containerName="istio-proxy" Jul 12 20:04:26.072937 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:26.072916 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wqrhv/must-gather-kx6zw" Jul 12 20:04:26.075352 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:26.075332 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wqrhv\"/\"kube-root-ca.crt\"" Jul 12 20:04:26.076118 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:26.076096 2576 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wqrhv\"/\"openshift-service-ca.crt\"" Jul 12 20:04:26.076219 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:26.076152 2576 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wqrhv\"/\"default-dockercfg-jbd6q\"" Jul 12 20:04:26.079856 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:26.079831 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wqrhv/must-gather-kx6zw"] Jul 12 20:04:26.140351 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:26.140318 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0b974dea-7599-4350-b8b4-3349a12fad56-must-gather-output\") pod \"must-gather-kx6zw\" (UID: \"0b974dea-7599-4350-b8b4-3349a12fad56\") " pod="openshift-must-gather-wqrhv/must-gather-kx6zw" Jul 12 20:04:26.140516 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:26.140460 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mswkn\" (UniqueName: \"kubernetes.io/projected/0b974dea-7599-4350-b8b4-3349a12fad56-kube-api-access-mswkn\") pod \"must-gather-kx6zw\" (UID: \"0b974dea-7599-4350-b8b4-3349a12fad56\") " pod="openshift-must-gather-wqrhv/must-gather-kx6zw" Jul 12 20:04:26.242063 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:26.242026 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0b974dea-7599-4350-b8b4-3349a12fad56-must-gather-output\") pod \"must-gather-kx6zw\" (UID: \"0b974dea-7599-4350-b8b4-3349a12fad56\") " pod="openshift-must-gather-wqrhv/must-gather-kx6zw" Jul 12 20:04:26.242240 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:26.242099 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mswkn\" (UniqueName: \"kubernetes.io/projected/0b974dea-7599-4350-b8b4-3349a12fad56-kube-api-access-mswkn\") pod \"must-gather-kx6zw\" (UID: \"0b974dea-7599-4350-b8b4-3349a12fad56\") " pod="openshift-must-gather-wqrhv/must-gather-kx6zw" Jul 12 20:04:26.242384 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:26.242363 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0b974dea-7599-4350-b8b4-3349a12fad56-must-gather-output\") pod \"must-gather-kx6zw\" (UID: \"0b974dea-7599-4350-b8b4-3349a12fad56\") " pod="openshift-must-gather-wqrhv/must-gather-kx6zw" Jul 12 20:04:26.255809 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:26.255780 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mswkn\" (UniqueName: \"kubernetes.io/projected/0b974dea-7599-4350-b8b4-3349a12fad56-kube-api-access-mswkn\") pod \"must-gather-kx6zw\" (UID: \"0b974dea-7599-4350-b8b4-3349a12fad56\") " pod="openshift-must-gather-wqrhv/must-gather-kx6zw" Jul 12 20:04:26.384159 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:26.384083 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wqrhv/must-gather-kx6zw" Jul 12 20:04:26.518916 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:26.518889 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wqrhv/must-gather-kx6zw"] Jul 12 20:04:26.520601 ip-10-0-137-63 kubenswrapper[2576]: W0712 20:04:26.520575 2576 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0b974dea_7599_4350_b8b4_3349a12fad56.slice/crio-359b6613ab7f61267c4bb11b2ce52b1990e73118641b8966e2a35543d053ae61 WatchSource:0}: Error finding container 359b6613ab7f61267c4bb11b2ce52b1990e73118641b8966e2a35543d053ae61: Status 404 returned error can't find the container with id 359b6613ab7f61267c4bb11b2ce52b1990e73118641b8966e2a35543d053ae61 Jul 12 20:04:26.522596 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:26.522580 2576 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 12 20:04:26.610202 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:26.610173 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wqrhv/must-gather-kx6zw" event={"ID":"0b974dea-7599-4350-b8b4-3349a12fad56","Type":"ContainerStarted","Data":"359b6613ab7f61267c4bb11b2ce52b1990e73118641b8966e2a35543d053ae61"} Jul 12 20:04:27.620346 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:27.620310 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wqrhv/must-gather-kx6zw" event={"ID":"0b974dea-7599-4350-b8b4-3349a12fad56","Type":"ContainerStarted","Data":"93e2584a5dab867693bd9d0765a0860701d1db742341a9b3c7f9716d56525391"} Jul 12 20:04:28.630068 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:28.630026 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wqrhv/must-gather-kx6zw" event={"ID":"0b974dea-7599-4350-b8b4-3349a12fad56","Type":"ContainerStarted","Data":"63d4af2b220f22b756a13e98ec28f168e563ea5a8bc6df258655e2cea05aabb5"} Jul 12 20:04:28.645888 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:28.645837 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wqrhv/must-gather-kx6zw" podStartSLOduration=1.729078657 podStartE2EDuration="2.645819966s" totalImagesPullingTime="916.741309ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-12 20:04:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 20:04:28.643723365 +0000 UTC m=+2540.098316341" watchObservedRunningTime="2026-07-12 20:04:28.645819966 +0000 UTC m=+2540.100412928" Jul 12 20:04:29.036641 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:29.036610 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7xr84_c3855f17-6f1a-4a9e-841e-bfda15547d26/global-pull-secret-syncer/0.log" Jul 12 20:04:29.161129 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:29.161093 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8h25q_16f30c9c-72f7-4d93-a0e8-9617958d76dd/konnectivity-agent/0.log" Jul 12 20:04:29.212547 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:29.212517 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-63.ec2.internal_b2a2874da17abefb7e09b1f75564bde1/haproxy/0.log" Jul 12 20:04:33.525584 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:33.525554 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sx5hm_1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d/extract/0.log" Jul 12 20:04:33.552751 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:33.552721 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sx5hm_1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d/util/0.log" Jul 12 20:04:33.577173 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:33.577127 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sx5hm_1d9768e7-42ed-4d7c-9704-1d9f71b3fe6d/pull/0.log" Jul 12 20:04:33.613207 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:33.613176 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tdrhh_7ee204fe-56da-4083-b92e-6cee48404ad8/extract/0.log" Jul 12 20:04:33.640914 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:33.640878 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tdrhh_7ee204fe-56da-4083-b92e-6cee48404ad8/util/0.log" Jul 12 20:04:33.662740 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:33.662708 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0tdrhh_7ee204fe-56da-4083-b92e-6cee48404ad8/pull/0.log" Jul 12 20:04:33.700967 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:33.700932 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g7trn_bf4a0806-1dc6-4850-924b-3ccecd65b997/extract/0.log" Jul 12 20:04:33.722265 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:33.722227 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g7trn_bf4a0806-1dc6-4850-924b-3ccecd65b997/util/0.log" Jul 12 20:04:33.745133 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:33.745103 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73g7trn_bf4a0806-1dc6-4850-924b-3ccecd65b997/pull/0.log" Jul 12 20:04:33.787562 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:33.787476 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sn52n_14bade62-668c-4df2-a2d4-2ac60f1e6094/extract/0.log" Jul 12 20:04:33.807225 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:33.807196 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sn52n_14bade62-668c-4df2-a2d4-2ac60f1e6094/util/0.log" Jul 12 20:04:33.830468 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:33.830440 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1sn52n_14bade62-668c-4df2-a2d4-2ac60f1e6094/pull/0.log" Jul 12 20:04:34.345011 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:34.344257 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5b6599d77-7njlq_a5bad969-641b-4d6a-84fc-db7731d83f70/authorino/0.log" Jul 12 20:04:34.387275 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:34.387240 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-wbwk8_e5b98265-fd90-4b00-a8fb-6aad2eda6308/manager/0.log" Jul 12 20:04:34.418861 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:34.418814 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-tmxhm_cee282b2-f6e2-4180-95b4-521dcc13ecdf/manager/0.log" Jul 12 20:04:34.443037 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:34.443003 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-58nvv_84eb4da4-7798-4a28-85e5-16369b69caeb/kuadrant-console-plugin/0.log" Jul 12 20:04:34.488072 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:34.488035 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-ptnpz_c39de0eb-143b-40d0-bdcc-f82958842e6e/registry-server/0.log" Jul 12 20:04:34.717016 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:34.716414 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-svqnf_aaca7341-8abd-4c8e-8d01-a318cf6f44d7/manager/0.log" Jul 12 20:04:34.837522 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:34.837485 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-jmlrw_dab9a189-e4fe-45a9-a841-7f5052ebc607/manager/0.log" Jul 12 20:04:36.456637 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:36.456602 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54c4642f-003c-49f5-bc47-f47334ec1bf1/alertmanager/0.log" Jul 12 20:04:36.489037 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:36.489007 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54c4642f-003c-49f5-bc47-f47334ec1bf1/config-reloader/0.log" Jul 12 20:04:36.527853 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:36.527818 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54c4642f-003c-49f5-bc47-f47334ec1bf1/kube-rbac-proxy-web/0.log" Jul 12 20:04:36.550819 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:36.550786 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54c4642f-003c-49f5-bc47-f47334ec1bf1/kube-rbac-proxy/0.log" Jul 12 20:04:36.571940 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:36.571913 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54c4642f-003c-49f5-bc47-f47334ec1bf1/kube-rbac-proxy-metric/0.log" Jul 12 20:04:36.604034 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:36.604009 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54c4642f-003c-49f5-bc47-f47334ec1bf1/prom-label-proxy/0.log" Jul 12 20:04:36.639376 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:36.639342 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_54c4642f-003c-49f5-bc47-f47334ec1bf1/init-config-reloader/0.log" Jul 12 20:04:36.941452 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:36.941407 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2pbhs_d62616d9-c564-4448-a42c-b691305621e8/node-exporter/0.log" Jul 12 20:04:36.961940 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:36.961912 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2pbhs_d62616d9-c564-4448-a42c-b691305621e8/kube-rbac-proxy/0.log" Jul 12 20:04:36.982870 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:36.982784 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-2pbhs_d62616d9-c564-4448-a42c-b691305621e8/init-textfile/0.log" Jul 12 20:04:37.214072 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:37.214040 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-97zpp_c154687e-b9d9-4311-8a9c-d785b21b7440/kube-rbac-proxy-main/0.log" Jul 12 20:04:37.265228 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:37.265120 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-97zpp_c154687e-b9d9-4311-8a9c-d785b21b7440/kube-rbac-proxy-self/0.log" Jul 12 20:04:37.291534 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:37.291500 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-97zpp_c154687e-b9d9-4311-8a9c-d785b21b7440/openshift-state-metrics/0.log" Jul 12 20:04:37.545648 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:37.545568 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-tdz9h_ad12b74e-7a61-45ff-b163-7146fcb1cde2/prometheus-operator-admission-webhook/0.log" Jul 12 20:04:37.575593 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:37.575551 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5d8c68f47b-dsvwx_4590cd89-b5f6-483b-8527-c40f763211b8/telemeter-client/0.log" Jul 12 20:04:37.596228 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:37.596197 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5d8c68f47b-dsvwx_4590cd89-b5f6-483b-8527-c40f763211b8/reload/0.log" Jul 12 20:04:37.617495 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:37.617471 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5d8c68f47b-dsvwx_4590cd89-b5f6-483b-8527-c40f763211b8/kube-rbac-proxy/0.log" Jul 12 20:04:37.650944 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:37.650908 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7466cd84d8-gm9qb_5c8ddf87-5eb7-4d46-8581-7c9d014924f5/thanos-query/0.log" Jul 12 20:04:37.670708 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:37.670682 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7466cd84d8-gm9qb_5c8ddf87-5eb7-4d46-8581-7c9d014924f5/kube-rbac-proxy-web/0.log" Jul 12 20:04:37.692050 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:37.692017 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7466cd84d8-gm9qb_5c8ddf87-5eb7-4d46-8581-7c9d014924f5/kube-rbac-proxy/0.log" Jul 12 20:04:37.711201 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:37.711170 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7466cd84d8-gm9qb_5c8ddf87-5eb7-4d46-8581-7c9d014924f5/prom-label-proxy/0.log" Jul 12 20:04:37.737325 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:37.737292 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7466cd84d8-gm9qb_5c8ddf87-5eb7-4d46-8581-7c9d014924f5/kube-rbac-proxy-rules/0.log" Jul 12 20:04:37.757146 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:37.757107 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7466cd84d8-gm9qb_5c8ddf87-5eb7-4d46-8581-7c9d014924f5/kube-rbac-proxy-metrics/0.log" Jul 12 20:04:39.112559 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:39.112514 2576 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wqrhv/perf-node-gather-daemonset-rkp7j"] Jul 12 20:04:39.118857 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:39.118825 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wqrhv/perf-node-gather-daemonset-rkp7j" Jul 12 20:04:39.124321 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:39.124295 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wqrhv/perf-node-gather-daemonset-rkp7j"] Jul 12 20:04:39.194917 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:39.194875 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3c8159b3-a0f0-4ad6-b4fe-2d0000c5bdf4-lib-modules\") pod \"perf-node-gather-daemonset-rkp7j\" (UID: \"3c8159b3-a0f0-4ad6-b4fe-2d0000c5bdf4\") " pod="openshift-must-gather-wqrhv/perf-node-gather-daemonset-rkp7j" Jul 12 20:04:39.195127 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:39.195012 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ldjqb\" (UniqueName: \"kubernetes.io/projected/3c8159b3-a0f0-4ad6-b4fe-2d0000c5bdf4-kube-api-access-ldjqb\") pod \"perf-node-gather-daemonset-rkp7j\" (UID: \"3c8159b3-a0f0-4ad6-b4fe-2d0000c5bdf4\") " pod="openshift-must-gather-wqrhv/perf-node-gather-daemonset-rkp7j" Jul 12 20:04:39.195127 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:39.195105 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3c8159b3-a0f0-4ad6-b4fe-2d0000c5bdf4-proc\") pod \"perf-node-gather-daemonset-rkp7j\" (UID: \"3c8159b3-a0f0-4ad6-b4fe-2d0000c5bdf4\") " pod="openshift-must-gather-wqrhv/perf-node-gather-daemonset-rkp7j" Jul 12 20:04:39.195254 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:39.195142 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3c8159b3-a0f0-4ad6-b4fe-2d0000c5bdf4-podres\") pod \"perf-node-gather-daemonset-rkp7j\" (UID: \"3c8159b3-a0f0-4ad6-b4fe-2d0000c5bdf4\") " pod="openshift-must-gather-wqrhv/perf-node-gather-daemonset-rkp7j" Jul 12 20:04:39.195254 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:39.195226 2576 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c8159b3-a0f0-4ad6-b4fe-2d0000c5bdf4-sys\") pod \"perf-node-gather-daemonset-rkp7j\" (UID: \"3c8159b3-a0f0-4ad6-b4fe-2d0000c5bdf4\") " pod="openshift-must-gather-wqrhv/perf-node-gather-daemonset-rkp7j" Jul 12 20:04:39.296612 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:39.296569 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3c8159b3-a0f0-4ad6-b4fe-2d0000c5bdf4-lib-modules\") pod \"perf-node-gather-daemonset-rkp7j\" (UID: \"3c8159b3-a0f0-4ad6-b4fe-2d0000c5bdf4\") " pod="openshift-must-gather-wqrhv/perf-node-gather-daemonset-rkp7j" Jul 12 20:04:39.296817 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:39.296625 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ldjqb\" (UniqueName: \"kubernetes.io/projected/3c8159b3-a0f0-4ad6-b4fe-2d0000c5bdf4-kube-api-access-ldjqb\") pod \"perf-node-gather-daemonset-rkp7j\" (UID: \"3c8159b3-a0f0-4ad6-b4fe-2d0000c5bdf4\") " pod="openshift-must-gather-wqrhv/perf-node-gather-daemonset-rkp7j" Jul 12 20:04:39.296817 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:39.296680 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/3c8159b3-a0f0-4ad6-b4fe-2d0000c5bdf4-lib-modules\") pod \"perf-node-gather-daemonset-rkp7j\" (UID: \"3c8159b3-a0f0-4ad6-b4fe-2d0000c5bdf4\") " pod="openshift-must-gather-wqrhv/perf-node-gather-daemonset-rkp7j" Jul 12 20:04:39.296817 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:39.296697 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3c8159b3-a0f0-4ad6-b4fe-2d0000c5bdf4-proc\") pod \"perf-node-gather-daemonset-rkp7j\" (UID: \"3c8159b3-a0f0-4ad6-b4fe-2d0000c5bdf4\") " pod="openshift-must-gather-wqrhv/perf-node-gather-daemonset-rkp7j" Jul 12 20:04:39.296817 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:39.296732 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3c8159b3-a0f0-4ad6-b4fe-2d0000c5bdf4-podres\") pod \"perf-node-gather-daemonset-rkp7j\" (UID: \"3c8159b3-a0f0-4ad6-b4fe-2d0000c5bdf4\") " pod="openshift-must-gather-wqrhv/perf-node-gather-daemonset-rkp7j" Jul 12 20:04:39.296817 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:39.296759 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/3c8159b3-a0f0-4ad6-b4fe-2d0000c5bdf4-proc\") pod \"perf-node-gather-daemonset-rkp7j\" (UID: \"3c8159b3-a0f0-4ad6-b4fe-2d0000c5bdf4\") " pod="openshift-must-gather-wqrhv/perf-node-gather-daemonset-rkp7j" Jul 12 20:04:39.296817 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:39.296805 2576 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c8159b3-a0f0-4ad6-b4fe-2d0000c5bdf4-sys\") pod \"perf-node-gather-daemonset-rkp7j\" (UID: \"3c8159b3-a0f0-4ad6-b4fe-2d0000c5bdf4\") " pod="openshift-must-gather-wqrhv/perf-node-gather-daemonset-rkp7j" Jul 12 20:04:39.297178 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:39.296873 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/3c8159b3-a0f0-4ad6-b4fe-2d0000c5bdf4-podres\") pod \"perf-node-gather-daemonset-rkp7j\" (UID: \"3c8159b3-a0f0-4ad6-b4fe-2d0000c5bdf4\") " pod="openshift-must-gather-wqrhv/perf-node-gather-daemonset-rkp7j" Jul 12 20:04:39.297178 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:39.296918 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/3c8159b3-a0f0-4ad6-b4fe-2d0000c5bdf4-sys\") pod \"perf-node-gather-daemonset-rkp7j\" (UID: \"3c8159b3-a0f0-4ad6-b4fe-2d0000c5bdf4\") " pod="openshift-must-gather-wqrhv/perf-node-gather-daemonset-rkp7j" Jul 12 20:04:39.304546 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:39.304514 2576 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ldjqb\" (UniqueName: \"kubernetes.io/projected/3c8159b3-a0f0-4ad6-b4fe-2d0000c5bdf4-kube-api-access-ldjqb\") pod \"perf-node-gather-daemonset-rkp7j\" (UID: \"3c8159b3-a0f0-4ad6-b4fe-2d0000c5bdf4\") " pod="openshift-must-gather-wqrhv/perf-node-gather-daemonset-rkp7j" Jul 12 20:04:39.434472 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:39.434385 2576 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wqrhv/perf-node-gather-daemonset-rkp7j" Jul 12 20:04:39.632520 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:39.632364 2576 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wqrhv/perf-node-gather-daemonset-rkp7j"] Jul 12 20:04:39.733333 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:39.733296 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wqrhv/perf-node-gather-daemonset-rkp7j" event={"ID":"3c8159b3-a0f0-4ad6-b4fe-2d0000c5bdf4","Type":"ContainerStarted","Data":"a0bdb9e1065fca2e4bfc16862f77ebe95b1065664441e8bbaaf1885d2f7a7d66"} Jul 12 20:04:40.742337 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:40.742302 2576 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wqrhv/perf-node-gather-daemonset-rkp7j" event={"ID":"3c8159b3-a0f0-4ad6-b4fe-2d0000c5bdf4","Type":"ContainerStarted","Data":"0f440a02f6be3fe255e91fac1fa9c653daf827339cd0adafce22a9f874304349"} Jul 12 20:04:40.742727 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:40.742412 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wqrhv/perf-node-gather-daemonset-rkp7j" Jul 12 20:04:40.760417 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:40.760357 2576 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wqrhv/perf-node-gather-daemonset-rkp7j" podStartSLOduration=1.760336653 podStartE2EDuration="1.760336653s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-12 20:04:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-12 20:04:40.757102049 +0000 UTC m=+2552.211695013" watchObservedRunningTime="2026-07-12 20:04:40.760336653 +0000 UTC m=+2552.214929617" Jul 12 20:04:41.640099 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:41.640064 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xdbcq_ce955d98-9d74-42d7-8bc1-0080c6e11730/dns/0.log" Jul 12 20:04:41.659126 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:41.659097 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xdbcq_ce955d98-9d74-42d7-8bc1-0080c6e11730/kube-rbac-proxy/0.log" Jul 12 20:04:41.742656 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:41.742611 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-s4snc_89fef961-c465-49fc-a683-244057d342fc/dns-node-resolver/0.log" Jul 12 20:04:42.280134 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:42.280095 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-7bc858f9f4-7lc6n_1d9954f0-f92c-419a-bdc8-e2acb31c980b/registry/0.log" Jul 12 20:04:42.322228 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:42.322201 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-kfgnm_c147ccfb-342a-4958-b365-f730046bebce/node-ca/0.log" Jul 12 20:04:43.378967 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:43.378937 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-654967888b-rnlk6_42d6a7be-2253-4d88-8992-8fe83e2ea727/kube-auth-proxy/0.log" Jul 12 20:04:43.410233 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:43.410203 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-888r7_5465dd47-b0dd-4a80-9db3-b93843ab360b/istio-proxy/0.log" Jul 12 20:04:43.486105 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:43.486072 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-888r7_5465dd47-b0dd-4a80-9db3-b93843ab360b/istio-proxy/1.log" Jul 12 20:04:43.526064 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:43.526033 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-8vnxf_87f2d86e-ac38-4086-a8b9-0eb0ed99c444/payload-pre-processing/0.log" Jul 12 20:04:43.607226 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:43.607193 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-slbvp_afe113f3-d8a5-42b9-a0d6-11d267c72959/payload-processing/0.log" Jul 12 20:04:44.316168 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:44.316139 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vr57n_81cb7278-de78-4af0-89c2-34b2cf08adf5/serve-healthcheck-canary/0.log" Jul 12 20:04:44.893599 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:44.893567 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xrmdv_a4c24f04-e3f4-4b10-9af1-1ccb3d30b0cd/kube-rbac-proxy/0.log" Jul 12 20:04:44.913643 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:44.913617 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xrmdv_a4c24f04-e3f4-4b10-9af1-1ccb3d30b0cd/exporter/0.log" Jul 12 20:04:44.936271 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:44.936233 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xrmdv_a4c24f04-e3f4-4b10-9af1-1ccb3d30b0cd/extractor/0.log" Jul 12 20:04:46.761223 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:46.761191 2576 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wqrhv/perf-node-gather-daemonset-rkp7j" Jul 12 20:04:47.421165 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:47.421131 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-9zsvq_fe75f8a7-055b-42b3-9120-95152115a284/manager/0.log" Jul 12 20:04:47.488133 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:47.488101 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5449d7969f-nwsdg_73a3c458-394e-4400-b7e8-c8d6855c85ba/manager/0.log" Jul 12 20:04:47.506501 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:47.506472 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5449d7969f-nwsdg_73a3c458-394e-4400-b7e8-c8d6855c85ba/copy-manifests/0.log" Jul 12 20:04:47.618328 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:47.618303 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-qsnfs_e25ac8bd-7a71-4a0a-8742-2acfd1e5d7c1/postgres/0.log" Jul 12 20:04:49.401065 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:49.401033 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-g4lth_103f212a-af4d-4357-a42c-0bb75eecd6f5/openshift-lws-operator/0.log" Jul 12 20:04:50.215122 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:50.215084 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-654967888b-rnlk6_42d6a7be-2253-4d88-8992-8fe83e2ea727/kube-auth-proxy/0.log" Jul 12 20:04:50.235325 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:50.235294 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-888r7_5465dd47-b0dd-4a80-9db3-b93843ab360b/istio-proxy/0.log" Jul 12 20:04:50.305717 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:50.305676 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-888r7_5465dd47-b0dd-4a80-9db3-b93843ab360b/istio-proxy/1.log" Jul 12 20:04:50.336653 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:50.336623 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-8vnxf_87f2d86e-ac38-4086-a8b9-0eb0ed99c444/payload-pre-processing/0.log" Jul 12 20:04:50.411160 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:50.411122 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-slbvp_afe113f3-d8a5-42b9-a0d6-11d267c72959/payload-processing/0.log" Jul 12 20:04:51.714946 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:51.714920 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-654967888b-rnlk6_42d6a7be-2253-4d88-8992-8fe83e2ea727/kube-auth-proxy/0.log" Jul 12 20:04:51.733956 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:51.733928 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-888r7_5465dd47-b0dd-4a80-9db3-b93843ab360b/istio-proxy/0.log" Jul 12 20:04:51.800045 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:51.799954 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-888r7_5465dd47-b0dd-4a80-9db3-b93843ab360b/istio-proxy/1.log" Jul 12 20:04:51.836396 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:51.836368 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-59f49fd4f6-8vnxf_87f2d86e-ac38-4086-a8b9-0eb0ed99c444/payload-pre-processing/0.log" Jul 12 20:04:51.910944 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:51.910918 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-7bbcb654f4-slbvp_afe113f3-d8a5-42b9-a0d6-11d267c72959/payload-processing/0.log" Jul 12 20:04:55.607388 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:55.607363 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-56fhk_97eab1be-059f-4563-ac6c-30b4edf4aa79/kube-multus/0.log" Jul 12 20:04:55.680292 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:55.680261 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9z5dq_c648764a-13c5-4cea-9dbc-dcfdcc308d68/kube-multus-additional-cni-plugins/0.log" Jul 12 20:04:55.698789 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:55.698766 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9z5dq_c648764a-13c5-4cea-9dbc-dcfdcc308d68/egress-router-binary-copy/0.log" Jul 12 20:04:55.717064 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:55.717045 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9z5dq_c648764a-13c5-4cea-9dbc-dcfdcc308d68/cni-plugins/0.log" Jul 12 20:04:55.738105 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:55.738082 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9z5dq_c648764a-13c5-4cea-9dbc-dcfdcc308d68/bond-cni-plugin/0.log" Jul 12 20:04:55.757944 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:55.757926 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9z5dq_c648764a-13c5-4cea-9dbc-dcfdcc308d68/routeoverride-cni/0.log" Jul 12 20:04:55.775873 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:55.775858 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9z5dq_c648764a-13c5-4cea-9dbc-dcfdcc308d68/whereabouts-cni-bincopy/0.log" Jul 12 20:04:55.794886 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:55.794870 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-9z5dq_c648764a-13c5-4cea-9dbc-dcfdcc308d68/whereabouts-cni/0.log" Jul 12 20:04:56.189572 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:56.189544 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sv9f6_0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52/network-metrics-daemon/0.log" Jul 12 20:04:56.205319 ip-10-0-137-63 kubenswrapper[2576]: I0712 20:04:56.205287 2576 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-sv9f6_0a72ff7f-1bbf-4a3a-8dcc-29ed99e89f52/kube-rbac-proxy/0.log"