Jul 02 20:32:41.440133 ip-10-0-137-144 systemd[1]: Starting Kubernetes Kubelet... Jul 02 20:32:41.888766 ip-10-0-137-144 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 20:32:41.888766 ip-10-0-137-144 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 02 20:32:41.888766 ip-10-0-137-144 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 20:32:41.888766 ip-10-0-137-144 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 02 20:32:41.888766 ip-10-0-137-144 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 20:32:41.888766 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.791656 2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 02 20:32:41.888766 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798101 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 20:32:41.888766 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798113 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 20:32:41.888766 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798118 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 20:32:41.888766 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798122 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 20:32:41.888766 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798127 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 20:32:41.888766 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798131 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 20:32:41.888766 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798135 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 20:32:41.888766 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798138 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 20:32:41.865282 ip-10-0-137-144 systemd[1]: Started Kubernetes Kubelet. Jul 02 20:32:41.891342 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798142 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 20:32:41.891342 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798145 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 20:32:41.891342 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798151 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 20:32:41.891342 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798157 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 20:32:41.891342 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798162 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 20:32:41.891342 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798166 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 20:32:41.891342 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798170 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 20:32:41.891342 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798175 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 20:32:41.891342 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798185 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 20:32:41.891342 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798189 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 20:32:41.891342 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798193 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 20:32:41.891342 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798197 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 20:32:41.891342 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798201 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 20:32:41.891342 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798205 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 20:32:41.891342 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798210 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 20:32:41.891342 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798213 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 20:32:41.891342 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798217 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 20:32:41.891342 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798221 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 20:32:41.891342 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798225 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 20:32:41.899750 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798229 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 20:32:41.899750 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798233 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 20:32:41.899750 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798237 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 20:32:41.899750 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798240 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 20:32:41.899750 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798244 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 20:32:41.899750 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798248 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 20:32:41.899750 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798252 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 20:32:41.899750 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798256 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 20:32:41.899750 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798259 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 20:32:41.899750 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798263 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 20:32:41.899750 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798267 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 20:32:41.899750 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798270 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 20:32:41.899750 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798273 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 20:32:41.899750 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798279 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 20:32:41.899750 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798284 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 20:32:41.899750 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798288 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 20:32:41.899750 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798292 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 20:32:41.899750 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798295 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 20:32:41.899750 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798299 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 20:32:41.900591 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798303 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 20:32:41.900591 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798307 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 20:32:41.900591 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798311 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 20:32:41.900591 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798315 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 20:32:41.900591 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798319 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 20:32:41.900591 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798322 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 20:32:41.900591 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798326 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 20:32:41.900591 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798330 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 20:32:41.900591 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798334 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 20:32:41.900591 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798338 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 20:32:41.900591 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798343 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 20:32:41.900591 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798346 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 20:32:41.900591 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798350 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 20:32:41.900591 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798354 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 20:32:41.900591 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798359 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 20:32:41.900591 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798363 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 20:32:41.900591 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798366 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 20:32:41.900591 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798370 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 20:32:41.900591 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798376 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 20:32:41.900591 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798382 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 02 20:32:41.904748 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798387 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 20:32:41.904748 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798391 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 20:32:41.904748 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798394 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 20:32:41.904748 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798398 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 20:32:41.904748 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798402 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 20:32:41.904748 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798407 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 20:32:41.904748 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798410 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 20:32:41.904748 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798413 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 20:32:41.904748 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798417 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 20:32:41.904748 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798421 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 20:32:41.904748 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798425 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 20:32:41.904748 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798429 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 20:32:41.904748 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798432 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 20:32:41.904748 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798435 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 20:32:41.904748 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798438 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 20:32:41.904748 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798446 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 20:32:41.904748 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798450 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 20:32:41.904748 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798454 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 20:32:41.904748 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798458 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 20:32:41.904748 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798461 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 20:32:41.905594 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798465 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 20:32:41.905594 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798469 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 20:32:41.905594 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798473 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 20:32:41.905594 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798477 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 20:32:41.905594 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798480 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 20:32:41.905594 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798484 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 20:32:41.905594 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798487 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 20:32:41.905594 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798491 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 20:32:41.905594 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798495 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 20:32:41.905594 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798499 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 20:32:41.905594 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798503 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 20:32:41.905594 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798506 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 20:32:41.905594 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.798510 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 20:32:41.905594 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799442 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 20:32:41.905594 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799450 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 20:32:41.905594 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799455 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 20:32:41.905594 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799458 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 20:32:41.905594 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799463 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 20:32:41.905594 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799467 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 20:32:41.905594 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799473 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 20:32:41.908121 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799478 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 20:32:41.908121 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799482 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 20:32:41.908121 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799486 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 20:32:41.908121 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799491 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 20:32:41.908121 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799495 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 20:32:41.908121 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799499 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 20:32:41.908121 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799503 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 20:32:41.908121 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799507 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 20:32:41.908121 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799511 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 02 20:32:41.908121 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799515 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 20:32:41.908121 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799518 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 20:32:41.908121 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799522 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 20:32:41.908121 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799527 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 20:32:41.908121 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799530 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 20:32:41.908121 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799534 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 20:32:41.908121 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799538 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 20:32:41.908121 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799541 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 20:32:41.908121 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799547 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 20:32:41.908121 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799551 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 20:32:41.908121 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799555 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 20:32:41.908962 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799560 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 20:32:41.908962 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799564 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 20:32:41.908962 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799569 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 20:32:41.908962 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799573 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 20:32:41.908962 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799578 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 20:32:41.908962 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799581 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 20:32:41.908962 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799585 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 20:32:41.908962 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799589 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 20:32:41.908962 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799592 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 20:32:41.908962 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799596 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 20:32:41.908962 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799600 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 20:32:41.908962 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799604 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 20:32:41.908962 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799607 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 20:32:41.908962 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799611 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 20:32:41.908962 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799615 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 20:32:41.908962 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799619 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 20:32:41.908962 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799622 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 20:32:41.908962 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799626 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 20:32:41.908962 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799630 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 20:32:41.908962 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799634 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 20:32:41.912324 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799637 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 20:32:41.912324 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799642 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 20:32:41.912324 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799646 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 20:32:41.912324 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799650 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 20:32:41.912324 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799654 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 20:32:41.912324 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799657 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 20:32:41.912324 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799661 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 20:32:41.912324 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799666 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 20:32:41.912324 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799670 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 20:32:41.912324 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799675 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 20:32:41.912324 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799679 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 20:32:41.912324 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799683 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 20:32:41.912324 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799686 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 20:32:41.912324 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799690 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 20:32:41.912324 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799694 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 20:32:41.912324 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799699 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 20:32:41.912324 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799702 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 20:32:41.912324 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799706 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 20:32:41.912324 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799709 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 20:32:41.912324 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799713 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 20:32:41.913561 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799717 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 20:32:41.913561 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799721 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 20:32:41.913561 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799724 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 20:32:41.913561 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799728 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 20:32:41.913561 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799732 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 20:32:41.913561 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799735 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 20:32:41.913561 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799739 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 20:32:41.913561 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799743 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 20:32:41.913561 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799747 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 20:32:41.913561 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799751 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 20:32:41.913561 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799754 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 20:32:41.913561 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799758 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 20:32:41.913561 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799762 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 20:32:41.913561 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799765 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 20:32:41.913561 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799770 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 20:32:41.913561 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799774 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 20:32:41.913561 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799778 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 20:32:41.913561 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799781 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 20:32:41.913561 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799785 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 20:32:41.913561 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799788 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 20:32:41.917331 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799792 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 20:32:41.917331 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799797 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 20:32:41.917331 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799800 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 20:32:41.917331 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799804 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 20:32:41.917331 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799810 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 20:32:41.917331 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799815 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 20:32:41.917331 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799819 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 20:32:41.917331 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799822 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 20:32:41.917331 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799826 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 20:32:41.917331 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799830 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 20:32:41.917331 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799833 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 20:32:41.917331 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.799837 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 20:32:41.917331 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800312 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 20:32:41.917331 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800319 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 20:32:41.917331 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800322 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 20:32:41.917331 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800326 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 20:32:41.917331 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800330 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 20:32:41.917331 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800333 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 20:32:41.917331 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800337 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 20:32:41.918149 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800341 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 20:32:41.918149 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800345 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 20:32:41.918149 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800348 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 20:32:41.918149 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800352 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 20:32:41.918149 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800356 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 20:32:41.918149 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800359 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 20:32:41.918149 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800363 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 20:32:41.918149 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800369 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 20:32:41.918149 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800372 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 20:32:41.918149 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800376 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 20:32:41.918149 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800379 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 20:32:41.918149 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800383 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 20:32:41.918149 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800387 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 20:32:41.918149 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800391 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 20:32:41.918149 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800398 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 20:32:41.918149 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800401 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 20:32:41.918149 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800404 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 20:32:41.918149 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800408 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 20:32:41.918149 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800412 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 20:32:41.918149 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800415 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 20:32:41.924022 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800419 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 20:32:41.924022 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800422 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 20:32:41.924022 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800426 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 20:32:41.924022 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800429 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 20:32:41.924022 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800434 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 20:32:41.924022 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800438 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 20:32:41.924022 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800441 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 20:32:41.924022 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800444 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 20:32:41.924022 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800448 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 20:32:41.924022 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800452 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 20:32:41.924022 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800455 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 02 20:32:41.924022 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800459 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 20:32:41.924022 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800463 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 20:32:41.924022 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800468 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 20:32:41.924022 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800474 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 20:32:41.924022 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800478 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 20:32:41.924022 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800483 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 20:32:41.924022 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800487 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 20:32:41.924022 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800491 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 20:32:41.924022 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800495 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 20:32:41.924878 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800500 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 20:32:41.924878 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800504 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 20:32:41.924878 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800508 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 20:32:41.924878 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800512 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 20:32:41.924878 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800516 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 20:32:41.924878 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800519 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 20:32:41.924878 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800525 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 20:32:41.924878 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800528 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 20:32:41.924878 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800532 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 20:32:41.924878 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800536 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 20:32:41.924878 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800539 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 20:32:41.924878 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800543 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 20:32:41.924878 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800547 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 20:32:41.924878 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800550 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 20:32:41.924878 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800554 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 20:32:41.924878 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800558 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 20:32:41.924878 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800562 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 20:32:41.924878 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800565 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 20:32:41.924878 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800569 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 20:32:41.924878 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800572 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 20:32:41.925713 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800576 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 20:32:41.925713 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800580 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 20:32:41.925713 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800584 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 20:32:41.925713 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800588 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 20:32:41.925713 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800591 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 20:32:41.925713 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800595 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 20:32:41.925713 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800600 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 20:32:41.925713 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800605 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 20:32:41.925713 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800611 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 20:32:41.925713 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800617 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 20:32:41.925713 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800621 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 20:32:41.925713 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800625 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 20:32:41.925713 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800630 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 20:32:41.925713 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800641 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 20:32:41.925713 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800646 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 20:32:41.925713 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800650 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 20:32:41.925713 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800654 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 20:32:41.925713 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800658 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 20:32:41.925713 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800662 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 20:32:41.930304 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800666 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 20:32:41.930304 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800669 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 20:32:41.930304 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800673 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 20:32:41.930304 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800677 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 20:32:41.930304 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800681 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 20:32:41.930304 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800684 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 20:32:41.930304 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800688 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 20:32:41.930304 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800692 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 20:32:41.930304 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800695 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 20:32:41.930304 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800699 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 20:32:41.930304 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800702 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 20:32:41.930304 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800706 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 20:32:41.930304 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.800710 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 20:32:41.930304 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.800797 2568 flags.go:64] FLAG: --address="0.0.0.0" Jul 02 20:32:41.930304 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.800805 2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 02 20:32:41.930304 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.800812 2568 flags.go:64] FLAG: --anonymous-auth="true" Jul 02 20:32:41.930304 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.800818 2568 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 02 20:32:41.930304 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.800824 2568 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 02 20:32:41.930304 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.800828 2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 02 20:32:41.930304 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.800835 2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 02 20:32:41.930304 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.800841 2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 02 20:32:41.931562 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.800860 2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 02 20:32:41.931562 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.800865 2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 02 20:32:41.931562 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.800870 2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 02 20:32:41.931562 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.800875 2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 02 20:32:41.931562 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.800880 2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 02 20:32:41.931562 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.800884 2568 flags.go:64] FLAG: --cgroup-root="" Jul 02 20:32:41.931562 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.800889 2568 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 02 20:32:41.931562 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.800893 2568 flags.go:64] FLAG: --client-ca-file="" Jul 02 20:32:41.931562 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.800897 2568 flags.go:64] FLAG: --cloud-provider="external" Jul 02 20:32:41.931562 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.800901 2568 flags.go:64] FLAG: --cluster-dns="[]" Jul 02 20:32:41.931562 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.800908 2568 flags.go:64] FLAG: --cluster-domain="" Jul 02 20:32:41.931562 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.800913 2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 02 20:32:41.931562 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.800917 2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 02 20:32:41.931562 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.800921 2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 02 20:32:41.931562 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.800926 2568 flags.go:64] FLAG: --container-log-max-files="5" Jul 02 20:32:41.931562 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.800931 2568 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 02 20:32:41.931562 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.800935 2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 02 20:32:41.931562 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.800939 2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 02 20:32:41.931562 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.800943 2568 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 02 20:32:41.931562 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.800948 2568 flags.go:64] FLAG: --contention-profiling="false" Jul 02 20:32:41.931562 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.800953 2568 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 02 20:32:41.931562 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.800957 2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 02 20:32:41.931562 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.800961 2568 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 02 20:32:41.931562 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.800965 2568 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 02 20:32:41.932391 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.800970 2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 02 20:32:41.932391 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.800974 2568 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 02 20:32:41.932391 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.800979 2568 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 02 20:32:41.932391 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.800983 2568 flags.go:64] FLAG: --enable-load-reader="false" Jul 02 20:32:41.932391 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.800987 2568 flags.go:64] FLAG: --enable-server="true" Jul 02 20:32:41.932391 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.800991 2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 02 20:32:41.932391 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.800997 2568 flags.go:64] FLAG: --event-burst="100" Jul 02 20:32:41.932391 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801002 2568 flags.go:64] FLAG: --event-qps="50" Jul 02 20:32:41.932391 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801006 2568 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 02 20:32:41.932391 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801010 2568 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 02 20:32:41.932391 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801015 2568 flags.go:64] FLAG: --eviction-hard="" Jul 02 20:32:41.932391 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801021 2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 02 20:32:41.932391 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801025 2568 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 02 20:32:41.932391 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801049 2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 02 20:32:41.932391 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801053 2568 flags.go:64] FLAG: --eviction-soft="" Jul 02 20:32:41.932391 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801059 2568 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 02 20:32:41.932391 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801064 2568 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 02 20:32:41.932391 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801068 2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 02 20:32:41.932391 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801074 2568 flags.go:64] FLAG: --experimental-mounter-path="" Jul 02 20:32:41.932391 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801078 2568 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 02 20:32:41.932391 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801082 2568 flags.go:64] FLAG: --fail-swap-on="true" Jul 02 20:32:41.932391 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801086 2568 flags.go:64] FLAG: --feature-gates="" Jul 02 20:32:41.932391 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801091 2568 flags.go:64] FLAG: --file-check-frequency="20s" Jul 02 20:32:41.932391 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801095 2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 02 20:32:41.932391 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801100 2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 02 20:32:42.035722 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801104 2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 02 20:32:42.035722 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801109 2568 flags.go:64] FLAG: --healthz-port="10248" Jul 02 20:32:42.035722 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801113 2568 flags.go:64] FLAG: --help="false" Jul 02 20:32:42.035722 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801117 2568 flags.go:64] FLAG: --hostname-override="ip-10-0-137-144.ec2.internal" Jul 02 20:32:42.035722 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801121 2568 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 02 20:32:42.035722 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801126 2568 flags.go:64] FLAG: --http-check-frequency="20s" Jul 02 20:32:42.035722 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801130 2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 02 20:32:42.035722 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801135 2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 02 20:32:42.035722 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801140 2568 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 02 20:32:42.035722 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801144 2568 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 02 20:32:42.035722 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801148 2568 flags.go:64] FLAG: --image-service-endpoint="" Jul 02 20:32:42.035722 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801152 2568 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 02 20:32:42.035722 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801156 2568 flags.go:64] FLAG: --kube-api-burst="100" Jul 02 20:32:42.035722 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801162 2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 02 20:32:42.035722 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801166 2568 flags.go:64] FLAG: --kube-api-qps="50" Jul 02 20:32:42.035722 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801171 2568 flags.go:64] FLAG: --kube-reserved="" Jul 02 20:32:42.035722 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801175 2568 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 02 20:32:42.035722 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801179 2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 02 20:32:42.035722 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801183 2568 flags.go:64] FLAG: --kubelet-cgroups="" Jul 02 20:32:42.035722 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801187 2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 02 20:32:42.035722 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801190 2568 flags.go:64] FLAG: --lock-file="" Jul 02 20:32:42.035722 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801194 2568 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 02 20:32:42.035722 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801198 2568 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 02 20:32:42.035722 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801203 2568 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 02 20:32:42.036573 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801210 2568 flags.go:64] FLAG: --log-json-split-stream="false" Jul 02 20:32:42.036573 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801215 2568 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 02 20:32:42.036573 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801220 2568 flags.go:64] FLAG: --log-text-split-stream="false" Jul 02 20:32:42.036573 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801224 2568 flags.go:64] FLAG: --logging-format="text" Jul 02 20:32:42.036573 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801228 2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 02 20:32:42.036573 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801232 2568 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 02 20:32:42.036573 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801236 2568 flags.go:64] FLAG: --manifest-url="" Jul 02 20:32:42.036573 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801239 2568 flags.go:64] FLAG: --manifest-url-header="" Jul 02 20:32:42.036573 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801246 2568 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 02 20:32:42.036573 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801250 2568 flags.go:64] FLAG: --max-open-files="1000000" Jul 02 20:32:42.036573 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801255 2568 flags.go:64] FLAG: --max-pods="110" Jul 02 20:32:42.036573 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801259 2568 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 02 20:32:42.036573 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801263 2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 02 20:32:42.036573 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801268 2568 flags.go:64] FLAG: --memory-manager-policy="None" Jul 02 20:32:42.036573 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801272 2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 02 20:32:42.036573 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801275 2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 02 20:32:42.036573 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801279 2568 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 02 20:32:42.036573 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801283 2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 02 20:32:42.036573 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801292 2568 flags.go:64] FLAG: --node-status-max-images="50" Jul 02 20:32:42.036573 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801297 2568 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 02 20:32:42.036573 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801301 2568 flags.go:64] FLAG: --oom-score-adj="-999" Jul 02 20:32:42.036573 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801306 2568 flags.go:64] FLAG: --pod-cidr="" Jul 02 20:32:42.036573 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801309 2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 02 20:32:42.040365 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801317 2568 flags.go:64] FLAG: --pod-manifest-path="" Jul 02 20:32:42.040365 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801321 2568 flags.go:64] FLAG: --pod-max-pids="-1" Jul 02 20:32:42.040365 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801326 2568 flags.go:64] FLAG: --pods-per-core="0" Jul 02 20:32:42.040365 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801329 2568 flags.go:64] FLAG: --port="10250" Jul 02 20:32:42.040365 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801333 2568 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 02 20:32:42.040365 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801338 2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-005b213fdcddffe55" Jul 02 20:32:42.040365 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801343 2568 flags.go:64] FLAG: --qos-reserved="" Jul 02 20:32:42.040365 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801347 2568 flags.go:64] FLAG: --read-only-port="10255" Jul 02 20:32:42.040365 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801352 2568 flags.go:64] FLAG: --register-node="true" Jul 02 20:32:42.040365 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801356 2568 flags.go:64] FLAG: --register-with-taints="" Jul 02 20:32:42.040365 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801362 2568 flags.go:64] FLAG: --registry-burst="10" Jul 02 20:32:42.040365 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801368 2568 flags.go:64] FLAG: --registry-qps="5" Jul 02 20:32:42.040365 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801372 2568 flags.go:64] FLAG: --reserved-cpus="" Jul 02 20:32:42.040365 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801376 2568 flags.go:64] FLAG: --reserved-memory="" Jul 02 20:32:42.040365 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801387 2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 02 20:32:42.040365 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801391 2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 02 20:32:42.040365 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801396 2568 flags.go:64] FLAG: --rotate-certificates="false" Jul 02 20:32:42.040365 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801400 2568 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 02 20:32:42.040365 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801403 2568 flags.go:64] FLAG: --runonce="false" Jul 02 20:32:42.040365 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801407 2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 02 20:32:42.040365 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801411 2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 02 20:32:42.040365 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801416 2568 flags.go:64] FLAG: --seccomp-default="false" Jul 02 20:32:42.040365 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801420 2568 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 02 20:32:42.040365 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801424 2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 02 20:32:42.040365 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801428 2568 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 02 20:32:42.040365 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801432 2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 02 20:32:42.041192 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801436 2568 flags.go:64] FLAG: --storage-driver-password="root" Jul 02 20:32:42.041192 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801441 2568 flags.go:64] FLAG: --storage-driver-secure="false" Jul 02 20:32:42.041192 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801445 2568 flags.go:64] FLAG: --storage-driver-table="stats" Jul 02 20:32:42.041192 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801448 2568 flags.go:64] FLAG: --storage-driver-user="root" Jul 02 20:32:42.041192 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801454 2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 02 20:32:42.041192 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801459 2568 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 02 20:32:42.041192 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801463 2568 flags.go:64] FLAG: --system-cgroups="" Jul 02 20:32:42.041192 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801467 2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 02 20:32:42.041192 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801474 2568 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 02 20:32:42.041192 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801478 2568 flags.go:64] FLAG: --tls-cert-file="" Jul 02 20:32:42.041192 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801481 2568 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 02 20:32:42.041192 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801488 2568 flags.go:64] FLAG: --tls-min-version="" Jul 02 20:32:42.041192 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801492 2568 flags.go:64] FLAG: --tls-private-key-file="" Jul 02 20:32:42.041192 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801495 2568 flags.go:64] FLAG: --topology-manager-policy="none" Jul 02 20:32:42.041192 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801500 2568 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 02 20:32:42.041192 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801503 2568 flags.go:64] FLAG: --topology-manager-scope="container" Jul 02 20:32:42.041192 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801508 2568 flags.go:64] FLAG: --v="2" Jul 02 20:32:42.041192 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801516 2568 flags.go:64] FLAG: --version="false" Jul 02 20:32:42.041192 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801521 2568 flags.go:64] FLAG: --vmodule="" Jul 02 20:32:42.041192 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801527 2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 02 20:32:42.041192 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.801531 2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 02 20:32:42.041192 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801679 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 20:32:42.041192 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801684 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 20:32:42.041192 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801689 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 20:32:42.041192 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801693 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 20:32:42.044105 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801697 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 20:32:42.044105 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801700 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 20:32:42.044105 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801704 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 20:32:42.044105 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801708 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 20:32:42.044105 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801711 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 20:32:42.044105 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801715 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 20:32:42.044105 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801718 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 20:32:42.044105 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801722 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 20:32:42.044105 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801726 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 20:32:42.044105 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801732 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 20:32:42.044105 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801736 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 20:32:42.044105 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801742 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 20:32:42.044105 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801747 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 20:32:42.044105 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801750 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 20:32:42.044105 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801755 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 20:32:42.044105 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801759 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 20:32:42.044105 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801763 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 20:32:42.044105 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801766 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 20:32:42.044105 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801770 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 20:32:42.044929 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801773 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 20:32:42.044929 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801777 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 20:32:42.044929 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801781 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 20:32:42.044929 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801785 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 20:32:42.044929 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801790 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 20:32:42.044929 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801801 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 20:32:42.044929 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801805 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 20:32:42.044929 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801809 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 20:32:42.044929 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801813 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 20:32:42.044929 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801817 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 20:32:42.044929 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801820 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 20:32:42.044929 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801824 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 20:32:42.044929 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801828 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 20:32:42.044929 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801832 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 20:32:42.044929 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801836 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 20:32:42.044929 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801840 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 20:32:42.044929 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801843 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 20:32:42.044929 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801864 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 20:32:42.044929 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801868 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 20:32:42.044929 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801871 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 20:32:42.153870 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801875 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 20:32:42.153870 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801878 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 20:32:42.153870 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801883 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 20:32:42.153870 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801887 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 20:32:42.153870 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801892 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 20:32:42.153870 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801895 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 20:32:42.153870 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801899 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 20:32:42.153870 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801903 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 20:32:42.153870 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801906 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 20:32:42.153870 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801910 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 20:32:42.153870 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801914 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 20:32:42.153870 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801917 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 20:32:42.153870 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801921 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 20:32:42.153870 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801925 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 20:32:42.153870 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801928 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 20:32:42.153870 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801932 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 20:32:42.153870 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801936 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 20:32:42.153870 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801941 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 20:32:42.153870 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801946 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 20:32:42.155081 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801950 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 20:32:42.155081 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801954 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 20:32:42.155081 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801958 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 20:32:42.155081 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801962 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 20:32:42.155081 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801965 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 20:32:42.155081 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801969 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 20:32:42.155081 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801972 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 20:32:42.155081 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801976 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 20:32:42.155081 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801979 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 20:32:42.155081 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801983 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 20:32:42.155081 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801987 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 20:32:42.155081 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801990 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 20:32:42.155081 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801994 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 20:32:42.155081 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.801997 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 20:32:42.155081 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.802001 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 20:32:42.155081 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.802005 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 20:32:42.155081 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.802009 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 20:32:42.155081 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.802014 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 20:32:42.155081 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.802017 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 20:32:42.155081 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.802021 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 20:32:42.155934 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.802027 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 20:32:42.155934 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.802031 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 20:32:42.155934 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.802036 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 20:32:42.155934 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.802039 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 02 20:32:42.155934 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.802043 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 20:32:42.155934 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.802047 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 20:32:42.155934 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.802050 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 20:32:42.155934 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.802054 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 20:32:42.155934 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.802058 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 20:32:42.155934 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.802062 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 20:32:42.155934 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.802068 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 20:32:42.155934 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.802071 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 20:32:42.155934 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.802076 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 20:32:42.155934 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.802080 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 20:32:42.155934 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.802084 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 20:32:42.155934 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.802087 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 20:32:42.155934 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.802091 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 20:32:42.157177 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.802722 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 20:32:42.157177 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.811764 2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 02 20:32:42.157177 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.811778 2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 02 20:32:42.157177 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.812501 2568 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 02 20:32:42.157177 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.812509 2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 02 20:32:42.157177 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812563 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 20:32:42.157177 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812568 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 20:32:42.157177 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812571 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 20:32:42.157177 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812574 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 20:32:42.157177 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812577 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 20:32:42.157177 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812581 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 20:32:42.157177 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812585 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 20:32:42.157177 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812588 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 20:32:42.157177 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812591 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 20:32:42.157597 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812595 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 20:32:42.157597 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812597 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 20:32:42.157597 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812600 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 20:32:42.157597 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812603 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 20:32:42.157597 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812606 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 20:32:42.157597 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812609 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 20:32:42.157597 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812612 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 20:32:42.157597 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812615 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 20:32:42.157597 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812618 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 20:32:42.157597 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812620 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 20:32:42.157597 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812623 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 20:32:42.157597 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812626 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 20:32:42.157597 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812629 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 20:32:42.157597 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812631 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 20:32:42.157597 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812634 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 20:32:42.157597 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812636 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 20:32:42.157597 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812639 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 20:32:42.157597 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812642 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 20:32:42.157597 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812644 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 20:32:42.157597 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812647 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 20:32:42.158811 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812649 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 20:32:42.158811 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812652 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 20:32:42.158811 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812655 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 20:32:42.158811 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812657 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 20:32:42.158811 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812660 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 20:32:42.158811 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812662 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 20:32:42.158811 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812665 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 20:32:42.158811 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812667 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 20:32:42.158811 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812670 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 20:32:42.158811 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812672 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 20:32:42.158811 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812675 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 20:32:42.158811 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812677 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 20:32:42.158811 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812680 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 20:32:42.158811 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812682 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 20:32:42.158811 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812684 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 20:32:42.158811 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812687 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 20:32:42.158811 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812690 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 20:32:42.158811 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812693 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 20:32:42.158811 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812696 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 20:32:42.158811 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812698 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 20:32:42.160062 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812701 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 20:32:42.160062 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812704 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 20:32:42.160062 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812706 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 20:32:42.160062 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812709 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 20:32:42.160062 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812711 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 20:32:42.160062 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812714 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 02 20:32:42.160062 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812716 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 20:32:42.160062 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812719 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 20:32:42.160062 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812721 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 20:32:42.160062 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812724 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 20:32:42.160062 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812726 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 20:32:42.160062 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812729 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 20:32:42.160062 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812731 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 20:32:42.160062 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812733 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 20:32:42.160062 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812736 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 20:32:42.160062 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812738 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 20:32:42.160062 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812741 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 20:32:42.160062 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812743 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 20:32:42.160062 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812746 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 20:32:42.160062 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812748 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 20:32:42.161334 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812751 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 20:32:42.161334 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812754 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 20:32:42.161334 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812758 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 20:32:42.161334 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812760 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 20:32:42.161334 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812763 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 20:32:42.161334 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812781 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 20:32:42.161334 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812785 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 20:32:42.161334 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812788 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 20:32:42.161334 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812794 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 20:32:42.161334 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812797 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 20:32:42.161334 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812801 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 20:32:42.161334 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812804 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 20:32:42.161334 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812807 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 20:32:42.161334 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812809 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 20:32:42.161334 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812814 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 20:32:42.161334 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812817 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 20:32:42.161334 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812820 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 20:32:42.161334 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812822 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 20:32:42.161334 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812825 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 20:32:42.163020 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812827 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 20:32:42.163020 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812830 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 20:32:42.163020 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812833 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 20:32:42.163020 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812835 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 20:32:42.163020 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812838 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 20:32:42.163020 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812840 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 20:32:42.163020 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812843 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 20:32:42.163020 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812863 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 20:32:42.163020 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812866 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 20:32:42.163020 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812869 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 20:32:42.163020 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812871 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 20:32:42.163020 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.812877 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 20:32:42.163020 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812984 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 20:32:42.163020 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812989 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 20:32:42.163020 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812991 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 20:32:42.163425 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812994 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 20:32:42.163425 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812997 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 20:32:42.163425 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.812999 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 20:32:42.163425 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813002 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 20:32:42.163425 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813005 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 20:32:42.163425 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813008 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 20:32:42.163425 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813011 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 20:32:42.163425 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813018 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 20:32:42.163425 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813020 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 20:32:42.163425 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813023 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 20:32:42.163425 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813026 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 20:32:42.163425 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813038 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 20:32:42.163425 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813041 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 20:32:42.163425 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813043 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 20:32:42.163425 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813046 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 20:32:42.163425 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813048 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 20:32:42.163425 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813051 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 20:32:42.163425 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813054 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 20:32:42.163425 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813056 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 20:32:42.163425 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813060 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 20:32:42.163912 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813062 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 20:32:42.163912 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813065 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 20:32:42.163912 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813067 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 20:32:42.163912 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813070 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 20:32:42.163912 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813073 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 20:32:42.163912 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813075 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 20:32:42.163912 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813078 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 20:32:42.163912 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813080 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 20:32:42.163912 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813083 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 20:32:42.163912 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813085 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 20:32:42.163912 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813087 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 20:32:42.163912 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813090 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 20:32:42.163912 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813092 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 20:32:42.163912 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813095 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 20:32:42.163912 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813097 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 20:32:42.163912 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813099 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 20:32:42.163912 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813102 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 20:32:42.163912 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813104 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 20:32:42.163912 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813107 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 02 20:32:42.163912 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813112 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 20:32:42.164419 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813114 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 20:32:42.164419 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813117 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 20:32:42.164419 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813121 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 20:32:42.164419 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813124 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 20:32:42.164419 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813126 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 20:32:42.164419 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813129 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 20:32:42.164419 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813133 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 20:32:42.164419 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813136 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 20:32:42.164419 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813139 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 20:32:42.164419 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813142 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 20:32:42.164419 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813145 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 20:32:42.164419 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813147 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 20:32:42.164419 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813150 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 20:32:42.164419 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813153 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 20:32:42.164419 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813155 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 20:32:42.164419 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813158 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 20:32:42.164419 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813161 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 20:32:42.164419 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813163 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 20:32:42.164419 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813166 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 20:32:42.164890 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813168 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 20:32:42.164890 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813171 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 20:32:42.164890 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813174 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 20:32:42.164890 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813178 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 20:32:42.164890 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813181 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 20:32:42.164890 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813184 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 20:32:42.164890 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813186 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 20:32:42.164890 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813189 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 20:32:42.164890 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813191 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 20:32:42.164890 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813194 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 20:32:42.164890 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813196 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 20:32:42.164890 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813198 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 20:32:42.164890 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813203 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 20:32:42.164890 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813206 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 20:32:42.164890 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813208 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 20:32:42.164890 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813211 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 20:32:42.164890 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813214 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 20:32:42.164890 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813216 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 20:32:42.164890 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813219 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 20:32:42.164890 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813221 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 20:32:42.165387 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813224 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 20:32:42.165387 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813227 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 20:32:42.165387 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813229 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 20:32:42.165387 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813231 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 20:32:42.165387 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813234 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 20:32:42.165387 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813236 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 20:32:42.165387 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813239 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 20:32:42.165387 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813243 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 20:32:42.165387 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813245 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 20:32:42.165387 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813248 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 20:32:42.165387 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813251 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 20:32:42.165387 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813253 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 20:32:42.165387 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813256 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 20:32:42.165387 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813258 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 20:32:42.165387 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813261 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 20:32:42.165387 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813263 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 20:32:42.165387 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:41.813266 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 20:32:42.165783 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.813271 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 20:32:42.165783 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.813364 2568 server.go:962] "Client rotation is on, will bootstrap in background" Jul 02 20:32:42.165783 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.816121 2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 02 20:32:42.165783 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.817355 2568 server.go:1019] "Starting client certificate rotation" Jul 02 20:32:42.165783 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.817460 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 20:32:42.165783 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.817503 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 20:32:42.165783 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.819606 2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 20:32:42.165783 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.822222 2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 20:32:42.165783 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.831529 2568 log.go:25] "Validated CRI v1 runtime API" Jul 02 20:32:42.165783 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.833753 2568 log.go:25] "Validated CRI v1 image API" Jul 02 20:32:42.165783 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.834493 2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 02 20:32:42.165783 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.836823 2568 fs.go:135] Filesystem UUIDs: map[5f5b2c4a-9264-4f6e-a910-ca785092af89:/dev/nvme0n1p3 68f5d04b-358c-4ab3-ba25-fd0c4d14e8a5:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 02 20:32:42.166092 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.836837 2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 02 20:32:42.166124 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.844760 2568 manager.go:216] Machine: {Timestamp:2026-07-02 20:32:41.843567986 +0000 UTC m=+0.296489078 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3104977 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2492f1dd47070b572f7a183db73e2a SystemUUID:ec2492f1-dd47-070b-572f-7a183db73e2a BootID:d538b2f1-fb7b-4366-8704-1fb066184b7c Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:b7:0f:2b:f0:87 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:b7:0f:2b:f0:87 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:82:ba:7c:75:6d:26 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 02 20:32:42.166124 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.844871 2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 02 20:32:42.166124 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.844940 2568 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 02 20:32:42.166124 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.846071 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 20:32:42.166124 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.847861 2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 02 20:32:42.166124 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.847888 2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-144.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 02 20:32:42.166124 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.848580 2568 topology_manager.go:138] "Creating topology manager with none policy" Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.848590 2568 container_manager_linux.go:309] "Creating device plugin manager" Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.848597 2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.849187 2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.850684 2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.854542 2568 state_mem.go:36] "Initialized new in-memory state store" Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.854649 2568 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.854677 2568 kubelet.go:486] "Attempting to sync node with API server" Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.854689 2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.854703 2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.854713 2568 kubelet.go:398] "Adding apiserver pod source" Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.854721 2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.855093 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.855115 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.856950 2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.858921 2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.858948 2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.860172 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.860189 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.860199 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.860206 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.860215 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.860220 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.860228 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.860233 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.860239 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.860244 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.860254 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.860263 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.861522 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.861536 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.863981 2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-144.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.864524 2568 server.go:1268] "Started kubelet" Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.864600 2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:41.864641 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-144.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:41.864641 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.864716 2568 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.864728 2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.867199 2568 server.go:310] "Adding debug handlers to kubelet server" Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.868529 2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 02 20:32:42.166327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.868935 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9l6t6" Jul 02 20:32:42.167324 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:41.869606 2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 02 20:32:42.167324 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.874809 2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 02 20:32:42.167324 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.874820 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 02 20:32:42.167324 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:41.874905 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-144.ec2.internal\" not found" Jul 02 20:32:42.167324 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.875636 2568 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 02 20:32:42.167324 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.875642 2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 02 20:32:42.167324 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.875685 2568 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 02 20:32:42.167324 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.875772 2568 reconstruct.go:97] "Volume reconstruction finished" Jul 02 20:32:42.167324 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.875786 2568 reconciler.go:29] "Reconciler: start to sync state" Jul 02 20:32:42.167324 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.875885 2568 factory.go:55] Registering systemd factory Jul 02 20:32:42.167324 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.875903 2568 factory.go:223] Registration of the systemd container factory successfully Jul 02 20:32:42.167324 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.876217 2568 factory.go:153] Registering CRI-O factory Jul 02 20:32:42.167324 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.876230 2568 factory.go:223] Registration of the crio container factory successfully Jul 02 20:32:42.167324 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.876299 2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 02 20:32:42.167324 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.876319 2568 factory.go:103] Registering Raw factory Jul 02 20:32:42.167324 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.876331 2568 manager.go:1196] Started watching for new ooms in manager Jul 02 20:32:42.167324 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.877123 2568 manager.go:349] Starting recovery of all containers Jul 02 20:32:42.167324 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:41.880546 2568 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-144.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 02 20:32:42.167324 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:41.881918 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9l6t6" Jul 02 20:32:42.167324 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:41.884349 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 02 20:32:42.167324 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:41.880659 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-144.ec2.internal.18be9335d2cd17b5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-144.ec2.internal,UID:ip-10-0-137-144.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-144.ec2.internal,},FirstTimestamp:2026-07-02 20:32:41.864501173 +0000 UTC m=+0.317422264,LastTimestamp:2026-07-02 20:32:41.864501173 +0000 UTC m=+0.317422264,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-144.ec2.internal,}" Jul 02 20:32:42.233278 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:42.233215 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-144.ec2.internal\" not found" Jul 02 20:32:42.235414 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:42.235386 2568 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-144.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="400ms" Jul 02 20:32:42.239419 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.239404 2568 manager.go:354] Recovery completed Jul 02 20:32:42.243532 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.243520 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 20:32:42.249167 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.249062 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientMemory" Jul 02 20:32:42.249262 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.249181 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 20:32:42.249262 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.249197 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientPID" Jul 02 20:32:42.249795 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.249780 2568 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 02 20:32:42.249795 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.249792 2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 02 20:32:42.249915 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.249807 2568 state_mem.go:36] "Initialized new in-memory state store" Jul 02 20:32:42.249915 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.249783 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 20:32:42.250486 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.250472 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientMemory" Jul 02 20:32:42.250522 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.250499 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 20:32:42.250522 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.250511 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientPID" Jul 02 20:32:42.251904 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.251891 2568 policy_none.go:49] "None policy: Start" Jul 02 20:32:42.251963 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.251909 2568 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 02 20:32:42.251963 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.251923 2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 02 20:32:42.253902 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.253890 2568 policy_none.go:47] "Start" Jul 02 20:32:42.291878 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.291862 2568 manager.go:337] "Starting Device Plugin manager" Jul 02 20:32:42.291963 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:42.291895 2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 02 20:32:42.291963 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.291908 2568 server.go:87] "Starting device plugin registration server" Jul 02 20:32:42.292129 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.292113 2568 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 02 20:32:42.292178 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.292131 2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 02 20:32:42.292224 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.292207 2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 02 20:32:42.292297 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.292282 2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 02 20:32:42.292347 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.292299 2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 02 20:32:42.292759 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:42.292743 2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 02 20:32:42.292821 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:42.292782 2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-144.ec2.internal\" not found" Jul 02 20:32:42.355675 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.355647 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 02 20:32:42.357798 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.356740 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 02 20:32:42.357798 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.356772 2568 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 02 20:32:42.357798 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.356791 2568 kubelet.go:2448] "Starting kubelet main sync loop" Jul 02 20:32:42.357798 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:42.356820 2568 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 02 20:32:42.359475 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.359453 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 20:32:42.392576 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.392559 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 20:32:42.394393 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.394378 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientMemory" Jul 02 20:32:42.394456 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.394405 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 20:32:42.394456 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.394421 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientPID" Jul 02 20:32:42.394456 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.394444 2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-144.ec2.internal" Jul 02 20:32:42.401258 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.401246 2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-144.ec2.internal" Jul 02 20:32:42.401299 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:42.401265 2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-144.ec2.internal\": node \"ip-10-0-137-144.ec2.internal\" not found" Jul 02 20:32:42.418321 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:42.418298 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-144.ec2.internal\" not found" Jul 02 20:32:42.458003 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.457974 2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-144.ec2.internal"] Jul 02 20:32:42.458052 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.458048 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 20:32:42.459534 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.459513 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientMemory" Jul 02 20:32:42.459626 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.459539 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 20:32:42.459626 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.459554 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientPID" Jul 02 20:32:42.462047 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.462035 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 20:32:42.462170 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.462155 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" Jul 02 20:32:42.462218 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.462185 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 20:32:42.462636 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.462620 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientMemory" Jul 02 20:32:42.462742 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.462645 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 20:32:42.462742 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.462658 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientPID" Jul 02 20:32:42.462742 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.462672 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientMemory" Jul 02 20:32:42.462742 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.462692 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 20:32:42.462742 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.462705 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientPID" Jul 02 20:32:42.465150 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.465132 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-144.ec2.internal" Jul 02 20:32:42.465231 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.465165 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 20:32:42.465849 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.465831 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientMemory" Jul 02 20:32:42.465946 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.465883 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 20:32:42.465946 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.465895 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeHasSufficientPID" Jul 02 20:32:42.487575 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:42.487556 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-144.ec2.internal\" not found" node="ip-10-0-137-144.ec2.internal" Jul 02 20:32:42.492349 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:42.492334 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-144.ec2.internal\" not found" node="ip-10-0-137-144.ec2.internal" Jul 02 20:32:42.519460 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:42.519443 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-144.ec2.internal\" not found" Jul 02 20:32:42.535289 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.535271 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2e15b28acdfde5fc6df129862ecf92ac-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal\" (UID: \"2e15b28acdfde5fc6df129862ecf92ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" Jul 02 20:32:42.535357 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.535294 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e15b28acdfde5fc6df129862ecf92ac-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal\" (UID: \"2e15b28acdfde5fc6df129862ecf92ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" Jul 02 20:32:42.535357 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.535313 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a3daa949ad2399aa2ae00a9f45c827ee-config\") pod \"kube-apiserver-proxy-ip-10-0-137-144.ec2.internal\" (UID: \"a3daa949ad2399aa2ae00a9f45c827ee\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-144.ec2.internal" Jul 02 20:32:42.621275 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:42.621252 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-144.ec2.internal\" not found" Jul 02 20:32:42.636594 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.636572 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2e15b28acdfde5fc6df129862ecf92ac-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal\" (UID: \"2e15b28acdfde5fc6df129862ecf92ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" Jul 02 20:32:42.636668 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.636595 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2e15b28acdfde5fc6df129862ecf92ac-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal\" (UID: \"2e15b28acdfde5fc6df129862ecf92ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" Jul 02 20:32:42.636668 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.636609 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e15b28acdfde5fc6df129862ecf92ac-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal\" (UID: \"2e15b28acdfde5fc6df129862ecf92ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" Jul 02 20:32:42.636668 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.636628 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a3daa949ad2399aa2ae00a9f45c827ee-config\") pod \"kube-apiserver-proxy-ip-10-0-137-144.ec2.internal\" (UID: \"a3daa949ad2399aa2ae00a9f45c827ee\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-144.ec2.internal" Jul 02 20:32:42.636668 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.636652 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/a3daa949ad2399aa2ae00a9f45c827ee-config\") pod \"kube-apiserver-proxy-ip-10-0-137-144.ec2.internal\" (UID: \"a3daa949ad2399aa2ae00a9f45c827ee\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-144.ec2.internal" Jul 02 20:32:42.636812 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.636694 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2e15b28acdfde5fc6df129862ecf92ac-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal\" (UID: \"2e15b28acdfde5fc6df129862ecf92ac\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" Jul 02 20:32:42.707610 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.707561 2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 20:32:42.777496 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.777462 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-144.ec2.internal" Jul 02 20:32:42.787671 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.787653 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 20:32:42.789421 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.789407 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" Jul 02 20:32:42.791565 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.791552 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" Jul 02 20:32:42.797413 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.796818 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-144.ec2.internal" Jul 02 20:32:42.800217 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.800201 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 20:32:42.817281 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.817255 2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 02 20:32:42.817401 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.817383 2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 20:32:42.817516 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.817425 2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 20:32:42.854911 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.854887 2568 apiserver.go:52] "Watching apiserver" Jul 02 20:32:42.869617 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.869593 2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 02 20:32:42.870686 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.870665 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-m678g","openshift-image-registry/node-ca-q8p8n","openshift-network-diagnostics/network-check-target-65xk9","openshift-ovn-kubernetes/ovnkube-node-mmgwl","kube-system/kube-apiserver-proxy-ip-10-0-137-144.ec2.internal","openshift-dns/node-resolver-hlj5p","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal","openshift-multus/multus-additional-cni-plugins-xkk7n","openshift-multus/multus-n9rd8","openshift-multus/network-metrics-daemon-ls998","openshift-network-operator/iptables-alerter-nc8b6","kube-system/global-pull-secret-syncer-6r6ph","kube-system/konnectivity-agent-tnmd2","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jlrcv"] Jul 02 20:32:42.873301 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.873287 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:42.875075 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.875057 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 02 20:32:42.875550 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.875529 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q8p8n" Jul 02 20:32:42.875788 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.875749 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-mbtsz\"" Jul 02 20:32:42.875914 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.875789 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 02 20:32:42.875914 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.875792 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 02 20:32:42.877693 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.877679 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 02 20:32:42.877937 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.877909 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65xk9" Jul 02 20:32:42.877996 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:42.877975 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65xk9" podUID="d5984f1f-3f02-4ab7-b9b9-7e203a87ea34" Jul 02 20:32:42.878206 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.878190 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-m2hn4\"" Jul 02 20:32:42.878306 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.878290 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 02 20:32:42.878393 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.878374 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 02 20:32:42.880445 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.880427 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:42.882745 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.882728 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gg7c4\"" Jul 02 20:32:42.882885 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.882871 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hlj5p" Jul 02 20:32:42.883112 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.883085 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 02 20:32:42.883273 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.883255 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 02 20:32:42.883328 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.883255 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 02 20:32:42.883707 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.883695 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 02 20:32:42.883934 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.883912 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 02 20:32:42.884006 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.883992 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 02 20:32:42.885005 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.884991 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-2z2jx\"" Jul 02 20:32:42.885178 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.885162 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 02 20:32:42.885298 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.885283 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xkk7n" Jul 02 20:32:42.885689 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.885675 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 02 20:32:42.886976 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.886959 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 20:32:42.887323 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.887307 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 02 20:32:42.887468 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.887453 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 02 20:32:42.887563 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.887540 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 02 20:32:42.887635 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.887589 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 02 20:32:42.887635 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.887607 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-x7j6k\"" Jul 02 20:32:42.887745 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.887735 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 02 20:32:42.887805 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.887771 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n9rd8" Jul 02 20:32:42.889892 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.889877 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 02 20:32:42.890609 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.890592 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls998" Jul 02 20:32:42.890661 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:42.890644 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ls998" podUID="56e0a8da-b013-4d0c-b5e9-b9431f944da3" Jul 02 20:32:42.891773 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.891756 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-fdqfk\"" Jul 02 20:32:42.893021 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.893004 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nc8b6" Jul 02 20:32:42.895067 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.895049 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 02 20:32:42.895331 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.895317 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 02 20:32:42.895500 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.895486 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6r6ph" Jul 02 20:32:42.895547 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:42.895533 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6r6ph" podUID="cce9f678-db00-4f8d-bdaa-b2479796b62e" Jul 02 20:32:42.895585 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.895536 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gx6tw\"" Jul 02 20:32:42.895658 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.895491 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 02 20:32:42.897496 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.897484 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tnmd2" Jul 02 20:32:42.899785 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.899768 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 02 20:32:42.900406 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.900372 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-b6w8h\"" Jul 02 20:32:42.900563 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.900449 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 02 20:32:42.900649 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.900571 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jlrcv" Jul 02 20:32:42.903284 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.903260 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 02 20:32:42.903396 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.903266 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-md9hq\"" Jul 02 20:32:42.903396 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.903309 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 02 20:32:42.903573 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.903559 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 02 20:32:42.915250 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.915231 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-89z9p" Jul 02 20:32:42.922534 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.922516 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-89z9p" Jul 02 20:32:42.937840 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.937818 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b7d5983b-3afb-4507-abeb-871f909d6414-host\") pod \"node-ca-q8p8n\" (UID: \"b7d5983b-3afb-4507-abeb-871f909d6414\") " pod="openshift-image-registry/node-ca-q8p8n" Jul 02 20:32:42.937840 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.937854 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b7d5983b-3afb-4507-abeb-871f909d6414-serviceca\") pod \"node-ca-q8p8n\" (UID: \"b7d5983b-3afb-4507-abeb-871f909d6414\") " pod="openshift-image-registry/node-ca-q8p8n" Jul 02 20:32:42.937979 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.937880 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h6n6n\" (UniqueName: \"kubernetes.io/projected/d5984f1f-3f02-4ab7-b9b9-7e203a87ea34-kube-api-access-h6n6n\") pod \"network-check-target-65xk9\" (UID: \"d5984f1f-3f02-4ab7-b9b9-7e203a87ea34\") " pod="openshift-network-diagnostics/network-check-target-65xk9" Jul 02 20:32:42.937979 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.937904 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6a31ac7c-eb80-40a5-ba12-098835ab593a-etc-modprobe-d\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:42.937979 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.937942 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a31ac7c-eb80-40a5-ba12-098835ab593a-etc-kubernetes\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:42.937979 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.937961 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a31ac7c-eb80-40a5-ba12-098835ab593a-var-lib-kubelet\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:42.937979 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.937976 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6a31ac7c-eb80-40a5-ba12-098835ab593a-etc-sysctl-d\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:42.938206 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.937990 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a31ac7c-eb80-40a5-ba12-098835ab593a-sys\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:42.938206 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.938009 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a31ac7c-eb80-40a5-ba12-098835ab593a-host\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:42.938206 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.938035 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kx29h\" (UniqueName: \"kubernetes.io/projected/6a31ac7c-eb80-40a5-ba12-098835ab593a-kube-api-access-kx29h\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:42.938206 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.938052 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4n22\" (UniqueName: \"kubernetes.io/projected/b7d5983b-3afb-4507-abeb-871f909d6414-kube-api-access-l4n22\") pod \"node-ca-q8p8n\" (UID: \"b7d5983b-3afb-4507-abeb-871f909d6414\") " pod="openshift-image-registry/node-ca-q8p8n" Jul 02 20:32:42.938206 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.938067 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6a31ac7c-eb80-40a5-ba12-098835ab593a-etc-sysconfig\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:42.938206 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.938132 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6a31ac7c-eb80-40a5-ba12-098835ab593a-etc-sysctl-conf\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:42.938206 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.938168 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6a31ac7c-eb80-40a5-ba12-098835ab593a-etc-systemd\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:42.938459 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.938214 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6a31ac7c-eb80-40a5-ba12-098835ab593a-etc-tuned\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:42.938459 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.938243 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6a31ac7c-eb80-40a5-ba12-098835ab593a-run\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:42.938459 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.938261 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a31ac7c-eb80-40a5-ba12-098835ab593a-lib-modules\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:42.938459 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.938284 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a31ac7c-eb80-40a5-ba12-098835ab593a-tmp\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:42.976459 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:42.976441 2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 02 20:32:43.013483 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.013466 2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 20:32:43.039436 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.039416 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6a31ac7c-eb80-40a5-ba12-098835ab593a-etc-sysctl-d\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:43.039536 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.039446 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/02a28c36-499c-40df-92ac-4cf4b1222c70-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xkk7n\" (UID: \"02a28c36-499c-40df-92ac-4cf4b1222c70\") " pod="openshift-multus/multus-additional-cni-plugins-xkk7n" Jul 02 20:32:43.039536 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.039463 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-systemd-units\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.039536 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.039479 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-host-cni-netd\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.039536 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.039493 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-etc-kubernetes\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.039536 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.039527 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6a31ac7c-eb80-40a5-ba12-098835ab593a-etc-sysconfig\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:43.039731 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.039552 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6a31ac7c-eb80-40a5-ba12-098835ab593a-etc-sysctl-d\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:43.039731 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.039586 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6a31ac7c-eb80-40a5-ba12-098835ab593a-etc-sysconfig\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:43.039731 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.039611 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/02a28c36-499c-40df-92ac-4cf4b1222c70-cnibin\") pod \"multus-additional-cni-plugins-xkk7n\" (UID: \"02a28c36-499c-40df-92ac-4cf4b1222c70\") " pod="openshift-multus/multus-additional-cni-plugins-xkk7n" Jul 02 20:32:43.039731 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.039634 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/131eba4c-85f0-47e1-8c22-28eff5d0d06e-device-dir\") pod \"aws-ebs-csi-driver-node-jlrcv\" (UID: \"131eba4c-85f0-47e1-8c22-28eff5d0d06e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jlrcv" Jul 02 20:32:43.039731 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.039652 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/131eba4c-85f0-47e1-8c22-28eff5d0d06e-sys-fs\") pod \"aws-ebs-csi-driver-node-jlrcv\" (UID: \"131eba4c-85f0-47e1-8c22-28eff5d0d06e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jlrcv" Jul 02 20:32:43.039731 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.039668 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4q8p\" (UniqueName: \"kubernetes.io/projected/56b04565-9e51-4bfe-bc36-4aa5864a9654-kube-api-access-j4q8p\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.039731 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.039683 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-multus-cni-dir\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.039731 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.039723 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/061a3e0f-48fe-4a8f-8b89-d0931f9e404d-agent-certs\") pod \"konnectivity-agent-tnmd2\" (UID: \"061a3e0f-48fe-4a8f-8b89-d0931f9e404d\") " pod="kube-system/konnectivity-agent-tnmd2" Jul 02 20:32:43.040041 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.039745 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f642606-1324-47e9-a987-6007d50f7707-tmp-dir\") pod \"node-resolver-hlj5p\" (UID: \"2f642606-1324-47e9-a987-6007d50f7707\") " pod="openshift-dns/node-resolver-hlj5p" Jul 02 20:32:43.040041 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.039762 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8gxng\" (UniqueName: \"kubernetes.io/projected/2f642606-1324-47e9-a987-6007d50f7707-kube-api-access-8gxng\") pod \"node-resolver-hlj5p\" (UID: \"2f642606-1324-47e9-a987-6007d50f7707\") " pod="openshift-dns/node-resolver-hlj5p" Jul 02 20:32:43.040041 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.039780 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzfhd\" (UniqueName: \"kubernetes.io/projected/7c9eafd9-a647-4969-9f9b-ba66b6da5c10-kube-api-access-xzfhd\") pod \"iptables-alerter-nc8b6\" (UID: \"7c9eafd9-a647-4969-9f9b-ba66b6da5c10\") " pod="openshift-network-operator/iptables-alerter-nc8b6" Jul 02 20:32:43.040041 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.039796 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cce9f678-db00-4f8d-bdaa-b2479796b62e-original-pull-secret\") pod \"global-pull-secret-syncer-6r6ph\" (UID: \"cce9f678-db00-4f8d-bdaa-b2479796b62e\") " pod="kube-system/global-pull-secret-syncer-6r6ph" Jul 02 20:32:43.040041 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.039810 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-run-systemd\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.040041 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.039840 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-host-var-lib-cni-bin\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.040041 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.039856 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/131eba4c-85f0-47e1-8c22-28eff5d0d06e-socket-dir\") pod \"aws-ebs-csi-driver-node-jlrcv\" (UID: \"131eba4c-85f0-47e1-8c22-28eff5d0d06e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jlrcv" Jul 02 20:32:43.040041 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.039884 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-os-release\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.040041 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.039903 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27c24\" (UniqueName: \"kubernetes.io/projected/2d608d9c-dccd-4a18-bc1f-b33258ff0874-kube-api-access-27c24\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.040041 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.039937 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6a31ac7c-eb80-40a5-ba12-098835ab593a-etc-systemd\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:43.040041 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.039960 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02a28c36-499c-40df-92ac-4cf4b1222c70-system-cni-dir\") pod \"multus-additional-cni-plugins-xkk7n\" (UID: \"02a28c36-499c-40df-92ac-4cf4b1222c70\") " pod="openshift-multus/multus-additional-cni-plugins-xkk7n" Jul 02 20:32:43.040041 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.039976 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/02a28c36-499c-40df-92ac-4cf4b1222c70-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xkk7n\" (UID: \"02a28c36-499c-40df-92ac-4cf4b1222c70\") " pod="openshift-multus/multus-additional-cni-plugins-xkk7n" Jul 02 20:32:43.040041 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.039993 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/131eba4c-85f0-47e1-8c22-28eff5d0d06e-registration-dir\") pod \"aws-ebs-csi-driver-node-jlrcv\" (UID: \"131eba4c-85f0-47e1-8c22-28eff5d0d06e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jlrcv" Jul 02 20:32:43.040041 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.040006 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6a31ac7c-eb80-40a5-ba12-098835ab593a-etc-systemd\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:43.040603 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.040028 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnxbt\" (UniqueName: \"kubernetes.io/projected/131eba4c-85f0-47e1-8c22-28eff5d0d06e-kube-api-access-bnxbt\") pod \"aws-ebs-csi-driver-node-jlrcv\" (UID: \"131eba4c-85f0-47e1-8c22-28eff5d0d06e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jlrcv" Jul 02 20:32:43.040603 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.040070 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-host-run-ovn-kubernetes\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.040603 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.040107 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-host-cni-bin\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.040603 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.040135 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.040603 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.040161 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zckjl\" (UniqueName: \"kubernetes.io/projected/02a28c36-499c-40df-92ac-4cf4b1222c70-kube-api-access-zckjl\") pod \"multus-additional-cni-plugins-xkk7n\" (UID: \"02a28c36-499c-40df-92ac-4cf4b1222c70\") " pod="openshift-multus/multus-additional-cni-plugins-xkk7n" Jul 02 20:32:43.040603 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.040186 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cce9f678-db00-4f8d-bdaa-b2479796b62e-dbus\") pod \"global-pull-secret-syncer-6r6ph\" (UID: \"cce9f678-db00-4f8d-bdaa-b2479796b62e\") " pod="kube-system/global-pull-secret-syncer-6r6ph" Jul 02 20:32:43.040603 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.040225 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-host-kubelet\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.040603 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.040253 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-etc-openvswitch\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.040603 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.040280 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-multus-socket-dir-parent\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.040603 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.040304 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-hostroot\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.040603 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.040327 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-multus-conf-dir\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.040603 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.040349 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2f642606-1324-47e9-a987-6007d50f7707-hosts-file\") pod \"node-resolver-hlj5p\" (UID: \"2f642606-1324-47e9-a987-6007d50f7707\") " pod="openshift-dns/node-resolver-hlj5p" Jul 02 20:32:43.040603 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.040376 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6a31ac7c-eb80-40a5-ba12-098835ab593a-etc-modprobe-d\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:43.041072 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.040401 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/02a28c36-499c-40df-92ac-4cf4b1222c70-cni-binary-copy\") pod \"multus-additional-cni-plugins-xkk7n\" (UID: \"02a28c36-499c-40df-92ac-4cf4b1222c70\") " pod="openshift-multus/multus-additional-cni-plugins-xkk7n" Jul 02 20:32:43.041072 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.040426 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-run-openvswitch\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.041072 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.040449 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a31ac7c-eb80-40a5-ba12-098835ab593a-sys\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:43.041072 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.040475 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a31ac7c-eb80-40a5-ba12-098835ab593a-host\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:43.041072 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.040505 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6a31ac7c-eb80-40a5-ba12-098835ab593a-etc-modprobe-d\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:43.041072 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.040516 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6a31ac7c-eb80-40a5-ba12-098835ab593a-host\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:43.041072 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.040536 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kx29h\" (UniqueName: \"kubernetes.io/projected/6a31ac7c-eb80-40a5-ba12-098835ab593a-kube-api-access-kx29h\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:43.041072 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.040555 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6a31ac7c-eb80-40a5-ba12-098835ab593a-sys\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:43.041072 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.040564 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/131eba4c-85f0-47e1-8c22-28eff5d0d06e-etc-selinux\") pod \"aws-ebs-csi-driver-node-jlrcv\" (UID: \"131eba4c-85f0-47e1-8c22-28eff5d0d06e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jlrcv" Jul 02 20:32:43.041072 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.040588 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-host-slash\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.041072 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.040624 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-var-lib-openvswitch\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.041072 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.040653 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/56b04565-9e51-4bfe-bc36-4aa5864a9654-ovnkube-config\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.041072 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.040680 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-system-cni-dir\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.041072 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.040702 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-log-socket\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.041873 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.040726 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2d608d9c-dccd-4a18-bc1f-b33258ff0874-cni-binary-copy\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.041873 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.040750 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-host-run-k8s-cni-cncf-io\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.041873 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.040775 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-host-run-multus-certs\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.041873 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.040799 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k8qr\" (UniqueName: \"kubernetes.io/projected/56e0a8da-b013-4d0c-b5e9-b9431f944da3-kube-api-access-2k8qr\") pod \"network-metrics-daemon-ls998\" (UID: \"56e0a8da-b013-4d0c-b5e9-b9431f944da3\") " pod="openshift-multus/network-metrics-daemon-ls998" Jul 02 20:32:43.041873 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.040854 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a31ac7c-eb80-40a5-ba12-098835ab593a-tmp\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:43.041873 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.040895 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b7d5983b-3afb-4507-abeb-871f909d6414-serviceca\") pod \"node-ca-q8p8n\" (UID: \"b7d5983b-3afb-4507-abeb-871f909d6414\") " pod="openshift-image-registry/node-ca-q8p8n" Jul 02 20:32:43.041873 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.040995 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-run-ovn\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.041873 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.041015 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-host-var-lib-cni-multus\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.041873 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.041035 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a31ac7c-eb80-40a5-ba12-098835ab593a-etc-kubernetes\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:43.041873 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.041052 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c9eafd9-a647-4969-9f9b-ba66b6da5c10-host-slash\") pod \"iptables-alerter-nc8b6\" (UID: \"7c9eafd9-a647-4969-9f9b-ba66b6da5c10\") " pod="openshift-network-operator/iptables-alerter-nc8b6" Jul 02 20:32:43.041873 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.041078 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-cnibin\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.041873 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.041093 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-host-var-lib-kubelet\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.041873 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.041108 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/061a3e0f-48fe-4a8f-8b89-d0931f9e404d-konnectivity-ca\") pod \"konnectivity-agent-tnmd2\" (UID: \"061a3e0f-48fe-4a8f-8b89-d0931f9e404d\") " pod="kube-system/konnectivity-agent-tnmd2" Jul 02 20:32:43.041873 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.041132 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4n22\" (UniqueName: \"kubernetes.io/projected/b7d5983b-3afb-4507-abeb-871f909d6414-kube-api-access-l4n22\") pod \"node-ca-q8p8n\" (UID: \"b7d5983b-3afb-4507-abeb-871f909d6414\") " pod="openshift-image-registry/node-ca-q8p8n" Jul 02 20:32:43.042436 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.041150 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6a31ac7c-eb80-40a5-ba12-098835ab593a-etc-kubernetes\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:43.042436 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.041150 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-host-run-netns\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.042436 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.041184 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-node-log\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.042436 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.041205 2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 02 20:32:43.042436 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.041230 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-host-run-netns\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.042436 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.041270 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2d608d9c-dccd-4a18-bc1f-b33258ff0874-multus-daemon-config\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.042436 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.041340 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6a31ac7c-eb80-40a5-ba12-098835ab593a-etc-sysctl-conf\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:43.042436 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.041379 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6a31ac7c-eb80-40a5-ba12-098835ab593a-etc-tuned\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:43.042436 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.041428 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/02a28c36-499c-40df-92ac-4cf4b1222c70-os-release\") pod \"multus-additional-cni-plugins-xkk7n\" (UID: \"02a28c36-499c-40df-92ac-4cf4b1222c70\") " pod="openshift-multus/multus-additional-cni-plugins-xkk7n" Jul 02 20:32:43.042436 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.041459 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56e0a8da-b013-4d0c-b5e9-b9431f944da3-metrics-certs\") pod \"network-metrics-daemon-ls998\" (UID: \"56e0a8da-b013-4d0c-b5e9-b9431f944da3\") " pod="openshift-multus/network-metrics-daemon-ls998" Jul 02 20:32:43.042436 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.041541 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6a31ac7c-eb80-40a5-ba12-098835ab593a-run\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:43.042436 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.041572 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a31ac7c-eb80-40a5-ba12-098835ab593a-lib-modules\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:43.042436 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.041601 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b7d5983b-3afb-4507-abeb-871f909d6414-host\") pod \"node-ca-q8p8n\" (UID: \"b7d5983b-3afb-4507-abeb-871f909d6414\") " pod="openshift-image-registry/node-ca-q8p8n" Jul 02 20:32:43.042436 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.041631 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6n6n\" (UniqueName: \"kubernetes.io/projected/d5984f1f-3f02-4ab7-b9b9-7e203a87ea34-kube-api-access-h6n6n\") pod \"network-check-target-65xk9\" (UID: \"d5984f1f-3f02-4ab7-b9b9-7e203a87ea34\") " pod="openshift-network-diagnostics/network-check-target-65xk9" Jul 02 20:32:43.042863 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.041657 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7c9eafd9-a647-4969-9f9b-ba66b6da5c10-iptables-alerter-script\") pod \"iptables-alerter-nc8b6\" (UID: \"7c9eafd9-a647-4969-9f9b-ba66b6da5c10\") " pod="openshift-network-operator/iptables-alerter-nc8b6" Jul 02 20:32:43.042863 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.041703 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cce9f678-db00-4f8d-bdaa-b2479796b62e-kubelet-config\") pod \"global-pull-secret-syncer-6r6ph\" (UID: \"cce9f678-db00-4f8d-bdaa-b2479796b62e\") " pod="kube-system/global-pull-secret-syncer-6r6ph" Jul 02 20:32:43.042863 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.041749 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/131eba4c-85f0-47e1-8c22-28eff5d0d06e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jlrcv\" (UID: \"131eba4c-85f0-47e1-8c22-28eff5d0d06e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jlrcv" Jul 02 20:32:43.042863 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.041774 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/56b04565-9e51-4bfe-bc36-4aa5864a9654-env-overrides\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.042863 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.041802 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a31ac7c-eb80-40a5-ba12-098835ab593a-var-lib-kubelet\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:43.042863 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.041811 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/b7d5983b-3afb-4507-abeb-871f909d6414-serviceca\") pod \"node-ca-q8p8n\" (UID: \"b7d5983b-3afb-4507-abeb-871f909d6414\") " pod="openshift-image-registry/node-ca-q8p8n" Jul 02 20:32:43.042863 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.041772 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6a31ac7c-eb80-40a5-ba12-098835ab593a-lib-modules\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:43.042863 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.041885 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/02a28c36-499c-40df-92ac-4cf4b1222c70-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xkk7n\" (UID: \"02a28c36-499c-40df-92ac-4cf4b1222c70\") " pod="openshift-multus/multus-additional-cni-plugins-xkk7n" Jul 02 20:32:43.042863 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.041890 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6a31ac7c-eb80-40a5-ba12-098835ab593a-var-lib-kubelet\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:43.042863 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.041932 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/56b04565-9e51-4bfe-bc36-4aa5864a9654-ovn-node-metrics-cert\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.042863 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.041919 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/b7d5983b-3afb-4507-abeb-871f909d6414-host\") pod \"node-ca-q8p8n\" (UID: \"b7d5983b-3afb-4507-abeb-871f909d6414\") " pod="openshift-image-registry/node-ca-q8p8n" Jul 02 20:32:43.042863 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.041446 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6a31ac7c-eb80-40a5-ba12-098835ab593a-etc-sysctl-conf\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:43.042863 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.042071 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/56b04565-9e51-4bfe-bc36-4aa5864a9654-ovnkube-script-lib\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.042863 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.042164 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6a31ac7c-eb80-40a5-ba12-098835ab593a-run\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:43.044377 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.044359 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6a31ac7c-eb80-40a5-ba12-098835ab593a-tmp\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:43.044451 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.044406 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6a31ac7c-eb80-40a5-ba12-098835ab593a-etc-tuned\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:43.049200 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.049177 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kx29h\" (UniqueName: \"kubernetes.io/projected/6a31ac7c-eb80-40a5-ba12-098835ab593a-kube-api-access-kx29h\") pod \"tuned-m678g\" (UID: \"6a31ac7c-eb80-40a5-ba12-098835ab593a\") " pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:43.056207 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:43.056182 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 20:32:43.056304 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:43.056214 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 20:32:43.056304 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:43.056227 2568 projected.go:196] Error preparing data for projected volume kube-api-access-h6n6n for pod openshift-network-diagnostics/network-check-target-65xk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 20:32:43.056643 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:43.056625 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5984f1f-3f02-4ab7-b9b9-7e203a87ea34-kube-api-access-h6n6n podName:d5984f1f-3f02-4ab7-b9b9-7e203a87ea34 nodeName:}" failed. No retries permitted until 2026-07-02 20:32:43.556596993 +0000 UTC m=+2.009518093 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-h6n6n" (UniqueName: "kubernetes.io/projected/d5984f1f-3f02-4ab7-b9b9-7e203a87ea34-kube-api-access-h6n6n") pod "network-check-target-65xk9" (UID: "d5984f1f-3f02-4ab7-b9b9-7e203a87ea34") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 20:32:43.058678 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.058649 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4n22\" (UniqueName: \"kubernetes.io/projected/b7d5983b-3afb-4507-abeb-871f909d6414-kube-api-access-l4n22\") pod \"node-ca-q8p8n\" (UID: \"b7d5983b-3afb-4507-abeb-871f909d6414\") " pod="openshift-image-registry/node-ca-q8p8n" Jul 02 20:32:43.142767 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.142736 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-node-log\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.142910 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.142774 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-host-run-netns\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.142910 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.142802 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2d608d9c-dccd-4a18-bc1f-b33258ff0874-multus-daemon-config\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.142910 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.142812 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-node-log\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.142910 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.142830 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/02a28c36-499c-40df-92ac-4cf4b1222c70-os-release\") pod \"multus-additional-cni-plugins-xkk7n\" (UID: \"02a28c36-499c-40df-92ac-4cf4b1222c70\") " pod="openshift-multus/multus-additional-cni-plugins-xkk7n" Jul 02 20:32:43.142910 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.142856 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56e0a8da-b013-4d0c-b5e9-b9431f944da3-metrics-certs\") pod \"network-metrics-daemon-ls998\" (UID: \"56e0a8da-b013-4d0c-b5e9-b9431f944da3\") " pod="openshift-multus/network-metrics-daemon-ls998" Jul 02 20:32:43.143101 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.142913 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7c9eafd9-a647-4969-9f9b-ba66b6da5c10-iptables-alerter-script\") pod \"iptables-alerter-nc8b6\" (UID: \"7c9eafd9-a647-4969-9f9b-ba66b6da5c10\") " pod="openshift-network-operator/iptables-alerter-nc8b6" Jul 02 20:32:43.143101 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:43.142937 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 20:32:43.143101 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.142982 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cce9f678-db00-4f8d-bdaa-b2479796b62e-kubelet-config\") pod \"global-pull-secret-syncer-6r6ph\" (UID: \"cce9f678-db00-4f8d-bdaa-b2479796b62e\") " pod="kube-system/global-pull-secret-syncer-6r6ph" Jul 02 20:32:43.143101 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:43.142991 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56e0a8da-b013-4d0c-b5e9-b9431f944da3-metrics-certs podName:56e0a8da-b013-4d0c-b5e9-b9431f944da3 nodeName:}" failed. No retries permitted until 2026-07-02 20:32:43.642978036 +0000 UTC m=+2.095899115 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/56e0a8da-b013-4d0c-b5e9-b9431f944da3-metrics-certs") pod "network-metrics-daemon-ls998" (UID: "56e0a8da-b013-4d0c-b5e9-b9431f944da3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 20:32:43.143101 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.142941 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/cce9f678-db00-4f8d-bdaa-b2479796b62e-kubelet-config\") pod \"global-pull-secret-syncer-6r6ph\" (UID: \"cce9f678-db00-4f8d-bdaa-b2479796b62e\") " pod="kube-system/global-pull-secret-syncer-6r6ph" Jul 02 20:32:43.143101 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.142863 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-host-run-netns\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.143101 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.142933 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/02a28c36-499c-40df-92ac-4cf4b1222c70-os-release\") pod \"multus-additional-cni-plugins-xkk7n\" (UID: \"02a28c36-499c-40df-92ac-4cf4b1222c70\") " pod="openshift-multus/multus-additional-cni-plugins-xkk7n" Jul 02 20:32:43.143101 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.143027 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/131eba4c-85f0-47e1-8c22-28eff5d0d06e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jlrcv\" (UID: \"131eba4c-85f0-47e1-8c22-28eff5d0d06e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jlrcv" Jul 02 20:32:43.143101 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.143057 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/56b04565-9e51-4bfe-bc36-4aa5864a9654-env-overrides\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.143101 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.143079 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/131eba4c-85f0-47e1-8c22-28eff5d0d06e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-jlrcv\" (UID: \"131eba4c-85f0-47e1-8c22-28eff5d0d06e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jlrcv" Jul 02 20:32:43.143101 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.143085 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/02a28c36-499c-40df-92ac-4cf4b1222c70-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xkk7n\" (UID: \"02a28c36-499c-40df-92ac-4cf4b1222c70\") " pod="openshift-multus/multus-additional-cni-plugins-xkk7n" Jul 02 20:32:43.143611 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.143128 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/56b04565-9e51-4bfe-bc36-4aa5864a9654-ovn-node-metrics-cert\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.143611 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.143154 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/56b04565-9e51-4bfe-bc36-4aa5864a9654-ovnkube-script-lib\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.143611 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.143179 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/02a28c36-499c-40df-92ac-4cf4b1222c70-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xkk7n\" (UID: \"02a28c36-499c-40df-92ac-4cf4b1222c70\") " pod="openshift-multus/multus-additional-cni-plugins-xkk7n" Jul 02 20:32:43.143611 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.143204 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-systemd-units\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.143611 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.143237 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-host-cni-netd\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.143611 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.143261 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-etc-kubernetes\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.143611 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.143287 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/02a28c36-499c-40df-92ac-4cf4b1222c70-cnibin\") pod \"multus-additional-cni-plugins-xkk7n\" (UID: \"02a28c36-499c-40df-92ac-4cf4b1222c70\") " pod="openshift-multus/multus-additional-cni-plugins-xkk7n" Jul 02 20:32:43.143611 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.143313 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/131eba4c-85f0-47e1-8c22-28eff5d0d06e-device-dir\") pod \"aws-ebs-csi-driver-node-jlrcv\" (UID: \"131eba4c-85f0-47e1-8c22-28eff5d0d06e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jlrcv" Jul 02 20:32:43.143611 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.143338 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/131eba4c-85f0-47e1-8c22-28eff5d0d06e-sys-fs\") pod \"aws-ebs-csi-driver-node-jlrcv\" (UID: \"131eba4c-85f0-47e1-8c22-28eff5d0d06e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jlrcv" Jul 02 20:32:43.143611 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.143362 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4q8p\" (UniqueName: \"kubernetes.io/projected/56b04565-9e51-4bfe-bc36-4aa5864a9654-kube-api-access-j4q8p\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.143611 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.143384 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-multus-cni-dir\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.143611 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.143412 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/061a3e0f-48fe-4a8f-8b89-d0931f9e404d-agent-certs\") pod \"konnectivity-agent-tnmd2\" (UID: \"061a3e0f-48fe-4a8f-8b89-d0931f9e404d\") " pod="kube-system/konnectivity-agent-tnmd2" Jul 02 20:32:43.143611 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.143442 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f642606-1324-47e9-a987-6007d50f7707-tmp-dir\") pod \"node-resolver-hlj5p\" (UID: \"2f642606-1324-47e9-a987-6007d50f7707\") " pod="openshift-dns/node-resolver-hlj5p" Jul 02 20:32:43.143611 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.143468 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8gxng\" (UniqueName: \"kubernetes.io/projected/2f642606-1324-47e9-a987-6007d50f7707-kube-api-access-8gxng\") pod \"node-resolver-hlj5p\" (UID: \"2f642606-1324-47e9-a987-6007d50f7707\") " pod="openshift-dns/node-resolver-hlj5p" Jul 02 20:32:43.144307 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.143494 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzfhd\" (UniqueName: \"kubernetes.io/projected/7c9eafd9-a647-4969-9f9b-ba66b6da5c10-kube-api-access-xzfhd\") pod \"iptables-alerter-nc8b6\" (UID: \"7c9eafd9-a647-4969-9f9b-ba66b6da5c10\") " pod="openshift-network-operator/iptables-alerter-nc8b6" Jul 02 20:32:43.144307 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.143517 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2d608d9c-dccd-4a18-bc1f-b33258ff0874-multus-daemon-config\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.144307 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.143523 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cce9f678-db00-4f8d-bdaa-b2479796b62e-original-pull-secret\") pod \"global-pull-secret-syncer-6r6ph\" (UID: \"cce9f678-db00-4f8d-bdaa-b2479796b62e\") " pod="kube-system/global-pull-secret-syncer-6r6ph" Jul 02 20:32:43.144307 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.143522 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/7c9eafd9-a647-4969-9f9b-ba66b6da5c10-iptables-alerter-script\") pod \"iptables-alerter-nc8b6\" (UID: \"7c9eafd9-a647-4969-9f9b-ba66b6da5c10\") " pod="openshift-network-operator/iptables-alerter-nc8b6" Jul 02 20:32:43.144307 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.143545 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/56b04565-9e51-4bfe-bc36-4aa5864a9654-env-overrides\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.144307 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.143579 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-run-systemd\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.144307 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.143735 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-host-var-lib-cni-bin\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.144307 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.143768 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/131eba4c-85f0-47e1-8c22-28eff5d0d06e-socket-dir\") pod \"aws-ebs-csi-driver-node-jlrcv\" (UID: \"131eba4c-85f0-47e1-8c22-28eff5d0d06e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jlrcv" Jul 02 20:32:43.144307 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.143813 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-os-release\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.144307 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.143820 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-etc-kubernetes\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.144307 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.143683 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-multus-cni-dir\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.144307 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:43.143620 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 20:32:43.144307 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.143841 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/56b04565-9e51-4bfe-bc36-4aa5864a9654-ovnkube-script-lib\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.144307 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.143584 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/02a28c36-499c-40df-92ac-4cf4b1222c70-cnibin\") pod \"multus-additional-cni-plugins-xkk7n\" (UID: \"02a28c36-499c-40df-92ac-4cf4b1222c70\") " pod="openshift-multus/multus-additional-cni-plugins-xkk7n" Jul 02 20:32:43.144307 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.143654 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-systemd-units\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.145067 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.143886 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-host-cni-netd\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.145067 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.143934 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-host-var-lib-cni-bin\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.145067 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.143936 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27c24\" (UniqueName: \"kubernetes.io/projected/2d608d9c-dccd-4a18-bc1f-b33258ff0874-kube-api-access-27c24\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.145067 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.143951 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-os-release\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.145067 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:43.144018 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cce9f678-db00-4f8d-bdaa-b2479796b62e-original-pull-secret podName:cce9f678-db00-4f8d-bdaa-b2479796b62e nodeName:}" failed. No retries permitted until 2026-07-02 20:32:43.644000216 +0000 UTC m=+2.096921296 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cce9f678-db00-4f8d-bdaa-b2479796b62e-original-pull-secret") pod "global-pull-secret-syncer-6r6ph" (UID: "cce9f678-db00-4f8d-bdaa-b2479796b62e") : object "kube-system"/"original-pull-secret" not registered Jul 02 20:32:43.145067 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144042 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02a28c36-499c-40df-92ac-4cf4b1222c70-system-cni-dir\") pod \"multus-additional-cni-plugins-xkk7n\" (UID: \"02a28c36-499c-40df-92ac-4cf4b1222c70\") " pod="openshift-multus/multus-additional-cni-plugins-xkk7n" Jul 02 20:32:43.145067 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144070 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/131eba4c-85f0-47e1-8c22-28eff5d0d06e-sys-fs\") pod \"aws-ebs-csi-driver-node-jlrcv\" (UID: \"131eba4c-85f0-47e1-8c22-28eff5d0d06e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jlrcv" Jul 02 20:32:43.145067 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144073 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/02a28c36-499c-40df-92ac-4cf4b1222c70-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xkk7n\" (UID: \"02a28c36-499c-40df-92ac-4cf4b1222c70\") " pod="openshift-multus/multus-additional-cni-plugins-xkk7n" Jul 02 20:32:43.145067 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144108 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/131eba4c-85f0-47e1-8c22-28eff5d0d06e-registration-dir\") pod \"aws-ebs-csi-driver-node-jlrcv\" (UID: \"131eba4c-85f0-47e1-8c22-28eff5d0d06e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jlrcv" Jul 02 20:32:43.145067 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144128 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnxbt\" (UniqueName: \"kubernetes.io/projected/131eba4c-85f0-47e1-8c22-28eff5d0d06e-kube-api-access-bnxbt\") pod \"aws-ebs-csi-driver-node-jlrcv\" (UID: \"131eba4c-85f0-47e1-8c22-28eff5d0d06e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jlrcv" Jul 02 20:32:43.145067 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144155 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-host-run-ovn-kubernetes\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.145067 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144154 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/2f642606-1324-47e9-a987-6007d50f7707-tmp-dir\") pod \"node-resolver-hlj5p\" (UID: \"2f642606-1324-47e9-a987-6007d50f7707\") " pod="openshift-dns/node-resolver-hlj5p" Jul 02 20:32:43.145067 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144181 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-host-cni-bin\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.145730 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144208 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.145730 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144237 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zckjl\" (UniqueName: \"kubernetes.io/projected/02a28c36-499c-40df-92ac-4cf4b1222c70-kube-api-access-zckjl\") pod \"multus-additional-cni-plugins-xkk7n\" (UID: \"02a28c36-499c-40df-92ac-4cf4b1222c70\") " pod="openshift-multus/multus-additional-cni-plugins-xkk7n" Jul 02 20:32:43.145730 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144253 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/02a28c36-499c-40df-92ac-4cf4b1222c70-tuning-conf-dir\") pod \"multus-additional-cni-plugins-xkk7n\" (UID: \"02a28c36-499c-40df-92ac-4cf4b1222c70\") " pod="openshift-multus/multus-additional-cni-plugins-xkk7n" Jul 02 20:32:43.145730 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144263 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cce9f678-db00-4f8d-bdaa-b2479796b62e-dbus\") pod \"global-pull-secret-syncer-6r6ph\" (UID: \"cce9f678-db00-4f8d-bdaa-b2479796b62e\") " pod="kube-system/global-pull-secret-syncer-6r6ph" Jul 02 20:32:43.145730 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144288 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-host-kubelet\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.145730 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144312 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-etc-openvswitch\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.145730 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144338 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-multus-socket-dir-parent\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.145730 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144355 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/131eba4c-85f0-47e1-8c22-28eff5d0d06e-device-dir\") pod \"aws-ebs-csi-driver-node-jlrcv\" (UID: \"131eba4c-85f0-47e1-8c22-28eff5d0d06e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jlrcv" Jul 02 20:32:43.145730 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144367 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-hostroot\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.145730 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144395 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-multus-conf-dir\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.145730 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144400 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-run-systemd\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.145730 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144402 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/131eba4c-85f0-47e1-8c22-28eff5d0d06e-socket-dir\") pod \"aws-ebs-csi-driver-node-jlrcv\" (UID: \"131eba4c-85f0-47e1-8c22-28eff5d0d06e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jlrcv" Jul 02 20:32:43.145730 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144425 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/02a28c36-499c-40df-92ac-4cf4b1222c70-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-xkk7n\" (UID: \"02a28c36-499c-40df-92ac-4cf4b1222c70\") " pod="openshift-multus/multus-additional-cni-plugins-xkk7n" Jul 02 20:32:43.145730 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144456 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-host-run-ovn-kubernetes\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.146273 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144471 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/131eba4c-85f0-47e1-8c22-28eff5d0d06e-registration-dir\") pod \"aws-ebs-csi-driver-node-jlrcv\" (UID: \"131eba4c-85f0-47e1-8c22-28eff5d0d06e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jlrcv" Jul 02 20:32:43.146273 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144484 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2f642606-1324-47e9-a987-6007d50f7707-hosts-file\") pod \"node-resolver-hlj5p\" (UID: \"2f642606-1324-47e9-a987-6007d50f7707\") " pod="openshift-dns/node-resolver-hlj5p" Jul 02 20:32:43.146273 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144486 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-multus-conf-dir\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.146273 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144500 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-host-cni-bin\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.146273 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144506 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.146273 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144314 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/02a28c36-499c-40df-92ac-4cf4b1222c70-system-cni-dir\") pod \"multus-additional-cni-plugins-xkk7n\" (UID: \"02a28c36-499c-40df-92ac-4cf4b1222c70\") " pod="openshift-multus/multus-additional-cni-plugins-xkk7n" Jul 02 20:32:43.146273 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144433 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/2f642606-1324-47e9-a987-6007d50f7707-hosts-file\") pod \"node-resolver-hlj5p\" (UID: \"2f642606-1324-47e9-a987-6007d50f7707\") " pod="openshift-dns/node-resolver-hlj5p" Jul 02 20:32:43.146273 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144549 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/02a28c36-499c-40df-92ac-4cf4b1222c70-cni-binary-copy\") pod \"multus-additional-cni-plugins-xkk7n\" (UID: \"02a28c36-499c-40df-92ac-4cf4b1222c70\") " pod="openshift-multus/multus-additional-cni-plugins-xkk7n" Jul 02 20:32:43.146273 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144555 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-etc-openvswitch\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.146273 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144560 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-hostroot\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.146273 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144580 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-run-openvswitch\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.146273 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144608 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-host-kubelet\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.146273 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144617 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/cce9f678-db00-4f8d-bdaa-b2479796b62e-dbus\") pod \"global-pull-secret-syncer-6r6ph\" (UID: \"cce9f678-db00-4f8d-bdaa-b2479796b62e\") " pod="kube-system/global-pull-secret-syncer-6r6ph" Jul 02 20:32:43.146273 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144610 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/131eba4c-85f0-47e1-8c22-28eff5d0d06e-etc-selinux\") pod \"aws-ebs-csi-driver-node-jlrcv\" (UID: \"131eba4c-85f0-47e1-8c22-28eff5d0d06e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jlrcv" Jul 02 20:32:43.146273 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144660 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-multus-socket-dir-parent\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.146702 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144661 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-host-slash\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.146702 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144692 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-var-lib-openvswitch\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.146702 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144695 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-host-slash\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.146702 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144703 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/131eba4c-85f0-47e1-8c22-28eff5d0d06e-etc-selinux\") pod \"aws-ebs-csi-driver-node-jlrcv\" (UID: \"131eba4c-85f0-47e1-8c22-28eff5d0d06e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jlrcv" Jul 02 20:32:43.146702 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144720 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/56b04565-9e51-4bfe-bc36-4aa5864a9654-ovnkube-config\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.146702 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144747 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-system-cni-dir\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.146702 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144753 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-var-lib-openvswitch\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.146702 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144794 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-system-cni-dir\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.146702 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144801 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/02a28c36-499c-40df-92ac-4cf4b1222c70-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-xkk7n\" (UID: \"02a28c36-499c-40df-92ac-4cf4b1222c70\") " pod="openshift-multus/multus-additional-cni-plugins-xkk7n" Jul 02 20:32:43.146702 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144886 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-run-openvswitch\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.146702 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144915 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-log-socket\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.146702 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144941 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2d608d9c-dccd-4a18-bc1f-b33258ff0874-cni-binary-copy\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.146702 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144968 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-host-run-k8s-cni-cncf-io\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.146702 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144991 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-log-socket\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.146702 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.144993 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-host-run-multus-certs\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.147156 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.145028 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-host-run-multus-certs\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.147156 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.145063 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-host-run-k8s-cni-cncf-io\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.147156 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.145064 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k8qr\" (UniqueName: \"kubernetes.io/projected/56e0a8da-b013-4d0c-b5e9-b9431f944da3-kube-api-access-2k8qr\") pod \"network-metrics-daemon-ls998\" (UID: \"56e0a8da-b013-4d0c-b5e9-b9431f944da3\") " pod="openshift-multus/network-metrics-daemon-ls998" Jul 02 20:32:43.147156 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.145142 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-run-ovn\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.147156 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.145140 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/02a28c36-499c-40df-92ac-4cf4b1222c70-cni-binary-copy\") pod \"multus-additional-cni-plugins-xkk7n\" (UID: \"02a28c36-499c-40df-92ac-4cf4b1222c70\") " pod="openshift-multus/multus-additional-cni-plugins-xkk7n" Jul 02 20:32:43.147156 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.145189 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-run-ovn\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.147156 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.145226 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-host-var-lib-cni-multus\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.147156 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.145257 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c9eafd9-a647-4969-9f9b-ba66b6da5c10-host-slash\") pod \"iptables-alerter-nc8b6\" (UID: \"7c9eafd9-a647-4969-9f9b-ba66b6da5c10\") " pod="openshift-network-operator/iptables-alerter-nc8b6" Jul 02 20:32:43.147156 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.145274 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/56b04565-9e51-4bfe-bc36-4aa5864a9654-ovnkube-config\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.147156 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.145282 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-cnibin\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.147156 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.145282 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-host-var-lib-cni-multus\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.147156 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.145309 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-host-var-lib-kubelet\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.147156 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.145322 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/7c9eafd9-a647-4969-9f9b-ba66b6da5c10-host-slash\") pod \"iptables-alerter-nc8b6\" (UID: \"7c9eafd9-a647-4969-9f9b-ba66b6da5c10\") " pod="openshift-network-operator/iptables-alerter-nc8b6" Jul 02 20:32:43.147156 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.145335 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/061a3e0f-48fe-4a8f-8b89-d0931f9e404d-konnectivity-ca\") pod \"konnectivity-agent-tnmd2\" (UID: \"061a3e0f-48fe-4a8f-8b89-d0931f9e404d\") " pod="kube-system/konnectivity-agent-tnmd2" Jul 02 20:32:43.147156 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.145346 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-cnibin\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.147591 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.145379 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2d608d9c-dccd-4a18-bc1f-b33258ff0874-host-var-lib-kubelet\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.147591 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.145381 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-host-run-netns\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.147591 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.145417 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56b04565-9e51-4bfe-bc36-4aa5864a9654-host-run-netns\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.147591 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.145547 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2d608d9c-dccd-4a18-bc1f-b33258ff0874-cni-binary-copy\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.147591 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.145916 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/061a3e0f-48fe-4a8f-8b89-d0931f9e404d-konnectivity-ca\") pod \"konnectivity-agent-tnmd2\" (UID: \"061a3e0f-48fe-4a8f-8b89-d0931f9e404d\") " pod="kube-system/konnectivity-agent-tnmd2" Jul 02 20:32:43.147591 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.145959 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/56b04565-9e51-4bfe-bc36-4aa5864a9654-ovn-node-metrics-cert\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.147591 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.146167 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/061a3e0f-48fe-4a8f-8b89-d0931f9e404d-agent-certs\") pod \"konnectivity-agent-tnmd2\" (UID: \"061a3e0f-48fe-4a8f-8b89-d0931f9e404d\") " pod="kube-system/konnectivity-agent-tnmd2" Jul 02 20:32:43.156613 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.156586 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zckjl\" (UniqueName: \"kubernetes.io/projected/02a28c36-499c-40df-92ac-4cf4b1222c70-kube-api-access-zckjl\") pod \"multus-additional-cni-plugins-xkk7n\" (UID: \"02a28c36-499c-40df-92ac-4cf4b1222c70\") " pod="openshift-multus/multus-additional-cni-plugins-xkk7n" Jul 02 20:32:43.156845 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.156823 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8gxng\" (UniqueName: \"kubernetes.io/projected/2f642606-1324-47e9-a987-6007d50f7707-kube-api-access-8gxng\") pod \"node-resolver-hlj5p\" (UID: \"2f642606-1324-47e9-a987-6007d50f7707\") " pod="openshift-dns/node-resolver-hlj5p" Jul 02 20:32:43.156903 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.156882 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k8qr\" (UniqueName: \"kubernetes.io/projected/56e0a8da-b013-4d0c-b5e9-b9431f944da3-kube-api-access-2k8qr\") pod \"network-metrics-daemon-ls998\" (UID: \"56e0a8da-b013-4d0c-b5e9-b9431f944da3\") " pod="openshift-multus/network-metrics-daemon-ls998" Jul 02 20:32:43.157378 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.157352 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzfhd\" (UniqueName: \"kubernetes.io/projected/7c9eafd9-a647-4969-9f9b-ba66b6da5c10-kube-api-access-xzfhd\") pod \"iptables-alerter-nc8b6\" (UID: \"7c9eafd9-a647-4969-9f9b-ba66b6da5c10\") " pod="openshift-network-operator/iptables-alerter-nc8b6" Jul 02 20:32:43.157378 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.157372 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27c24\" (UniqueName: \"kubernetes.io/projected/2d608d9c-dccd-4a18-bc1f-b33258ff0874-kube-api-access-27c24\") pod \"multus-n9rd8\" (UID: \"2d608d9c-dccd-4a18-bc1f-b33258ff0874\") " pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.157539 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.157521 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnxbt\" (UniqueName: \"kubernetes.io/projected/131eba4c-85f0-47e1-8c22-28eff5d0d06e-kube-api-access-bnxbt\") pod \"aws-ebs-csi-driver-node-jlrcv\" (UID: \"131eba4c-85f0-47e1-8c22-28eff5d0d06e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jlrcv" Jul 02 20:32:43.157690 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.157675 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4q8p\" (UniqueName: \"kubernetes.io/projected/56b04565-9e51-4bfe-bc36-4aa5864a9654-kube-api-access-j4q8p\") pod \"ovnkube-node-mmgwl\" (UID: \"56b04565-9e51-4bfe-bc36-4aa5864a9654\") " pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.211156 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.211101 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m678g" Jul 02 20:32:43.227727 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.227705 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q8p8n" Jul 02 20:32:43.234609 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.234592 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:32:43.236837 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.236787 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 20:27:42 +0000 UTC" deadline="2028-01-03 05:25:08.63341276 +0000 UTC" Jul 02 20:32:43.236837 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.236834 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13184h52m25.396581268s" Jul 02 20:32:43.260169 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.260147 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-hlj5p" Jul 02 20:32:43.266799 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.266783 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-xkk7n" Jul 02 20:32:43.281894 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.281876 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n9rd8" Jul 02 20:32:43.293408 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.293386 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-nc8b6" Jul 02 20:32:43.293477 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.293440 2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 20:32:43.299570 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.299553 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-tnmd2" Jul 02 20:32:43.304038 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.304021 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jlrcv" Jul 02 20:32:43.463693 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:43.463628 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e15b28acdfde5fc6df129862ecf92ac.slice/crio-6b2d35ca17c1ba1b71bbe55247d9e979270d4c55d9ce24b181dba4257c09ce45 WatchSource:0}: Error finding container 6b2d35ca17c1ba1b71bbe55247d9e979270d4c55d9ce24b181dba4257c09ce45: Status 404 returned error can't find the container with id 6b2d35ca17c1ba1b71bbe55247d9e979270d4c55d9ce24b181dba4257c09ce45 Jul 02 20:32:43.464153 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:43.464135 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3daa949ad2399aa2ae00a9f45c827ee.slice/crio-6655edd3b0a04799b6dd98b2669aee3623294eca3b87c4fd9e7d3b9a653be322 WatchSource:0}: Error finding container 6655edd3b0a04799b6dd98b2669aee3623294eca3b87c4fd9e7d3b9a653be322: Status 404 returned error can't find the container with id 6655edd3b0a04799b6dd98b2669aee3623294eca3b87c4fd9e7d3b9a653be322 Jul 02 20:32:43.469464 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.469450 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 20:32:43.612508 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:43.612485 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7d5983b_3afb_4507_abeb_871f909d6414.slice/crio-2d06eab272a539da0d3c694f3aa5c2bff927af1028c0a6f17bc881ad87ec9910 WatchSource:0}: Error finding container 2d06eab272a539da0d3c694f3aa5c2bff927af1028c0a6f17bc881ad87ec9910: Status 404 returned error can't find the container with id 2d06eab272a539da0d3c694f3aa5c2bff927af1028c0a6f17bc881ad87ec9910 Jul 02 20:32:43.650635 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.650608 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56e0a8da-b013-4d0c-b5e9-b9431f944da3-metrics-certs\") pod \"network-metrics-daemon-ls998\" (UID: \"56e0a8da-b013-4d0c-b5e9-b9431f944da3\") " pod="openshift-multus/network-metrics-daemon-ls998" Jul 02 20:32:43.650727 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.650637 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6n6n\" (UniqueName: \"kubernetes.io/projected/d5984f1f-3f02-4ab7-b9b9-7e203a87ea34-kube-api-access-h6n6n\") pod \"network-check-target-65xk9\" (UID: \"d5984f1f-3f02-4ab7-b9b9-7e203a87ea34\") " pod="openshift-network-diagnostics/network-check-target-65xk9" Jul 02 20:32:43.650727 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.650662 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cce9f678-db00-4f8d-bdaa-b2479796b62e-original-pull-secret\") pod \"global-pull-secret-syncer-6r6ph\" (UID: \"cce9f678-db00-4f8d-bdaa-b2479796b62e\") " pod="kube-system/global-pull-secret-syncer-6r6ph" Jul 02 20:32:43.650799 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:43.650763 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 20:32:43.650799 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:43.650765 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 20:32:43.650881 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:43.650808 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cce9f678-db00-4f8d-bdaa-b2479796b62e-original-pull-secret podName:cce9f678-db00-4f8d-bdaa-b2479796b62e nodeName:}" failed. No retries permitted until 2026-07-02 20:32:44.650789439 +0000 UTC m=+3.103710520 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cce9f678-db00-4f8d-bdaa-b2479796b62e-original-pull-secret") pod "global-pull-secret-syncer-6r6ph" (UID: "cce9f678-db00-4f8d-bdaa-b2479796b62e") : object "kube-system"/"original-pull-secret" not registered Jul 02 20:32:43.650881 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:43.650823 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56e0a8da-b013-4d0c-b5e9-b9431f944da3-metrics-certs podName:56e0a8da-b013-4d0c-b5e9-b9431f944da3 nodeName:}" failed. No retries permitted until 2026-07-02 20:32:44.650816134 +0000 UTC m=+3.103737212 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/56e0a8da-b013-4d0c-b5e9-b9431f944da3-metrics-certs") pod "network-metrics-daemon-ls998" (UID: "56e0a8da-b013-4d0c-b5e9-b9431f944da3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 20:32:43.650881 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:43.650827 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 20:32:43.650881 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:43.650843 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 20:32:43.650881 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:43.650867 2568 projected.go:196] Error preparing data for projected volume kube-api-access-h6n6n for pod openshift-network-diagnostics/network-check-target-65xk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 20:32:43.651055 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:43.650917 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5984f1f-3f02-4ab7-b9b9-7e203a87ea34-kube-api-access-h6n6n podName:d5984f1f-3f02-4ab7-b9b9-7e203a87ea34 nodeName:}" failed. No retries permitted until 2026-07-02 20:32:44.650901828 +0000 UTC m=+3.103822906 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-h6n6n" (UniqueName: "kubernetes.io/projected/d5984f1f-3f02-4ab7-b9b9-7e203a87ea34-kube-api-access-h6n6n") pod "network-check-target-65xk9" (UID: "d5984f1f-3f02-4ab7-b9b9-7e203a87ea34") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 20:32:43.725556 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:43.725532 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a31ac7c_eb80_40a5_ba12_098835ab593a.slice/crio-bcba9f1994c287926ea8991f97efa5c9846aa325e49caeefcfc628876fc73812 WatchSource:0}: Error finding container bcba9f1994c287926ea8991f97efa5c9846aa325e49caeefcfc628876fc73812: Status 404 returned error can't find the container with id bcba9f1994c287926ea8991f97efa5c9846aa325e49caeefcfc628876fc73812 Jul 02 20:32:43.725987 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.725969 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 20:32:43.733060 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:43.733023 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c9eafd9_a647_4969_9f9b_ba66b6da5c10.slice/crio-bdd26912fd876345cff6fa7ed3d480d4c5d19e35f1f726cdcbb7fbf13b7511cd WatchSource:0}: Error finding container bdd26912fd876345cff6fa7ed3d480d4c5d19e35f1f726cdcbb7fbf13b7511cd: Status 404 returned error can't find the container with id bdd26912fd876345cff6fa7ed3d480d4c5d19e35f1f726cdcbb7fbf13b7511cd Jul 02 20:32:43.733508 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:43.733484 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod061a3e0f_48fe_4a8f_8b89_d0931f9e404d.slice/crio-c7f5a4e89be65d0e4376d1fb877e7570c6dd82cd7499e724fe57f2d02d0af3af WatchSource:0}: Error finding container c7f5a4e89be65d0e4376d1fb877e7570c6dd82cd7499e724fe57f2d02d0af3af: Status 404 returned error can't find the container with id c7f5a4e89be65d0e4376d1fb877e7570c6dd82cd7499e724fe57f2d02d0af3af Jul 02 20:32:43.774469 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:43.774450 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d608d9c_dccd_4a18_bc1f_b33258ff0874.slice/crio-82b749e0812203a2c46bc763502510b195dffd90cf1f04318296a7bc93f5d0db WatchSource:0}: Error finding container 82b749e0812203a2c46bc763502510b195dffd90cf1f04318296a7bc93f5d0db: Status 404 returned error can't find the container with id 82b749e0812203a2c46bc763502510b195dffd90cf1f04318296a7bc93f5d0db Jul 02 20:32:43.775176 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:43.775158 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod131eba4c_85f0_47e1_8c22_28eff5d0d06e.slice/crio-8591534f2c1f5c0322e0c3499f1cc822dad944dace42be182fc4b86d0001b026 WatchSource:0}: Error finding container 8591534f2c1f5c0322e0c3499f1cc822dad944dace42be182fc4b86d0001b026: Status 404 returned error can't find the container with id 8591534f2c1f5c0322e0c3499f1cc822dad944dace42be182fc4b86d0001b026 Jul 02 20:32:43.821897 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:43.821876 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02a28c36_499c_40df_92ac_4cf4b1222c70.slice/crio-9c2043871b8fe5d8afecc5009c87edd930a499d2f7c2efa6ebe7f26cd388d2da WatchSource:0}: Error finding container 9c2043871b8fe5d8afecc5009c87edd930a499d2f7c2efa6ebe7f26cd388d2da: Status 404 returned error can't find the container with id 9c2043871b8fe5d8afecc5009c87edd930a499d2f7c2efa6ebe7f26cd388d2da Jul 02 20:32:43.925967 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.925938 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 20:27:43 +0000 UTC" deadline="2028-03-04 19:40:14.784151808 +0000 UTC" Jul 02 20:32:43.925967 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:43.925962 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14663h7m30.858192459s" Jul 02 20:32:43.944312 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:43.944293 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f642606_1324_47e9_a987_6007d50f7707.slice/crio-c6f3b5fd4db33e97597c010a90509a15ee410841396657a7877c0c1a7aae2187 WatchSource:0}: Error finding container c6f3b5fd4db33e97597c010a90509a15ee410841396657a7877c0c1a7aae2187: Status 404 returned error can't find the container with id c6f3b5fd4db33e97597c010a90509a15ee410841396657a7877c0c1a7aae2187 Jul 02 20:32:43.995646 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:32:43.995627 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56b04565_9e51_4bfe_bc36_4aa5864a9654.slice/crio-f630526c29cc7a2e2a99734b1b3a854a1fbc65a75467393d68021f13699d5dcd WatchSource:0}: Error finding container f630526c29cc7a2e2a99734b1b3a854a1fbc65a75467393d68021f13699d5dcd: Status 404 returned error can't find the container with id f630526c29cc7a2e2a99734b1b3a854a1fbc65a75467393d68021f13699d5dcd Jul 02 20:32:44.359837 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:44.359751 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls998" Jul 02 20:32:44.360017 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:44.359901 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ls998" podUID="56e0a8da-b013-4d0c-b5e9-b9431f944da3" Jul 02 20:32:44.360085 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:44.360015 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65xk9" Jul 02 20:32:44.360144 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:44.360092 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65xk9" podUID="d5984f1f-3f02-4ab7-b9b9-7e203a87ea34" Jul 02 20:32:44.360209 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:44.360154 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6r6ph" Jul 02 20:32:44.360260 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:44.360228 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6r6ph" podUID="cce9f678-db00-4f8d-bdaa-b2479796b62e" Jul 02 20:32:44.376315 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:44.376226 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n9rd8" event={"ID":"2d608d9c-dccd-4a18-bc1f-b33258ff0874","Type":"ContainerStarted","Data":"82b749e0812203a2c46bc763502510b195dffd90cf1f04318296a7bc93f5d0db"} Jul 02 20:32:44.398733 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:44.398650 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m678g" event={"ID":"6a31ac7c-eb80-40a5-ba12-098835ab593a","Type":"ContainerStarted","Data":"bcba9f1994c287926ea8991f97efa5c9846aa325e49caeefcfc628876fc73812"} Jul 02 20:32:44.405496 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:44.405398 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hlj5p" event={"ID":"2f642606-1324-47e9-a987-6007d50f7707","Type":"ContainerStarted","Data":"c6f3b5fd4db33e97597c010a90509a15ee410841396657a7877c0c1a7aae2187"} Jul 02 20:32:44.422189 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:44.422159 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xkk7n" event={"ID":"02a28c36-499c-40df-92ac-4cf4b1222c70","Type":"ContainerStarted","Data":"9c2043871b8fe5d8afecc5009c87edd930a499d2f7c2efa6ebe7f26cd388d2da"} Jul 02 20:32:44.428287 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:44.428212 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jlrcv" event={"ID":"131eba4c-85f0-47e1-8c22-28eff5d0d06e","Type":"ContainerStarted","Data":"8591534f2c1f5c0322e0c3499f1cc822dad944dace42be182fc4b86d0001b026"} Jul 02 20:32:44.433969 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:44.433941 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tnmd2" event={"ID":"061a3e0f-48fe-4a8f-8b89-d0931f9e404d","Type":"ContainerStarted","Data":"c7f5a4e89be65d0e4376d1fb877e7570c6dd82cd7499e724fe57f2d02d0af3af"} Jul 02 20:32:44.459928 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:44.459876 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nc8b6" event={"ID":"7c9eafd9-a647-4969-9f9b-ba66b6da5c10","Type":"ContainerStarted","Data":"bdd26912fd876345cff6fa7ed3d480d4c5d19e35f1f726cdcbb7fbf13b7511cd"} Jul 02 20:32:44.466272 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:44.466246 2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 20:32:44.472039 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:44.471966 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q8p8n" event={"ID":"b7d5983b-3afb-4507-abeb-871f909d6414","Type":"ContainerStarted","Data":"2d06eab272a539da0d3c694f3aa5c2bff927af1028c0a6f17bc881ad87ec9910"} Jul 02 20:32:44.475353 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:44.475326 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" event={"ID":"2e15b28acdfde5fc6df129862ecf92ac","Type":"ContainerStarted","Data":"6b2d35ca17c1ba1b71bbe55247d9e979270d4c55d9ce24b181dba4257c09ce45"} Jul 02 20:32:44.489058 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:44.489035 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-144.ec2.internal" event={"ID":"a3daa949ad2399aa2ae00a9f45c827ee","Type":"ContainerStarted","Data":"6655edd3b0a04799b6dd98b2669aee3623294eca3b87c4fd9e7d3b9a653be322"} Jul 02 20:32:44.501036 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:44.501010 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" event={"ID":"56b04565-9e51-4bfe-bc36-4aa5864a9654","Type":"ContainerStarted","Data":"f630526c29cc7a2e2a99734b1b3a854a1fbc65a75467393d68021f13699d5dcd"} Jul 02 20:32:44.664138 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:44.664054 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cce9f678-db00-4f8d-bdaa-b2479796b62e-original-pull-secret\") pod \"global-pull-secret-syncer-6r6ph\" (UID: \"cce9f678-db00-4f8d-bdaa-b2479796b62e\") " pod="kube-system/global-pull-secret-syncer-6r6ph" Jul 02 20:32:44.664315 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:44.664145 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56e0a8da-b013-4d0c-b5e9-b9431f944da3-metrics-certs\") pod \"network-metrics-daemon-ls998\" (UID: \"56e0a8da-b013-4d0c-b5e9-b9431f944da3\") " pod="openshift-multus/network-metrics-daemon-ls998" Jul 02 20:32:44.664315 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:44.664176 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6n6n\" (UniqueName: \"kubernetes.io/projected/d5984f1f-3f02-4ab7-b9b9-7e203a87ea34-kube-api-access-h6n6n\") pod \"network-check-target-65xk9\" (UID: \"d5984f1f-3f02-4ab7-b9b9-7e203a87ea34\") " pod="openshift-network-diagnostics/network-check-target-65xk9" Jul 02 20:32:44.664439 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:44.664321 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 20:32:44.664439 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:44.664342 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 20:32:44.664439 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:44.664355 2568 projected.go:196] Error preparing data for projected volume kube-api-access-h6n6n for pod openshift-network-diagnostics/network-check-target-65xk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 20:32:44.664439 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:44.664413 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5984f1f-3f02-4ab7-b9b9-7e203a87ea34-kube-api-access-h6n6n podName:d5984f1f-3f02-4ab7-b9b9-7e203a87ea34 nodeName:}" failed. No retries permitted until 2026-07-02 20:32:46.66439456 +0000 UTC m=+5.117315652 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-h6n6n" (UniqueName: "kubernetes.io/projected/d5984f1f-3f02-4ab7-b9b9-7e203a87ea34-kube-api-access-h6n6n") pod "network-check-target-65xk9" (UID: "d5984f1f-3f02-4ab7-b9b9-7e203a87ea34") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 20:32:44.664906 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:44.664885 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 20:32:44.665018 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:44.664966 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cce9f678-db00-4f8d-bdaa-b2479796b62e-original-pull-secret podName:cce9f678-db00-4f8d-bdaa-b2479796b62e nodeName:}" failed. No retries permitted until 2026-07-02 20:32:46.664945098 +0000 UTC m=+5.117866179 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cce9f678-db00-4f8d-bdaa-b2479796b62e-original-pull-secret") pod "global-pull-secret-syncer-6r6ph" (UID: "cce9f678-db00-4f8d-bdaa-b2479796b62e") : object "kube-system"/"original-pull-secret" not registered Jul 02 20:32:44.665088 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:44.665038 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 20:32:44.665088 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:44.665077 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56e0a8da-b013-4d0c-b5e9-b9431f944da3-metrics-certs podName:56e0a8da-b013-4d0c-b5e9-b9431f944da3 nodeName:}" failed. No retries permitted until 2026-07-02 20:32:46.665064222 +0000 UTC m=+5.117985316 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/56e0a8da-b013-4d0c-b5e9-b9431f944da3-metrics-certs") pod "network-metrics-daemon-ls998" (UID: "56e0a8da-b013-4d0c-b5e9-b9431f944da3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 20:32:44.926966 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:44.926826 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 20:27:43 +0000 UTC" deadline="2028-03-09 01:23:09.448466699 +0000 UTC" Jul 02 20:32:44.926966 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:44.926898 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14764h50m24.521573211s" Jul 02 20:32:46.359534 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:46.359452 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65xk9" Jul 02 20:32:46.360020 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:46.359593 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65xk9" podUID="d5984f1f-3f02-4ab7-b9b9-7e203a87ea34" Jul 02 20:32:46.360099 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:46.360056 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6r6ph" Jul 02 20:32:46.360180 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:46.360157 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6r6ph" podUID="cce9f678-db00-4f8d-bdaa-b2479796b62e" Jul 02 20:32:46.360244 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:46.360218 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls998" Jul 02 20:32:46.360324 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:46.360304 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ls998" podUID="56e0a8da-b013-4d0c-b5e9-b9431f944da3" Jul 02 20:32:46.682135 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:46.681035 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cce9f678-db00-4f8d-bdaa-b2479796b62e-original-pull-secret\") pod \"global-pull-secret-syncer-6r6ph\" (UID: \"cce9f678-db00-4f8d-bdaa-b2479796b62e\") " pod="kube-system/global-pull-secret-syncer-6r6ph" Jul 02 20:32:46.682135 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:46.681125 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56e0a8da-b013-4d0c-b5e9-b9431f944da3-metrics-certs\") pod \"network-metrics-daemon-ls998\" (UID: \"56e0a8da-b013-4d0c-b5e9-b9431f944da3\") " pod="openshift-multus/network-metrics-daemon-ls998" Jul 02 20:32:46.682135 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:46.681160 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6n6n\" (UniqueName: \"kubernetes.io/projected/d5984f1f-3f02-4ab7-b9b9-7e203a87ea34-kube-api-access-h6n6n\") pod \"network-check-target-65xk9\" (UID: \"d5984f1f-3f02-4ab7-b9b9-7e203a87ea34\") " pod="openshift-network-diagnostics/network-check-target-65xk9" Jul 02 20:32:46.682135 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:46.681315 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 20:32:46.682135 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:46.681333 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 20:32:46.682135 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:46.681348 2568 projected.go:196] Error preparing data for projected volume kube-api-access-h6n6n for pod openshift-network-diagnostics/network-check-target-65xk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 20:32:46.682135 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:46.681406 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5984f1f-3f02-4ab7-b9b9-7e203a87ea34-kube-api-access-h6n6n podName:d5984f1f-3f02-4ab7-b9b9-7e203a87ea34 nodeName:}" failed. No retries permitted until 2026-07-02 20:32:50.681386156 +0000 UTC m=+9.134307249 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-h6n6n" (UniqueName: "kubernetes.io/projected/d5984f1f-3f02-4ab7-b9b9-7e203a87ea34-kube-api-access-h6n6n") pod "network-check-target-65xk9" (UID: "d5984f1f-3f02-4ab7-b9b9-7e203a87ea34") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 20:32:46.682135 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:46.681835 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 20:32:46.682135 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:46.681906 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cce9f678-db00-4f8d-bdaa-b2479796b62e-original-pull-secret podName:cce9f678-db00-4f8d-bdaa-b2479796b62e nodeName:}" failed. No retries permitted until 2026-07-02 20:32:50.681886285 +0000 UTC m=+9.134807367 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cce9f678-db00-4f8d-bdaa-b2479796b62e-original-pull-secret") pod "global-pull-secret-syncer-6r6ph" (UID: "cce9f678-db00-4f8d-bdaa-b2479796b62e") : object "kube-system"/"original-pull-secret" not registered Jul 02 20:32:46.682135 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:46.681990 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 20:32:46.682135 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:46.682025 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56e0a8da-b013-4d0c-b5e9-b9431f944da3-metrics-certs podName:56e0a8da-b013-4d0c-b5e9-b9431f944da3 nodeName:}" failed. No retries permitted until 2026-07-02 20:32:50.682013283 +0000 UTC m=+9.134934363 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/56e0a8da-b013-4d0c-b5e9-b9431f944da3-metrics-certs") pod "network-metrics-daemon-ls998" (UID: "56e0a8da-b013-4d0c-b5e9-b9431f944da3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 20:32:48.357979 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:48.357918 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65xk9" Jul 02 20:32:48.358464 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:48.358100 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65xk9" podUID="d5984f1f-3f02-4ab7-b9b9-7e203a87ea34" Jul 02 20:32:48.358664 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:48.358642 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6r6ph" Jul 02 20:32:48.359624 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:48.358786 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6r6ph" podUID="cce9f678-db00-4f8d-bdaa-b2479796b62e" Jul 02 20:32:48.359624 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:48.358873 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls998" Jul 02 20:32:48.359624 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:48.359052 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ls998" podUID="56e0a8da-b013-4d0c-b5e9-b9431f944da3" Jul 02 20:32:50.359125 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:50.359046 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6r6ph" Jul 02 20:32:50.359580 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:50.359180 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6r6ph" podUID="cce9f678-db00-4f8d-bdaa-b2479796b62e" Jul 02 20:32:50.359580 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:50.359568 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls998" Jul 02 20:32:50.359698 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:50.359681 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ls998" podUID="56e0a8da-b013-4d0c-b5e9-b9431f944da3" Jul 02 20:32:50.359940 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:50.359866 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65xk9" Jul 02 20:32:50.360018 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:50.359973 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65xk9" podUID="d5984f1f-3f02-4ab7-b9b9-7e203a87ea34" Jul 02 20:32:50.717692 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:50.717650 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56e0a8da-b013-4d0c-b5e9-b9431f944da3-metrics-certs\") pod \"network-metrics-daemon-ls998\" (UID: \"56e0a8da-b013-4d0c-b5e9-b9431f944da3\") " pod="openshift-multus/network-metrics-daemon-ls998" Jul 02 20:32:50.717886 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:50.717709 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6n6n\" (UniqueName: \"kubernetes.io/projected/d5984f1f-3f02-4ab7-b9b9-7e203a87ea34-kube-api-access-h6n6n\") pod \"network-check-target-65xk9\" (UID: \"d5984f1f-3f02-4ab7-b9b9-7e203a87ea34\") " pod="openshift-network-diagnostics/network-check-target-65xk9" Jul 02 20:32:50.717886 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:50.717756 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cce9f678-db00-4f8d-bdaa-b2479796b62e-original-pull-secret\") pod \"global-pull-secret-syncer-6r6ph\" (UID: \"cce9f678-db00-4f8d-bdaa-b2479796b62e\") " pod="kube-system/global-pull-secret-syncer-6r6ph" Jul 02 20:32:50.717989 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:50.717939 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 20:32:50.718045 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:50.718010 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cce9f678-db00-4f8d-bdaa-b2479796b62e-original-pull-secret podName:cce9f678-db00-4f8d-bdaa-b2479796b62e nodeName:}" failed. No retries permitted until 2026-07-02 20:32:58.717989471 +0000 UTC m=+17.170910551 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cce9f678-db00-4f8d-bdaa-b2479796b62e-original-pull-secret") pod "global-pull-secret-syncer-6r6ph" (UID: "cce9f678-db00-4f8d-bdaa-b2479796b62e") : object "kube-system"/"original-pull-secret" not registered Jul 02 20:32:50.718361 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:50.718101 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 20:32:50.718361 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:50.718173 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56e0a8da-b013-4d0c-b5e9-b9431f944da3-metrics-certs podName:56e0a8da-b013-4d0c-b5e9-b9431f944da3 nodeName:}" failed. No retries permitted until 2026-07-02 20:32:58.718152998 +0000 UTC m=+17.171074087 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/56e0a8da-b013-4d0c-b5e9-b9431f944da3-metrics-certs") pod "network-metrics-daemon-ls998" (UID: "56e0a8da-b013-4d0c-b5e9-b9431f944da3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 20:32:50.718361 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:50.718265 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 20:32:50.718361 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:50.718280 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 20:32:50.718361 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:50.718295 2568 projected.go:196] Error preparing data for projected volume kube-api-access-h6n6n for pod openshift-network-diagnostics/network-check-target-65xk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 20:32:50.718361 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:50.718333 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5984f1f-3f02-4ab7-b9b9-7e203a87ea34-kube-api-access-h6n6n podName:d5984f1f-3f02-4ab7-b9b9-7e203a87ea34 nodeName:}" failed. No retries permitted until 2026-07-02 20:32:58.718319447 +0000 UTC m=+17.171240531 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-h6n6n" (UniqueName: "kubernetes.io/projected/d5984f1f-3f02-4ab7-b9b9-7e203a87ea34-kube-api-access-h6n6n") pod "network-check-target-65xk9" (UID: "d5984f1f-3f02-4ab7-b9b9-7e203a87ea34") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 20:32:52.359108 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:52.359064 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls998" Jul 02 20:32:52.359590 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:52.359190 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65xk9" Jul 02 20:32:52.359590 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:52.359198 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ls998" podUID="56e0a8da-b013-4d0c-b5e9-b9431f944da3" Jul 02 20:32:52.359590 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:52.359308 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65xk9" podUID="d5984f1f-3f02-4ab7-b9b9-7e203a87ea34" Jul 02 20:32:52.359590 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:52.359360 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6r6ph" Jul 02 20:32:52.359590 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:52.359444 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6r6ph" podUID="cce9f678-db00-4f8d-bdaa-b2479796b62e" Jul 02 20:32:54.358374 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:54.357823 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65xk9" Jul 02 20:32:54.358374 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:54.357975 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65xk9" podUID="d5984f1f-3f02-4ab7-b9b9-7e203a87ea34" Jul 02 20:32:54.358374 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:54.358037 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6r6ph" Jul 02 20:32:54.358374 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:54.358138 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6r6ph" podUID="cce9f678-db00-4f8d-bdaa-b2479796b62e" Jul 02 20:32:54.358374 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:54.358172 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls998" Jul 02 20:32:54.358374 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:54.358253 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ls998" podUID="56e0a8da-b013-4d0c-b5e9-b9431f944da3" Jul 02 20:32:56.357775 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:56.357534 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls998" Jul 02 20:32:56.358221 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:56.357534 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65xk9" Jul 02 20:32:56.358221 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:56.357832 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ls998" podUID="56e0a8da-b013-4d0c-b5e9-b9431f944da3" Jul 02 20:32:56.358221 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:56.357922 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65xk9" podUID="d5984f1f-3f02-4ab7-b9b9-7e203a87ea34" Jul 02 20:32:56.358221 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:56.357563 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6r6ph" Jul 02 20:32:56.358221 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:56.358016 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6r6ph" podUID="cce9f678-db00-4f8d-bdaa-b2479796b62e" Jul 02 20:32:58.357172 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:58.357126 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65xk9" Jul 02 20:32:58.357172 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:58.357166 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls998" Jul 02 20:32:58.357723 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:58.357134 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6r6ph" Jul 02 20:32:58.357723 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:58.357259 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65xk9" podUID="d5984f1f-3f02-4ab7-b9b9-7e203a87ea34" Jul 02 20:32:58.357723 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:58.357319 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6r6ph" podUID="cce9f678-db00-4f8d-bdaa-b2479796b62e" Jul 02 20:32:58.357723 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:58.357430 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ls998" podUID="56e0a8da-b013-4d0c-b5e9-b9431f944da3" Jul 02 20:32:58.776894 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:58.776844 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56e0a8da-b013-4d0c-b5e9-b9431f944da3-metrics-certs\") pod \"network-metrics-daemon-ls998\" (UID: \"56e0a8da-b013-4d0c-b5e9-b9431f944da3\") " pod="openshift-multus/network-metrics-daemon-ls998" Jul 02 20:32:58.777095 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:58.776909 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6n6n\" (UniqueName: \"kubernetes.io/projected/d5984f1f-3f02-4ab7-b9b9-7e203a87ea34-kube-api-access-h6n6n\") pod \"network-check-target-65xk9\" (UID: \"d5984f1f-3f02-4ab7-b9b9-7e203a87ea34\") " pod="openshift-network-diagnostics/network-check-target-65xk9" Jul 02 20:32:58.777095 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:32:58.776953 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cce9f678-db00-4f8d-bdaa-b2479796b62e-original-pull-secret\") pod \"global-pull-secret-syncer-6r6ph\" (UID: \"cce9f678-db00-4f8d-bdaa-b2479796b62e\") " pod="kube-system/global-pull-secret-syncer-6r6ph" Jul 02 20:32:58.777095 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:58.776995 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 20:32:58.777095 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:58.777069 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56e0a8da-b013-4d0c-b5e9-b9431f944da3-metrics-certs podName:56e0a8da-b013-4d0c-b5e9-b9431f944da3 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:14.777049662 +0000 UTC m=+33.229970757 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/56e0a8da-b013-4d0c-b5e9-b9431f944da3-metrics-certs") pod "network-metrics-daemon-ls998" (UID: "56e0a8da-b013-4d0c-b5e9-b9431f944da3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 20:32:58.777095 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:58.777070 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 20:32:58.777360 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:58.777121 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cce9f678-db00-4f8d-bdaa-b2479796b62e-original-pull-secret podName:cce9f678-db00-4f8d-bdaa-b2479796b62e nodeName:}" failed. No retries permitted until 2026-07-02 20:33:14.777105844 +0000 UTC m=+33.230026938 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cce9f678-db00-4f8d-bdaa-b2479796b62e-original-pull-secret") pod "global-pull-secret-syncer-6r6ph" (UID: "cce9f678-db00-4f8d-bdaa-b2479796b62e") : object "kube-system"/"original-pull-secret" not registered Jul 02 20:32:58.777360 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:58.777068 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 20:32:58.777360 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:58.777153 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 20:32:58.777360 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:58.777167 2568 projected.go:196] Error preparing data for projected volume kube-api-access-h6n6n for pod openshift-network-diagnostics/network-check-target-65xk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 20:32:58.777360 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:32:58.777210 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5984f1f-3f02-4ab7-b9b9-7e203a87ea34-kube-api-access-h6n6n podName:d5984f1f-3f02-4ab7-b9b9-7e203a87ea34 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:14.7771977 +0000 UTC m=+33.230118778 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-h6n6n" (UniqueName: "kubernetes.io/projected/d5984f1f-3f02-4ab7-b9b9-7e203a87ea34-kube-api-access-h6n6n") pod "network-check-target-65xk9" (UID: "d5984f1f-3f02-4ab7-b9b9-7e203a87ea34") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 20:33:00.357865 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:00.357823 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls998" Jul 02 20:33:00.357865 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:00.357844 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6r6ph" Jul 02 20:33:00.358298 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:00.357912 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65xk9" Jul 02 20:33:00.358298 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:00.358025 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65xk9" podUID="d5984f1f-3f02-4ab7-b9b9-7e203a87ea34" Jul 02 20:33:00.358298 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:00.358146 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6r6ph" podUID="cce9f678-db00-4f8d-bdaa-b2479796b62e" Jul 02 20:33:00.358298 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:00.358252 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ls998" podUID="56e0a8da-b013-4d0c-b5e9-b9431f944da3" Jul 02 20:33:02.358416 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:02.358387 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6r6ph" Jul 02 20:33:02.358874 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:02.358490 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls998" Jul 02 20:33:02.358874 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:02.358492 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6r6ph" podUID="cce9f678-db00-4f8d-bdaa-b2479796b62e" Jul 02 20:33:02.358874 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:02.358696 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65xk9" Jul 02 20:33:02.358874 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:02.358702 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ls998" podUID="56e0a8da-b013-4d0c-b5e9-b9431f944da3" Jul 02 20:33:02.358874 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:02.358820 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65xk9" podUID="d5984f1f-3f02-4ab7-b9b9-7e203a87ea34" Jul 02 20:33:04.357116 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:04.357083 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65xk9" Jul 02 20:33:04.357607 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:04.357091 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6r6ph" Jul 02 20:33:04.357607 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:04.357182 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65xk9" podUID="d5984f1f-3f02-4ab7-b9b9-7e203a87ea34" Jul 02 20:33:04.357607 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:04.357195 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls998" Jul 02 20:33:04.357607 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:04.357264 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6r6ph" podUID="cce9f678-db00-4f8d-bdaa-b2479796b62e" Jul 02 20:33:04.357607 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:04.357360 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ls998" podUID="56e0a8da-b013-4d0c-b5e9-b9431f944da3" Jul 02 20:33:05.554046 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:05.553868 2568 generic.go:356] "Generic (PLEG): container finished" podID="2e15b28acdfde5fc6df129862ecf92ac" containerID="9ad107e5fa20a431a5720559c700ff6ec3bf708d2cb007f917c8813f6f2711a1" exitCode=0 Jul 02 20:33:05.554808 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:05.553959 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" event={"ID":"2e15b28acdfde5fc6df129862ecf92ac","Type":"ContainerDied","Data":"9ad107e5fa20a431a5720559c700ff6ec3bf708d2cb007f917c8813f6f2711a1"} Jul 02 20:33:05.555762 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:05.555738 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-144.ec2.internal" event={"ID":"a3daa949ad2399aa2ae00a9f45c827ee","Type":"ContainerStarted","Data":"fb073c9cf9f87e9ab06869da67e6fc5dfe0409b1002866d7f7e239769ea73e9f"} Jul 02 20:33:05.558828 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:05.558809 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" event={"ID":"56b04565-9e51-4bfe-bc36-4aa5864a9654","Type":"ContainerStarted","Data":"dc6abf1b8f9ceddd2d58d96ede51ffe5c00bce205d2354e45cc0981c24c51895"} Jul 02 20:33:05.558922 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:05.558905 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" event={"ID":"56b04565-9e51-4bfe-bc36-4aa5864a9654","Type":"ContainerStarted","Data":"3cdf6e1a2cf1cb270be45df8b329fdd3515f08f598e6aa6e697e6cb6438306d2"} Jul 02 20:33:05.558976 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:05.558957 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" event={"ID":"56b04565-9e51-4bfe-bc36-4aa5864a9654","Type":"ContainerStarted","Data":"f2eb695095ef08736b40b4da29200c9f82a814b54112283be2a24916020669ec"} Jul 02 20:33:05.559023 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:05.559007 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" event={"ID":"56b04565-9e51-4bfe-bc36-4aa5864a9654","Type":"ContainerStarted","Data":"d8153437ce746db926f7ff2cb93c5252e7b857aa71bff7853d52fb7b6d60ad5a"} Jul 02 20:33:05.559072 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:05.559048 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" event={"ID":"56b04565-9e51-4bfe-bc36-4aa5864a9654","Type":"ContainerStarted","Data":"777bc61c3d154beddf086dc51f89793916287db55f51619f7e83ee41a1e3e5ce"} Jul 02 20:33:05.559135 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:05.559082 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" event={"ID":"56b04565-9e51-4bfe-bc36-4aa5864a9654","Type":"ContainerStarted","Data":"536f17c7f3667f5b9b270d9cf237bc4fd65c74c6524db789ff0242e504623ed4"} Jul 02 20:33:05.560329 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:05.560309 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n9rd8" event={"ID":"2d608d9c-dccd-4a18-bc1f-b33258ff0874","Type":"ContainerStarted","Data":"1dc45669c9c75396b7e63658bc462bc7c472786ce82dcbd567eac9d4669a7a5d"} Jul 02 20:33:05.561726 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:05.561704 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m678g" event={"ID":"6a31ac7c-eb80-40a5-ba12-098835ab593a","Type":"ContainerStarted","Data":"4fcda9e966095b13f0f449ff3a1de99301ad2ff1534eecc1fd648124ce424fe0"} Jul 02 20:33:05.563088 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:05.563070 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-hlj5p" event={"ID":"2f642606-1324-47e9-a987-6007d50f7707","Type":"ContainerStarted","Data":"9028974e629ea2dde915a3f09eef12988d81ba8f4c4badb936a7b36bfb770d8b"} Jul 02 20:33:05.564462 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:05.564442 2568 generic.go:356] "Generic (PLEG): container finished" podID="02a28c36-499c-40df-92ac-4cf4b1222c70" containerID="c8c94f4090b4a1ae778383a0d67fa8dc99e1d5725b17075935e6f0e26bec9cc2" exitCode=0 Jul 02 20:33:05.564549 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:05.564517 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xkk7n" event={"ID":"02a28c36-499c-40df-92ac-4cf4b1222c70","Type":"ContainerDied","Data":"c8c94f4090b4a1ae778383a0d67fa8dc99e1d5725b17075935e6f0e26bec9cc2"} Jul 02 20:33:05.565954 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:05.565938 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jlrcv" event={"ID":"131eba4c-85f0-47e1-8c22-28eff5d0d06e","Type":"ContainerStarted","Data":"a02d097d258d08dc683d07d6acad94c6a4597e9c4869d3f97032717caff13b73"} Jul 02 20:33:05.567341 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:05.567314 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-tnmd2" event={"ID":"061a3e0f-48fe-4a8f-8b89-d0931f9e404d","Type":"ContainerStarted","Data":"44ceb20120b2be3d9ea19af26d8b731fdd760beb49245287446ab33acb0d75e8"} Jul 02 20:33:05.568491 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:05.568469 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q8p8n" event={"ID":"b7d5983b-3afb-4507-abeb-871f909d6414","Type":"ContainerStarted","Data":"812bf01d5a630fbf27f3f577afcf4f1d4707da1277451ccdb882b928b9cfca5b"} Jul 02 20:33:05.583224 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:05.583185 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-tnmd2" podStartSLOduration=1.803512719 podStartE2EDuration="22.583172084s" totalImagesPullingTime="20.779659365s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:32:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:05.582983526 +0000 UTC m=+24.035904624" watchObservedRunningTime="2026-07-02 20:33:05.583172084 +0000 UTC m=+24.036093481" Jul 02 20:33:05.596572 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:05.596537 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-144.ec2.internal" podStartSLOduration=22.596523935 podStartE2EDuration="22.596523935s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:05.59621144 +0000 UTC m=+24.049132537" watchObservedRunningTime="2026-07-02 20:33:05.596523935 +0000 UTC m=+24.049445033" Jul 02 20:33:05.615006 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:05.614743 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-q8p8n" podStartSLOduration=1.713962601 podStartE2EDuration="22.614725599s" totalImagesPullingTime="20.900762998s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:05.614426623 +0000 UTC m=+24.067347722" watchObservedRunningTime="2026-07-02 20:33:05.614725599 +0000 UTC m=+24.067646697" Jul 02 20:33:05.627490 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:05.627387 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-hlj5p" podStartSLOduration=2.058332539 podStartE2EDuration="22.62737055s" totalImagesPullingTime="20.569038011s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:05.627096293 +0000 UTC m=+24.080017392" watchObservedRunningTime="2026-07-02 20:33:05.62737055 +0000 UTC m=+24.080291648" Jul 02 20:33:05.665070 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:05.665037 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-n9rd8" podStartSLOduration=1.9087336750000001 podStartE2EDuration="22.665025512s" totalImagesPullingTime="20.756291837s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:05.664870422 +0000 UTC m=+24.117791515" watchObservedRunningTime="2026-07-02 20:33:05.665025512 +0000 UTC m=+24.117946610" Jul 02 20:33:05.684967 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:05.684935 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-m678g" podStartSLOduration=1.8966258649999999 podStartE2EDuration="22.684922187s" totalImagesPullingTime="20.788296322s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:05.684632347 +0000 UTC m=+24.137553446" watchObservedRunningTime="2026-07-02 20:33:05.684922187 +0000 UTC m=+24.137843285" Jul 02 20:33:05.977525 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:05.977497 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-tnmd2" Jul 02 20:33:06.358277 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:06.357942 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls998" Jul 02 20:33:06.358277 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:06.358063 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ls998" podUID="56e0a8da-b013-4d0c-b5e9-b9431f944da3" Jul 02 20:33:06.358277 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:06.358104 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6r6ph" Jul 02 20:33:06.358277 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:06.358118 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65xk9" Jul 02 20:33:06.358277 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:06.358222 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6r6ph" podUID="cce9f678-db00-4f8d-bdaa-b2479796b62e" Jul 02 20:33:06.358596 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:06.358295 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65xk9" podUID="d5984f1f-3f02-4ab7-b9b9-7e203a87ea34" Jul 02 20:33:06.405003 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:06.404972 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-tnmd2" Jul 02 20:33:06.405504 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:06.405485 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-tnmd2" Jul 02 20:33:06.572730 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:06.572697 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-nc8b6" event={"ID":"7c9eafd9-a647-4969-9f9b-ba66b6da5c10","Type":"ContainerStarted","Data":"7c9ebcf48f9d505d450a075bc73c30dd99261dee86bc84aa92c9d2a0a0b25dbf"} Jul 02 20:33:06.574691 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:06.574663 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" event={"ID":"2e15b28acdfde5fc6df129862ecf92ac","Type":"ContainerStarted","Data":"cacf3c156327715a0a440db3074ccfd700d723d491221201f257c9b06728563a"} Jul 02 20:33:06.575881 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:06.575864 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-tnmd2" Jul 02 20:33:06.587192 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:06.587134 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-nc8b6" podStartSLOduration=2.8068103410000003 podStartE2EDuration="23.587120024s" totalImagesPullingTime="20.780309683s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:06.586952088 +0000 UTC m=+25.039873188" watchObservedRunningTime="2026-07-02 20:33:06.587120024 +0000 UTC m=+25.040041167" Jul 02 20:33:06.615833 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:06.615774 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-144.ec2.internal" podStartSLOduration=23.615762262 podStartE2EDuration="23.615762262s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:06.615329457 +0000 UTC m=+25.068250555" watchObservedRunningTime="2026-07-02 20:33:06.615762262 +0000 UTC m=+25.068683359" Jul 02 20:33:06.756028 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:06.756005 2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 02 20:33:07.306802 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:07.306682 2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T20:33:06.756024027Z","UUID":"f1ca06b8-5a93-4d60-a980-221eb06bb54d","Handler":null,"Name":"","Endpoint":""} Jul 02 20:33:07.308965 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:07.308926 2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 02 20:33:07.309103 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:07.308988 2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 02 20:33:07.581375 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:07.581287 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" event={"ID":"56b04565-9e51-4bfe-bc36-4aa5864a9654","Type":"ContainerStarted","Data":"8eac868a0b4c6ff23d3d556bd10975bceb91eb6f5c846f7b3adac0f56ecfdb6b"} Jul 02 20:33:07.583642 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:07.583573 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jlrcv" event={"ID":"131eba4c-85f0-47e1-8c22-28eff5d0d06e","Type":"ContainerStarted","Data":"0b624f8af675e1968b58444517fc154ed79296eeb497fd539d696874a5804829"} Jul 02 20:33:08.357447 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:08.357417 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6r6ph" Jul 02 20:33:08.357447 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:08.357444 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65xk9" Jul 02 20:33:08.357676 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:08.357420 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls998" Jul 02 20:33:08.357676 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:08.357522 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6r6ph" podUID="cce9f678-db00-4f8d-bdaa-b2479796b62e" Jul 02 20:33:08.357676 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:08.357605 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ls998" podUID="56e0a8da-b013-4d0c-b5e9-b9431f944da3" Jul 02 20:33:08.357816 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:08.357685 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65xk9" podUID="d5984f1f-3f02-4ab7-b9b9-7e203a87ea34" Jul 02 20:33:08.587195 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:08.587163 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jlrcv" event={"ID":"131eba4c-85f0-47e1-8c22-28eff5d0d06e","Type":"ContainerStarted","Data":"ef99b335d7d9bbd2a13b391ddc35f73b5548cc79623d899ba8bbd98d4762579e"} Jul 02 20:33:08.605638 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:08.605591 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-jlrcv" podStartSLOduration=2.548794527 podStartE2EDuration="25.605577119s" totalImagesPullingTime="23.056782592s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:08.604192941 +0000 UTC m=+27.057114038" watchObservedRunningTime="2026-07-02 20:33:08.605577119 +0000 UTC m=+27.058498216" Jul 02 20:33:10.358082 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:10.357902 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65xk9" Jul 02 20:33:10.358082 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:10.357948 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls998" Jul 02 20:33:10.358082 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:10.357902 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6r6ph" Jul 02 20:33:10.358082 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:10.358027 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65xk9" podUID="d5984f1f-3f02-4ab7-b9b9-7e203a87ea34" Jul 02 20:33:10.358538 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:10.358116 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6r6ph" podUID="cce9f678-db00-4f8d-bdaa-b2479796b62e" Jul 02 20:33:10.358538 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:10.358204 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ls998" podUID="56e0a8da-b013-4d0c-b5e9-b9431f944da3" Jul 02 20:33:11.596973 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:11.596755 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" event={"ID":"56b04565-9e51-4bfe-bc36-4aa5864a9654","Type":"ContainerStarted","Data":"18380820ff622b914d05f64a88d2f9b0ac2eddfbb04ed22992731f583c0a5015"} Jul 02 20:33:11.597718 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:11.597025 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:33:11.597718 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:11.597081 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:33:11.598639 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:11.598618 2568 generic.go:356] "Generic (PLEG): container finished" podID="02a28c36-499c-40df-92ac-4cf4b1222c70" containerID="e5cd23af022a505a47b2057848888257a7ed957cb4141a19cddb98b2f36c8642" exitCode=0 Jul 02 20:33:11.598736 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:11.598647 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xkk7n" event={"ID":"02a28c36-499c-40df-92ac-4cf4b1222c70","Type":"ContainerDied","Data":"e5cd23af022a505a47b2057848888257a7ed957cb4141a19cddb98b2f36c8642"} Jul 02 20:33:11.612007 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:11.611985 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:33:11.623606 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:11.623571 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" podStartSLOduration=7.9793259 podStartE2EDuration="28.623559972s" totalImagesPullingTime="20.644234072s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:11.622369013 +0000 UTC m=+30.075290112" watchObservedRunningTime="2026-07-02 20:33:11.623559972 +0000 UTC m=+30.076481073" Jul 02 20:33:12.359047 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:12.358876 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6r6ph" Jul 02 20:33:12.359347 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:12.358907 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls998" Jul 02 20:33:12.359347 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:12.359121 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6r6ph" podUID="cce9f678-db00-4f8d-bdaa-b2479796b62e" Jul 02 20:33:12.359347 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:12.358933 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65xk9" Jul 02 20:33:12.359347 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:12.359256 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ls998" podUID="56e0a8da-b013-4d0c-b5e9-b9431f944da3" Jul 02 20:33:12.359568 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:12.359340 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65xk9" podUID="d5984f1f-3f02-4ab7-b9b9-7e203a87ea34" Jul 02 20:33:12.600711 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:12.600684 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:33:12.615745 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:12.615725 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:33:13.008816 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:13.008791 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6r6ph"] Jul 02 20:33:13.008969 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:13.008917 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6r6ph" Jul 02 20:33:13.009027 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:13.009000 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6r6ph" podUID="cce9f678-db00-4f8d-bdaa-b2479796b62e" Jul 02 20:33:13.011998 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:13.011969 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-65xk9"] Jul 02 20:33:13.012112 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:13.012040 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65xk9" Jul 02 20:33:13.012176 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:13.012123 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65xk9" podUID="d5984f1f-3f02-4ab7-b9b9-7e203a87ea34" Jul 02 20:33:13.012543 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:13.012519 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ls998"] Jul 02 20:33:13.012642 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:13.012605 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls998" Jul 02 20:33:13.012713 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:13.012696 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ls998" podUID="56e0a8da-b013-4d0c-b5e9-b9431f944da3" Jul 02 20:33:13.604651 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:13.604624 2568 generic.go:356] "Generic (PLEG): container finished" podID="02a28c36-499c-40df-92ac-4cf4b1222c70" containerID="8ccba1b6dde6bf0f5bfdc3daaff3dc7a807efb5c906caaac0e84bc4920fec9d2" exitCode=0 Jul 02 20:33:13.605047 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:13.604704 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xkk7n" event={"ID":"02a28c36-499c-40df-92ac-4cf4b1222c70","Type":"ContainerDied","Data":"8ccba1b6dde6bf0f5bfdc3daaff3dc7a807efb5c906caaac0e84bc4920fec9d2"} Jul 02 20:33:14.358106 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:14.358034 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6r6ph" Jul 02 20:33:14.358232 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:14.358160 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6r6ph" podUID="cce9f678-db00-4f8d-bdaa-b2479796b62e" Jul 02 20:33:14.798262 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:14.798235 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cce9f678-db00-4f8d-bdaa-b2479796b62e-original-pull-secret\") pod \"global-pull-secret-syncer-6r6ph\" (UID: \"cce9f678-db00-4f8d-bdaa-b2479796b62e\") " pod="kube-system/global-pull-secret-syncer-6r6ph" Jul 02 20:33:14.798567 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:14.798277 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56e0a8da-b013-4d0c-b5e9-b9431f944da3-metrics-certs\") pod \"network-metrics-daemon-ls998\" (UID: \"56e0a8da-b013-4d0c-b5e9-b9431f944da3\") " pod="openshift-multus/network-metrics-daemon-ls998" Jul 02 20:33:14.798567 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:14.798295 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6n6n\" (UniqueName: \"kubernetes.io/projected/d5984f1f-3f02-4ab7-b9b9-7e203a87ea34-kube-api-access-h6n6n\") pod \"network-check-target-65xk9\" (UID: \"d5984f1f-3f02-4ab7-b9b9-7e203a87ea34\") " pod="openshift-network-diagnostics/network-check-target-65xk9" Jul 02 20:33:14.798567 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:14.798361 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 20:33:14.798567 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:14.798373 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 20:33:14.798567 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:14.798379 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 20:33:14.798567 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:14.798394 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 20:33:14.798567 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:14.798402 2568 projected.go:196] Error preparing data for projected volume kube-api-access-h6n6n for pod openshift-network-diagnostics/network-check-target-65xk9: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 20:33:14.798567 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:14.798414 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cce9f678-db00-4f8d-bdaa-b2479796b62e-original-pull-secret podName:cce9f678-db00-4f8d-bdaa-b2479796b62e nodeName:}" failed. No retries permitted until 2026-07-02 20:33:46.798398913 +0000 UTC m=+65.251319993 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/cce9f678-db00-4f8d-bdaa-b2479796b62e-original-pull-secret") pod "global-pull-secret-syncer-6r6ph" (UID: "cce9f678-db00-4f8d-bdaa-b2479796b62e") : object "kube-system"/"original-pull-secret" not registered Jul 02 20:33:14.798567 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:14.798427 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56e0a8da-b013-4d0c-b5e9-b9431f944da3-metrics-certs podName:56e0a8da-b013-4d0c-b5e9-b9431f944da3 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:46.798420845 +0000 UTC m=+65.251341921 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/56e0a8da-b013-4d0c-b5e9-b9431f944da3-metrics-certs") pod "network-metrics-daemon-ls998" (UID: "56e0a8da-b013-4d0c-b5e9-b9431f944da3") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 20:33:14.798567 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:14.798437 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/d5984f1f-3f02-4ab7-b9b9-7e203a87ea34-kube-api-access-h6n6n podName:d5984f1f-3f02-4ab7-b9b9-7e203a87ea34 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:46.798431902 +0000 UTC m=+65.251352977 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-h6n6n" (UniqueName: "kubernetes.io/projected/d5984f1f-3f02-4ab7-b9b9-7e203a87ea34-kube-api-access-h6n6n") pod "network-check-target-65xk9" (UID: "d5984f1f-3f02-4ab7-b9b9-7e203a87ea34") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 20:33:15.357226 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:15.357199 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls998" Jul 02 20:33:15.357394 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:15.357293 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ls998" podUID="56e0a8da-b013-4d0c-b5e9-b9431f944da3" Jul 02 20:33:15.357394 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:15.357351 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65xk9" Jul 02 20:33:15.357476 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:15.357422 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65xk9" podUID="d5984f1f-3f02-4ab7-b9b9-7e203a87ea34" Jul 02 20:33:15.610707 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:15.610629 2568 generic.go:356] "Generic (PLEG): container finished" podID="02a28c36-499c-40df-92ac-4cf4b1222c70" containerID="13b0ed25011507fd913a8fbea1509b12068334d71f36898d74768f1bb7ce1fb4" exitCode=0 Jul 02 20:33:15.610707 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:15.610684 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xkk7n" event={"ID":"02a28c36-499c-40df-92ac-4cf4b1222c70","Type":"ContainerDied","Data":"13b0ed25011507fd913a8fbea1509b12068334d71f36898d74768f1bb7ce1fb4"} Jul 02 20:33:16.358076 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:16.358046 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6r6ph" Jul 02 20:33:16.358485 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:16.358169 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6r6ph" podUID="cce9f678-db00-4f8d-bdaa-b2479796b62e" Jul 02 20:33:17.357047 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:17.356969 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65xk9" Jul 02 20:33:17.357047 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:17.356988 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls998" Jul 02 20:33:17.357249 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:17.357105 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-65xk9" podUID="d5984f1f-3f02-4ab7-b9b9-7e203a87ea34" Jul 02 20:33:17.357249 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:17.357226 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ls998" podUID="56e0a8da-b013-4d0c-b5e9-b9431f944da3" Jul 02 20:33:17.365779 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:17.365751 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-144.ec2.internal" event="NodeReady" Jul 02 20:33:17.366135 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:17.365910 2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 02 20:33:17.408341 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:17.408315 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xmprk"] Jul 02 20:33:17.413026 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:17.413007 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-s2t78"] Jul 02 20:33:17.413154 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:17.413116 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xmprk" Jul 02 20:33:17.415659 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:17.415467 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 02 20:33:17.415792 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:17.415666 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w7dxd\"" Jul 02 20:33:17.415993 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:17.415975 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 02 20:33:17.417189 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:17.417171 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s2t78" Jul 02 20:33:17.419346 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:17.419215 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-h2bvt\"" Jul 02 20:33:17.419346 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:17.419236 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 02 20:33:17.419346 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:17.419260 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 02 20:33:17.419591 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:17.419400 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 02 20:33:17.421183 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:17.421161 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xmprk"] Jul 02 20:33:17.423789 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:17.423743 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s2t78"] Jul 02 20:33:17.518469 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:17.518437 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1705bb5f-096c-48a1-84ec-bd013e7d0349-tmp-dir\") pod \"dns-default-xmprk\" (UID: \"1705bb5f-096c-48a1-84ec-bd013e7d0349\") " pod="openshift-dns/dns-default-xmprk" Jul 02 20:33:17.518624 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:17.518478 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plcc5\" (UniqueName: \"kubernetes.io/projected/a5763ddc-b57e-4b60-9779-a16c70e04461-kube-api-access-plcc5\") pod \"ingress-canary-s2t78\" (UID: \"a5763ddc-b57e-4b60-9779-a16c70e04461\") " pod="openshift-ingress-canary/ingress-canary-s2t78" Jul 02 20:33:17.518624 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:17.518503 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1705bb5f-096c-48a1-84ec-bd013e7d0349-config-volume\") pod \"dns-default-xmprk\" (UID: \"1705bb5f-096c-48a1-84ec-bd013e7d0349\") " pod="openshift-dns/dns-default-xmprk" Jul 02 20:33:17.518624 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:17.518553 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tmj88\" (UniqueName: \"kubernetes.io/projected/1705bb5f-096c-48a1-84ec-bd013e7d0349-kube-api-access-tmj88\") pod \"dns-default-xmprk\" (UID: \"1705bb5f-096c-48a1-84ec-bd013e7d0349\") " pod="openshift-dns/dns-default-xmprk" Jul 02 20:33:17.518624 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:17.518602 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1705bb5f-096c-48a1-84ec-bd013e7d0349-metrics-tls\") pod \"dns-default-xmprk\" (UID: \"1705bb5f-096c-48a1-84ec-bd013e7d0349\") " pod="openshift-dns/dns-default-xmprk" Jul 02 20:33:17.518782 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:17.518633 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a5763ddc-b57e-4b60-9779-a16c70e04461-cert\") pod \"ingress-canary-s2t78\" (UID: \"a5763ddc-b57e-4b60-9779-a16c70e04461\") " pod="openshift-ingress-canary/ingress-canary-s2t78" Jul 02 20:33:17.619758 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:17.619690 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1705bb5f-096c-48a1-84ec-bd013e7d0349-config-volume\") pod \"dns-default-xmprk\" (UID: \"1705bb5f-096c-48a1-84ec-bd013e7d0349\") " pod="openshift-dns/dns-default-xmprk" Jul 02 20:33:17.619758 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:17.619729 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tmj88\" (UniqueName: \"kubernetes.io/projected/1705bb5f-096c-48a1-84ec-bd013e7d0349-kube-api-access-tmj88\") pod \"dns-default-xmprk\" (UID: \"1705bb5f-096c-48a1-84ec-bd013e7d0349\") " pod="openshift-dns/dns-default-xmprk" Jul 02 20:33:17.619960 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:17.619760 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1705bb5f-096c-48a1-84ec-bd013e7d0349-metrics-tls\") pod \"dns-default-xmprk\" (UID: \"1705bb5f-096c-48a1-84ec-bd013e7d0349\") " pod="openshift-dns/dns-default-xmprk" Jul 02 20:33:17.619960 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:17.619783 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a5763ddc-b57e-4b60-9779-a16c70e04461-cert\") pod \"ingress-canary-s2t78\" (UID: \"a5763ddc-b57e-4b60-9779-a16c70e04461\") " pod="openshift-ingress-canary/ingress-canary-s2t78" Jul 02 20:33:17.619960 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:17.619822 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1705bb5f-096c-48a1-84ec-bd013e7d0349-tmp-dir\") pod \"dns-default-xmprk\" (UID: \"1705bb5f-096c-48a1-84ec-bd013e7d0349\") " pod="openshift-dns/dns-default-xmprk" Jul 02 20:33:17.619960 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:17.619871 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plcc5\" (UniqueName: \"kubernetes.io/projected/a5763ddc-b57e-4b60-9779-a16c70e04461-kube-api-access-plcc5\") pod \"ingress-canary-s2t78\" (UID: \"a5763ddc-b57e-4b60-9779-a16c70e04461\") " pod="openshift-ingress-canary/ingress-canary-s2t78" Jul 02 20:33:17.620164 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:17.620068 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 20:33:17.620164 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:17.620133 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1705bb5f-096c-48a1-84ec-bd013e7d0349-metrics-tls podName:1705bb5f-096c-48a1-84ec-bd013e7d0349 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:18.120111467 +0000 UTC m=+36.573032547 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1705bb5f-096c-48a1-84ec-bd013e7d0349-metrics-tls") pod "dns-default-xmprk" (UID: "1705bb5f-096c-48a1-84ec-bd013e7d0349") : secret "dns-default-metrics-tls" not found Jul 02 20:33:17.620444 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:17.620418 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1705bb5f-096c-48a1-84ec-bd013e7d0349-tmp-dir\") pod \"dns-default-xmprk\" (UID: \"1705bb5f-096c-48a1-84ec-bd013e7d0349\") " pod="openshift-dns/dns-default-xmprk" Jul 02 20:33:17.620591 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:17.620571 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/1705bb5f-096c-48a1-84ec-bd013e7d0349-config-volume\") pod \"dns-default-xmprk\" (UID: \"1705bb5f-096c-48a1-84ec-bd013e7d0349\") " pod="openshift-dns/dns-default-xmprk" Jul 02 20:33:17.624574 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:17.624550 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/a5763ddc-b57e-4b60-9779-a16c70e04461-cert\") pod \"ingress-canary-s2t78\" (UID: \"a5763ddc-b57e-4b60-9779-a16c70e04461\") " pod="openshift-ingress-canary/ingress-canary-s2t78" Jul 02 20:33:17.628172 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:17.628128 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tmj88\" (UniqueName: \"kubernetes.io/projected/1705bb5f-096c-48a1-84ec-bd013e7d0349-kube-api-access-tmj88\") pod \"dns-default-xmprk\" (UID: \"1705bb5f-096c-48a1-84ec-bd013e7d0349\") " pod="openshift-dns/dns-default-xmprk" Jul 02 20:33:17.628511 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:17.628493 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plcc5\" (UniqueName: \"kubernetes.io/projected/a5763ddc-b57e-4b60-9779-a16c70e04461-kube-api-access-plcc5\") pod \"ingress-canary-s2t78\" (UID: \"a5763ddc-b57e-4b60-9779-a16c70e04461\") " pod="openshift-ingress-canary/ingress-canary-s2t78" Jul 02 20:33:17.731595 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:17.731562 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-s2t78" Jul 02 20:33:17.878869 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:17.878790 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-s2t78"] Jul 02 20:33:18.123045 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:18.123012 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1705bb5f-096c-48a1-84ec-bd013e7d0349-metrics-tls\") pod \"dns-default-xmprk\" (UID: \"1705bb5f-096c-48a1-84ec-bd013e7d0349\") " pod="openshift-dns/dns-default-xmprk" Jul 02 20:33:18.123213 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:18.123151 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 20:33:18.123274 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:18.123225 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1705bb5f-096c-48a1-84ec-bd013e7d0349-metrics-tls podName:1705bb5f-096c-48a1-84ec-bd013e7d0349 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:19.123204653 +0000 UTC m=+37.576125732 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1705bb5f-096c-48a1-84ec-bd013e7d0349-metrics-tls") pod "dns-default-xmprk" (UID: "1705bb5f-096c-48a1-84ec-bd013e7d0349") : secret "dns-default-metrics-tls" not found Jul 02 20:33:18.357083 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:18.357052 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6r6ph" Jul 02 20:33:18.362831 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:18.360107 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 20:33:18.620331 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:18.620221 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s2t78" event={"ID":"a5763ddc-b57e-4b60-9779-a16c70e04461","Type":"ContainerStarted","Data":"2857af335ad9ae078effb0c56ed51190eeb72a1d93ff3b0f6490601832aadb56"} Jul 02 20:33:19.131608 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:19.131568 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1705bb5f-096c-48a1-84ec-bd013e7d0349-metrics-tls\") pod \"dns-default-xmprk\" (UID: \"1705bb5f-096c-48a1-84ec-bd013e7d0349\") " pod="openshift-dns/dns-default-xmprk" Jul 02 20:33:19.131772 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:19.131749 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 20:33:19.131863 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:19.131837 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1705bb5f-096c-48a1-84ec-bd013e7d0349-metrics-tls podName:1705bb5f-096c-48a1-84ec-bd013e7d0349 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:21.131813678 +0000 UTC m=+39.584734769 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1705bb5f-096c-48a1-84ec-bd013e7d0349-metrics-tls") pod "dns-default-xmprk" (UID: "1705bb5f-096c-48a1-84ec-bd013e7d0349") : secret "dns-default-metrics-tls" not found Jul 02 20:33:19.357170 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:19.357131 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65xk9" Jul 02 20:33:19.357573 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:19.357382 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls998" Jul 02 20:33:19.360993 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:19.360710 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zddh5\"" Jul 02 20:33:19.360993 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:19.360774 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w2d5j\"" Jul 02 20:33:19.360993 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:19.360796 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 20:33:19.360993 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:19.360838 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 20:33:19.360993 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:19.360778 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 20:33:21.145632 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:21.145395 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1705bb5f-096c-48a1-84ec-bd013e7d0349-metrics-tls\") pod \"dns-default-xmprk\" (UID: \"1705bb5f-096c-48a1-84ec-bd013e7d0349\") " pod="openshift-dns/dns-default-xmprk" Jul 02 20:33:21.146028 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:21.145541 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 20:33:21.146028 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:21.145772 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1705bb5f-096c-48a1-84ec-bd013e7d0349-metrics-tls podName:1705bb5f-096c-48a1-84ec-bd013e7d0349 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:25.145751473 +0000 UTC m=+43.598672552 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1705bb5f-096c-48a1-84ec-bd013e7d0349-metrics-tls") pod "dns-default-xmprk" (UID: "1705bb5f-096c-48a1-84ec-bd013e7d0349") : secret "dns-default-metrics-tls" not found Jul 02 20:33:22.630827 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:22.630789 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-s2t78" event={"ID":"a5763ddc-b57e-4b60-9779-a16c70e04461","Type":"ContainerStarted","Data":"050a2ca6f03db4a6776c97667ebaae8f62dbf06fd23a71e15f741739217e7f55"} Jul 02 20:33:22.633497 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:22.633448 2568 generic.go:356] "Generic (PLEG): container finished" podID="02a28c36-499c-40df-92ac-4cf4b1222c70" containerID="e066c2bbac041cad4dc92b875c1a828b884c04343fea48358e2d42943b20c262" exitCode=0 Jul 02 20:33:22.633627 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:22.633530 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xkk7n" event={"ID":"02a28c36-499c-40df-92ac-4cf4b1222c70","Type":"ContainerDied","Data":"e066c2bbac041cad4dc92b875c1a828b884c04343fea48358e2d42943b20c262"} Jul 02 20:33:22.645763 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:22.645714 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-s2t78" podStartSLOduration=1.7000511889999999 podStartE2EDuration="5.645697252s" totalImagesPullingTime="3.945646063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:33:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:22.645539771 +0000 UTC m=+41.098460870" watchObservedRunningTime="2026-07-02 20:33:22.645697252 +0000 UTC m=+41.098618345" Jul 02 20:33:23.638042 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:23.638007 2568 generic.go:356] "Generic (PLEG): container finished" podID="02a28c36-499c-40df-92ac-4cf4b1222c70" containerID="91829b18eb2a3558a38a668ea55ac41f617d33595cc9811c4eb3ba3b0251915a" exitCode=0 Jul 02 20:33:23.638458 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:23.638088 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xkk7n" event={"ID":"02a28c36-499c-40df-92ac-4cf4b1222c70","Type":"ContainerDied","Data":"91829b18eb2a3558a38a668ea55ac41f617d33595cc9811c4eb3ba3b0251915a"} Jul 02 20:33:24.643353 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:24.643320 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-xkk7n" event={"ID":"02a28c36-499c-40df-92ac-4cf4b1222c70","Type":"ContainerStarted","Data":"a13b4c6f7778bc6abcba283eaca5c340c1413ea1f7ae718cd462de83ae1d7794"} Jul 02 20:33:24.665917 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:24.665872 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-xkk7n" podStartSLOduration=7.44744806 podStartE2EDuration="41.665835233s" totalImagesPullingTime="34.218387173s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:43 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:24.665692875 +0000 UTC m=+43.118614002" watchObservedRunningTime="2026-07-02 20:33:24.665835233 +0000 UTC m=+43.118756332" Jul 02 20:33:25.190795 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:25.190763 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1705bb5f-096c-48a1-84ec-bd013e7d0349-metrics-tls\") pod \"dns-default-xmprk\" (UID: \"1705bb5f-096c-48a1-84ec-bd013e7d0349\") " pod="openshift-dns/dns-default-xmprk" Jul 02 20:33:25.190958 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:25.190877 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 20:33:25.190958 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:25.190925 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1705bb5f-096c-48a1-84ec-bd013e7d0349-metrics-tls podName:1705bb5f-096c-48a1-84ec-bd013e7d0349 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:33.190912833 +0000 UTC m=+51.643833909 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1705bb5f-096c-48a1-84ec-bd013e7d0349-metrics-tls") pod "dns-default-xmprk" (UID: "1705bb5f-096c-48a1-84ec-bd013e7d0349") : secret "dns-default-metrics-tls" not found Jul 02 20:33:33.245561 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:33.245527 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1705bb5f-096c-48a1-84ec-bd013e7d0349-metrics-tls\") pod \"dns-default-xmprk\" (UID: \"1705bb5f-096c-48a1-84ec-bd013e7d0349\") " pod="openshift-dns/dns-default-xmprk" Jul 02 20:33:33.245970 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:33.245627 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 20:33:33.245970 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:33.245685 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1705bb5f-096c-48a1-84ec-bd013e7d0349-metrics-tls podName:1705bb5f-096c-48a1-84ec-bd013e7d0349 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:49.245672427 +0000 UTC m=+67.698593503 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1705bb5f-096c-48a1-84ec-bd013e7d0349-metrics-tls") pod "dns-default-xmprk" (UID: "1705bb5f-096c-48a1-84ec-bd013e7d0349") : secret "dns-default-metrics-tls" not found Jul 02 20:33:44.624616 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:44.624586 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-mmgwl" Jul 02 20:33:46.838749 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:46.838705 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56e0a8da-b013-4d0c-b5e9-b9431f944da3-metrics-certs\") pod \"network-metrics-daemon-ls998\" (UID: \"56e0a8da-b013-4d0c-b5e9-b9431f944da3\") " pod="openshift-multus/network-metrics-daemon-ls998" Jul 02 20:33:46.838749 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:46.838758 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h6n6n\" (UniqueName: \"kubernetes.io/projected/d5984f1f-3f02-4ab7-b9b9-7e203a87ea34-kube-api-access-h6n6n\") pod \"network-check-target-65xk9\" (UID: \"d5984f1f-3f02-4ab7-b9b9-7e203a87ea34\") " pod="openshift-network-diagnostics/network-check-target-65xk9" Jul 02 20:33:46.839187 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:46.838802 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cce9f678-db00-4f8d-bdaa-b2479796b62e-original-pull-secret\") pod \"global-pull-secret-syncer-6r6ph\" (UID: \"cce9f678-db00-4f8d-bdaa-b2479796b62e\") " pod="kube-system/global-pull-secret-syncer-6r6ph" Jul 02 20:33:46.841068 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:46.841048 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 20:33:46.841207 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:46.841188 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 20:33:46.841252 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:46.841199 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 20:33:46.849903 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:46.849881 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 02 20:33:46.849983 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:46.849961 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/56e0a8da-b013-4d0c-b5e9-b9431f944da3-metrics-certs podName:56e0a8da-b013-4d0c-b5e9-b9431f944da3 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:50.849939266 +0000 UTC m=+129.302860345 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/56e0a8da-b013-4d0c-b5e9-b9431f944da3-metrics-certs") pod "network-metrics-daemon-ls998" (UID: "56e0a8da-b013-4d0c-b5e9-b9431f944da3") : secret "metrics-daemon-secret" not found Jul 02 20:33:46.851742 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:46.851728 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 20:33:46.853136 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:46.853119 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/cce9f678-db00-4f8d-bdaa-b2479796b62e-original-pull-secret\") pod \"global-pull-secret-syncer-6r6ph\" (UID: \"cce9f678-db00-4f8d-bdaa-b2479796b62e\") " pod="kube-system/global-pull-secret-syncer-6r6ph" Jul 02 20:33:46.862608 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:46.862588 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h6n6n\" (UniqueName: \"kubernetes.io/projected/d5984f1f-3f02-4ab7-b9b9-7e203a87ea34-kube-api-access-h6n6n\") pod \"network-check-target-65xk9\" (UID: \"d5984f1f-3f02-4ab7-b9b9-7e203a87ea34\") " pod="openshift-network-diagnostics/network-check-target-65xk9" Jul 02 20:33:46.870417 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:46.870400 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6r6ph" Jul 02 20:33:46.972611 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:46.972585 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-w2d5j\"" Jul 02 20:33:46.981546 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:46.981520 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-65xk9" Jul 02 20:33:46.983212 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:46.983188 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6r6ph"] Jul 02 20:33:46.988038 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:33:46.988013 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcce9f678_db00_4f8d_bdaa_b2479796b62e.slice/crio-dbbd4b06163073977b7f935eb51efac3d1e83a23bf90ad652073976bdafc64be WatchSource:0}: Error finding container dbbd4b06163073977b7f935eb51efac3d1e83a23bf90ad652073976bdafc64be: Status 404 returned error can't find the container with id dbbd4b06163073977b7f935eb51efac3d1e83a23bf90ad652073976bdafc64be Jul 02 20:33:47.096263 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:47.096200 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-65xk9"] Jul 02 20:33:47.098922 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:33:47.098896 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd5984f1f_3f02_4ab7_b9b9_7e203a87ea34.slice/crio-0bcfc26c71e380adf02ee73966c8245c2ac21be863733327bd5375d2e5e50d78 WatchSource:0}: Error finding container 0bcfc26c71e380adf02ee73966c8245c2ac21be863733327bd5375d2e5e50d78: Status 404 returned error can't find the container with id 0bcfc26c71e380adf02ee73966c8245c2ac21be863733327bd5375d2e5e50d78 Jul 02 20:33:47.695596 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:47.695558 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-65xk9" event={"ID":"d5984f1f-3f02-4ab7-b9b9-7e203a87ea34","Type":"ContainerStarted","Data":"0bcfc26c71e380adf02ee73966c8245c2ac21be863733327bd5375d2e5e50d78"} Jul 02 20:33:47.697300 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:47.697271 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6r6ph" event={"ID":"cce9f678-db00-4f8d-bdaa-b2479796b62e","Type":"ContainerStarted","Data":"dbbd4b06163073977b7f935eb51efac3d1e83a23bf90ad652073976bdafc64be"} Jul 02 20:33:49.257962 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:49.257923 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1705bb5f-096c-48a1-84ec-bd013e7d0349-metrics-tls\") pod \"dns-default-xmprk\" (UID: \"1705bb5f-096c-48a1-84ec-bd013e7d0349\") " pod="openshift-dns/dns-default-xmprk" Jul 02 20:33:49.258419 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:49.258076 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 20:33:49.258419 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:49.258146 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1705bb5f-096c-48a1-84ec-bd013e7d0349-metrics-tls podName:1705bb5f-096c-48a1-84ec-bd013e7d0349 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:21.258120579 +0000 UTC m=+99.711041655 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/1705bb5f-096c-48a1-84ec-bd013e7d0349-metrics-tls") pod "dns-default-xmprk" (UID: "1705bb5f-096c-48a1-84ec-bd013e7d0349") : secret "dns-default-metrics-tls" not found Jul 02 20:33:52.710471 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:52.710438 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-65xk9" event={"ID":"d5984f1f-3f02-4ab7-b9b9-7e203a87ea34","Type":"ContainerStarted","Data":"2c5ddd4f9797f4faeb6a6bbfa537ac8895aac7ca1da0dd64b1bf0a999e515662"} Jul 02 20:33:52.710929 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:52.710580 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-65xk9" Jul 02 20:33:52.711977 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:52.711955 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6r6ph" event={"ID":"cce9f678-db00-4f8d-bdaa-b2479796b62e","Type":"ContainerStarted","Data":"241911e1d911f7795918e4a735f3a1e6b29a5d4510623ac46b747224aac79374"} Jul 02 20:33:52.725793 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:52.725757 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-65xk9" podStartSLOduration=64.692035716 podStartE2EDuration="1m9.725744519s" totalImagesPullingTime="5.033708803s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:32:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:52.72493979 +0000 UTC m=+71.177860888" watchObservedRunningTime="2026-07-02 20:33:52.725744519 +0000 UTC m=+71.178665616" Jul 02 20:33:52.738655 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:52.738622 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6r6ph" podStartSLOduration=64.583227815 podStartE2EDuration="1m9.738610822s" totalImagesPullingTime="5.155383007s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:32:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:52.738140598 +0000 UTC m=+71.191061696" watchObservedRunningTime="2026-07-02 20:33:52.738610822 +0000 UTC m=+71.191531929" Jul 02 20:33:54.892033 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:54.891996 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lsjxx"] Jul 02 20:33:54.894421 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:54.894399 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lsjxx" Jul 02 20:33:54.896406 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:54.896382 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-6n7zw"] Jul 02 20:33:54.896996 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:54.896980 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 02 20:33:54.897311 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:54.897293 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-fmgls\"" Jul 02 20:33:54.897864 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:54.897836 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 02 20:33:54.898200 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:54.898184 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 02 20:33:54.898276 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:54.898235 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 02 20:33:54.898752 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:54.898733 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-6n7zw" Jul 02 20:33:54.900944 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:54.900928 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 02 20:33:54.901508 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:54.901273 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-82tmn\"" Jul 02 20:33:54.901744 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:54.901595 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 02 20:33:54.901744 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:54.901634 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 02 20:33:54.901744 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:54.901716 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 02 20:33:54.903379 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:54.903361 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rjw76"] Jul 02 20:33:54.905720 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:54.905705 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rjw76" Jul 02 20:33:54.907431 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:54.907412 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lsjxx"] Jul 02 20:33:54.907519 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:54.907460 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 02 20:33:54.908928 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:54.908744 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 02 20:33:54.908928 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:54.908763 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 02 20:33:54.908928 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:54.908901 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 02 20:33:54.909126 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:54.908968 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 02 20:33:54.909182 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:54.909140 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-xdz2n\"" Jul 02 20:33:54.913413 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:54.913375 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-6n7zw"] Jul 02 20:33:54.926102 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:54.926082 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rjw76"] Jul 02 20:33:54.995102 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:54.995083 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4wtxj\" (UniqueName: \"kubernetes.io/projected/9119d7cb-306a-4d98-a453-f123ab249419-kube-api-access-4wtxj\") pod \"insights-operator-5c847dcfc4-6n7zw\" (UID: \"9119d7cb-306a-4d98-a453-f123ab249419\") " pod="openshift-insights/insights-operator-5c847dcfc4-6n7zw" Jul 02 20:33:54.995204 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:54.995116 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9119d7cb-306a-4d98-a453-f123ab249419-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-6n7zw\" (UID: \"9119d7cb-306a-4d98-a453-f123ab249419\") " pod="openshift-insights/insights-operator-5c847dcfc4-6n7zw" Jul 02 20:33:54.995204 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:54.995150 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9119d7cb-306a-4d98-a453-f123ab249419-serving-cert\") pod \"insights-operator-5c847dcfc4-6n7zw\" (UID: \"9119d7cb-306a-4d98-a453-f123ab249419\") " pod="openshift-insights/insights-operator-5c847dcfc4-6n7zw" Jul 02 20:33:54.995204 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:54.995178 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9119d7cb-306a-4d98-a453-f123ab249419-snapshots\") pod \"insights-operator-5c847dcfc4-6n7zw\" (UID: \"9119d7cb-306a-4d98-a453-f123ab249419\") " pod="openshift-insights/insights-operator-5c847dcfc4-6n7zw" Jul 02 20:33:54.995204 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:54.995197 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/27355627-e4c9-456a-9820-da0513c338db-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-lsjxx\" (UID: \"27355627-e4c9-456a-9820-da0513c338db\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lsjxx" Jul 02 20:33:54.995363 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:54.995250 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9119d7cb-306a-4d98-a453-f123ab249419-tmp\") pod \"insights-operator-5c847dcfc4-6n7zw\" (UID: \"9119d7cb-306a-4d98-a453-f123ab249419\") " pod="openshift-insights/insights-operator-5c847dcfc4-6n7zw" Jul 02 20:33:54.995363 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:54.995267 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb8qb\" (UniqueName: \"kubernetes.io/projected/27355627-e4c9-456a-9820-da0513c338db-kube-api-access-qb8qb\") pod \"service-ca-operator-5d46d9ffd4-lsjxx\" (UID: \"27355627-e4c9-456a-9820-da0513c338db\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lsjxx" Jul 02 20:33:54.995363 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:54.995284 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9119d7cb-306a-4d98-a453-f123ab249419-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-6n7zw\" (UID: \"9119d7cb-306a-4d98-a453-f123ab249419\") " pod="openshift-insights/insights-operator-5c847dcfc4-6n7zw" Jul 02 20:33:54.995363 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:54.995298 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/27355627-e4c9-456a-9820-da0513c338db-config\") pod \"service-ca-operator-5d46d9ffd4-lsjxx\" (UID: \"27355627-e4c9-456a-9820-da0513c338db\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lsjxx" Jul 02 20:33:55.012224 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.012196 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6bcf6499df-kdlwt"] Jul 02 20:33:55.014888 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.014873 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6bcf6499df-kdlwt" Jul 02 20:33:55.019135 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.019118 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 02 20:33:55.019307 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.019296 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 02 20:33:55.019689 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.019671 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 02 20:33:55.025463 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.025447 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-fcxxh\"" Jul 02 20:33:55.025862 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.025835 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 02 20:33:55.025924 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.025886 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 02 20:33:55.025968 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.025951 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 02 20:33:55.038369 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.038351 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6bcf6499df-kdlwt"] Jul 02 20:33:55.095879 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.095835 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9119d7cb-306a-4d98-a453-f123ab249419-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-6n7zw\" (UID: \"9119d7cb-306a-4d98-a453-f123ab249419\") " pod="openshift-insights/insights-operator-5c847dcfc4-6n7zw" Jul 02 20:33:55.095984 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.095894 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2dchw\" (UniqueName: \"kubernetes.io/projected/04592575-7bc0-4f9f-9396-e286c6b76413-kube-api-access-2dchw\") pod \"kube-storage-version-migrator-operator-846bf668f7-rjw76\" (UID: \"04592575-7bc0-4f9f-9396-e286c6b76413\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rjw76" Jul 02 20:33:55.095984 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.095932 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9119d7cb-306a-4d98-a453-f123ab249419-serving-cert\") pod \"insights-operator-5c847dcfc4-6n7zw\" (UID: \"9119d7cb-306a-4d98-a453-f123ab249419\") " pod="openshift-insights/insights-operator-5c847dcfc4-6n7zw" Jul 02 20:33:55.095984 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.095959 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/04592575-7bc0-4f9f-9396-e286c6b76413-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-rjw76\" (UID: \"04592575-7bc0-4f9f-9396-e286c6b76413\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rjw76" Jul 02 20:33:55.096082 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.096016 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9119d7cb-306a-4d98-a453-f123ab249419-snapshots\") pod \"insights-operator-5c847dcfc4-6n7zw\" (UID: \"9119d7cb-306a-4d98-a453-f123ab249419\") " pod="openshift-insights/insights-operator-5c847dcfc4-6n7zw" Jul 02 20:33:55.096082 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.096042 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/27355627-e4c9-456a-9820-da0513c338db-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-lsjxx\" (UID: \"27355627-e4c9-456a-9820-da0513c338db\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lsjxx" Jul 02 20:33:55.096152 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.096086 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/04592575-7bc0-4f9f-9396-e286c6b76413-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-rjw76\" (UID: \"04592575-7bc0-4f9f-9396-e286c6b76413\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rjw76" Jul 02 20:33:55.096152 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.096111 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9119d7cb-306a-4d98-a453-f123ab249419-tmp\") pod \"insights-operator-5c847dcfc4-6n7zw\" (UID: \"9119d7cb-306a-4d98-a453-f123ab249419\") " pod="openshift-insights/insights-operator-5c847dcfc4-6n7zw" Jul 02 20:33:55.096152 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.096140 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb8qb\" (UniqueName: \"kubernetes.io/projected/27355627-e4c9-456a-9820-da0513c338db-kube-api-access-qb8qb\") pod \"service-ca-operator-5d46d9ffd4-lsjxx\" (UID: \"27355627-e4c9-456a-9820-da0513c338db\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lsjxx" Jul 02 20:33:55.096300 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.096198 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9119d7cb-306a-4d98-a453-f123ab249419-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-6n7zw\" (UID: \"9119d7cb-306a-4d98-a453-f123ab249419\") " pod="openshift-insights/insights-operator-5c847dcfc4-6n7zw" Jul 02 20:33:55.096300 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.096240 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/27355627-e4c9-456a-9820-da0513c338db-config\") pod \"service-ca-operator-5d46d9ffd4-lsjxx\" (UID: \"27355627-e4c9-456a-9820-da0513c338db\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lsjxx" Jul 02 20:33:55.096300 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.096272 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4wtxj\" (UniqueName: \"kubernetes.io/projected/9119d7cb-306a-4d98-a453-f123ab249419-kube-api-access-4wtxj\") pod \"insights-operator-5c847dcfc4-6n7zw\" (UID: \"9119d7cb-306a-4d98-a453-f123ab249419\") " pod="openshift-insights/insights-operator-5c847dcfc4-6n7zw" Jul 02 20:33:55.096628 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.096604 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/9119d7cb-306a-4d98-a453-f123ab249419-snapshots\") pod \"insights-operator-5c847dcfc4-6n7zw\" (UID: \"9119d7cb-306a-4d98-a453-f123ab249419\") " pod="openshift-insights/insights-operator-5c847dcfc4-6n7zw" Jul 02 20:33:55.096735 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.096692 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9119d7cb-306a-4d98-a453-f123ab249419-tmp\") pod \"insights-operator-5c847dcfc4-6n7zw\" (UID: \"9119d7cb-306a-4d98-a453-f123ab249419\") " pod="openshift-insights/insights-operator-5c847dcfc4-6n7zw" Jul 02 20:33:55.096826 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.096803 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9119d7cb-306a-4d98-a453-f123ab249419-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-6n7zw\" (UID: \"9119d7cb-306a-4d98-a453-f123ab249419\") " pod="openshift-insights/insights-operator-5c847dcfc4-6n7zw" Jul 02 20:33:55.096964 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.096940 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9119d7cb-306a-4d98-a453-f123ab249419-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-6n7zw\" (UID: \"9119d7cb-306a-4d98-a453-f123ab249419\") " pod="openshift-insights/insights-operator-5c847dcfc4-6n7zw" Jul 02 20:33:55.096964 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.096957 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/27355627-e4c9-456a-9820-da0513c338db-config\") pod \"service-ca-operator-5d46d9ffd4-lsjxx\" (UID: \"27355627-e4c9-456a-9820-da0513c338db\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lsjxx" Jul 02 20:33:55.098347 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.098327 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/27355627-e4c9-456a-9820-da0513c338db-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-lsjxx\" (UID: \"27355627-e4c9-456a-9820-da0513c338db\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lsjxx" Jul 02 20:33:55.099012 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.098988 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9119d7cb-306a-4d98-a453-f123ab249419-serving-cert\") pod \"insights-operator-5c847dcfc4-6n7zw\" (UID: \"9119d7cb-306a-4d98-a453-f123ab249419\") " pod="openshift-insights/insights-operator-5c847dcfc4-6n7zw" Jul 02 20:33:55.105011 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.104992 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4wtxj\" (UniqueName: \"kubernetes.io/projected/9119d7cb-306a-4d98-a453-f123ab249419-kube-api-access-4wtxj\") pod \"insights-operator-5c847dcfc4-6n7zw\" (UID: \"9119d7cb-306a-4d98-a453-f123ab249419\") " pod="openshift-insights/insights-operator-5c847dcfc4-6n7zw" Jul 02 20:33:55.105196 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.105180 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb8qb\" (UniqueName: \"kubernetes.io/projected/27355627-e4c9-456a-9820-da0513c338db-kube-api-access-qb8qb\") pod \"service-ca-operator-5d46d9ffd4-lsjxx\" (UID: \"27355627-e4c9-456a-9820-da0513c338db\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lsjxx" Jul 02 20:33:55.197298 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.197246 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2dchw\" (UniqueName: \"kubernetes.io/projected/04592575-7bc0-4f9f-9396-e286c6b76413-kube-api-access-2dchw\") pod \"kube-storage-version-migrator-operator-846bf668f7-rjw76\" (UID: \"04592575-7bc0-4f9f-9396-e286c6b76413\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rjw76" Jul 02 20:33:55.197298 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.197275 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-stats-auth\") pod \"router-default-6bcf6499df-kdlwt\" (UID: \"23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3\") " pod="openshift-ingress/router-default-6bcf6499df-kdlwt" Jul 02 20:33:55.197430 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.197311 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-metrics-certs\") pod \"router-default-6bcf6499df-kdlwt\" (UID: \"23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3\") " pod="openshift-ingress/router-default-6bcf6499df-kdlwt" Jul 02 20:33:55.197430 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.197355 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/04592575-7bc0-4f9f-9396-e286c6b76413-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-rjw76\" (UID: \"04592575-7bc0-4f9f-9396-e286c6b76413\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rjw76" Jul 02 20:33:55.197533 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.197490 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/04592575-7bc0-4f9f-9396-e286c6b76413-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-rjw76\" (UID: \"04592575-7bc0-4f9f-9396-e286c6b76413\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rjw76" Jul 02 20:33:55.197590 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.197530 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-default-certificate\") pod \"router-default-6bcf6499df-kdlwt\" (UID: \"23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3\") " pod="openshift-ingress/router-default-6bcf6499df-kdlwt" Jul 02 20:33:55.197590 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.197565 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-service-ca-bundle\") pod \"router-default-6bcf6499df-kdlwt\" (UID: \"23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3\") " pod="openshift-ingress/router-default-6bcf6499df-kdlwt" Jul 02 20:33:55.197685 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.197595 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmq8t\" (UniqueName: \"kubernetes.io/projected/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-kube-api-access-lmq8t\") pod \"router-default-6bcf6499df-kdlwt\" (UID: \"23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3\") " pod="openshift-ingress/router-default-6bcf6499df-kdlwt" Jul 02 20:33:55.197832 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.197808 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/04592575-7bc0-4f9f-9396-e286c6b76413-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-rjw76\" (UID: \"04592575-7bc0-4f9f-9396-e286c6b76413\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rjw76" Jul 02 20:33:55.199316 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.199290 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/04592575-7bc0-4f9f-9396-e286c6b76413-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-rjw76\" (UID: \"04592575-7bc0-4f9f-9396-e286c6b76413\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rjw76" Jul 02 20:33:55.204880 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.204859 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lsjxx" Jul 02 20:33:55.205514 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.205493 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2dchw\" (UniqueName: \"kubernetes.io/projected/04592575-7bc0-4f9f-9396-e286c6b76413-kube-api-access-2dchw\") pod \"kube-storage-version-migrator-operator-846bf668f7-rjw76\" (UID: \"04592575-7bc0-4f9f-9396-e286c6b76413\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rjw76" Jul 02 20:33:55.211702 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.211685 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-6n7zw" Jul 02 20:33:55.218618 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.218596 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rjw76" Jul 02 20:33:55.298679 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.298159 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-default-certificate\") pod \"router-default-6bcf6499df-kdlwt\" (UID: \"23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3\") " pod="openshift-ingress/router-default-6bcf6499df-kdlwt" Jul 02 20:33:55.298679 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.298216 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-service-ca-bundle\") pod \"router-default-6bcf6499df-kdlwt\" (UID: \"23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3\") " pod="openshift-ingress/router-default-6bcf6499df-kdlwt" Jul 02 20:33:55.298679 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.298251 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmq8t\" (UniqueName: \"kubernetes.io/projected/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-kube-api-access-lmq8t\") pod \"router-default-6bcf6499df-kdlwt\" (UID: \"23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3\") " pod="openshift-ingress/router-default-6bcf6499df-kdlwt" Jul 02 20:33:55.298679 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.298305 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-stats-auth\") pod \"router-default-6bcf6499df-kdlwt\" (UID: \"23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3\") " pod="openshift-ingress/router-default-6bcf6499df-kdlwt" Jul 02 20:33:55.298679 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.298350 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-metrics-certs\") pod \"router-default-6bcf6499df-kdlwt\" (UID: \"23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3\") " pod="openshift-ingress/router-default-6bcf6499df-kdlwt" Jul 02 20:33:55.298679 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:55.298484 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 20:33:55.298679 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:55.298545 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-metrics-certs podName:23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:55.798525884 +0000 UTC m=+74.251446983 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-metrics-certs") pod "router-default-6bcf6499df-kdlwt" (UID: "23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3") : secret "router-metrics-certs-default" not found Jul 02 20:33:55.299560 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:55.299304 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-service-ca-bundle podName:23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:55.799282956 +0000 UTC m=+74.252204037 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-service-ca-bundle") pod "router-default-6bcf6499df-kdlwt" (UID: "23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3") : configmap references non-existent config key: service-ca.crt Jul 02 20:33:55.302117 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.301975 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-default-certificate\") pod \"router-default-6bcf6499df-kdlwt\" (UID: \"23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3\") " pod="openshift-ingress/router-default-6bcf6499df-kdlwt" Jul 02 20:33:55.303009 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.302976 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-stats-auth\") pod \"router-default-6bcf6499df-kdlwt\" (UID: \"23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3\") " pod="openshift-ingress/router-default-6bcf6499df-kdlwt" Jul 02 20:33:55.308192 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.308170 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmq8t\" (UniqueName: \"kubernetes.io/projected/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-kube-api-access-lmq8t\") pod \"router-default-6bcf6499df-kdlwt\" (UID: \"23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3\") " pod="openshift-ingress/router-default-6bcf6499df-kdlwt" Jul 02 20:33:55.350043 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.349969 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-6n7zw"] Jul 02 20:33:55.352687 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:33:55.352661 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9119d7cb_306a_4d98_a453_f123ab249419.slice/crio-9a547bb8bb13356f536e5f9a39e2255f7ee5b730ef939fd08eebd7e7c5f0a148 WatchSource:0}: Error finding container 9a547bb8bb13356f536e5f9a39e2255f7ee5b730ef939fd08eebd7e7c5f0a148: Status 404 returned error can't find the container with id 9a547bb8bb13356f536e5f9a39e2255f7ee5b730ef939fd08eebd7e7c5f0a148 Jul 02 20:33:55.567418 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.567340 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lsjxx"] Jul 02 20:33:55.569701 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:33:55.569677 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27355627_e4c9_456a_9820_da0513c338db.slice/crio-117a2cd2c14ad7aaf28134c8d6e4e5a8a186c02f68751cb079431329e472d446 WatchSource:0}: Error finding container 117a2cd2c14ad7aaf28134c8d6e4e5a8a186c02f68751cb079431329e472d446: Status 404 returned error can't find the container with id 117a2cd2c14ad7aaf28134c8d6e4e5a8a186c02f68751cb079431329e472d446 Jul 02 20:33:55.570080 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.570062 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rjw76"] Jul 02 20:33:55.572811 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:33:55.572786 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod04592575_7bc0_4f9f_9396_e286c6b76413.slice/crio-4ce5b031e40e2ef0bde4ec6d47178e27d0cba75bcbbafac683bb5d4180207ef4 WatchSource:0}: Error finding container 4ce5b031e40e2ef0bde4ec6d47178e27d0cba75bcbbafac683bb5d4180207ef4: Status 404 returned error can't find the container with id 4ce5b031e40e2ef0bde4ec6d47178e27d0cba75bcbbafac683bb5d4180207ef4 Jul 02 20:33:55.719296 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.719264 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rjw76" event={"ID":"04592575-7bc0-4f9f-9396-e286c6b76413","Type":"ContainerStarted","Data":"4ce5b031e40e2ef0bde4ec6d47178e27d0cba75bcbbafac683bb5d4180207ef4"} Jul 02 20:33:55.720308 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.720274 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-6n7zw" event={"ID":"9119d7cb-306a-4d98-a453-f123ab249419","Type":"ContainerStarted","Data":"9a547bb8bb13356f536e5f9a39e2255f7ee5b730ef939fd08eebd7e7c5f0a148"} Jul 02 20:33:55.721166 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.721149 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lsjxx" event={"ID":"27355627-e4c9-456a-9820-da0513c338db","Type":"ContainerStarted","Data":"117a2cd2c14ad7aaf28134c8d6e4e5a8a186c02f68751cb079431329e472d446"} Jul 02 20:33:55.802563 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.802530 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-service-ca-bundle\") pod \"router-default-6bcf6499df-kdlwt\" (UID: \"23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3\") " pod="openshift-ingress/router-default-6bcf6499df-kdlwt" Jul 02 20:33:55.802679 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:55.802585 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-metrics-certs\") pod \"router-default-6bcf6499df-kdlwt\" (UID: \"23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3\") " pod="openshift-ingress/router-default-6bcf6499df-kdlwt" Jul 02 20:33:55.802721 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:55.802680 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 20:33:55.802721 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:55.802691 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-service-ca-bundle podName:23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:56.802674333 +0000 UTC m=+75.255595431 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-service-ca-bundle") pod "router-default-6bcf6499df-kdlwt" (UID: "23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3") : configmap references non-existent config key: service-ca.crt Jul 02 20:33:55.802721 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:55.802720 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-metrics-certs podName:23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:56.802707259 +0000 UTC m=+75.255628336 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-metrics-certs") pod "router-default-6bcf6499df-kdlwt" (UID: "23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3") : secret "router-metrics-certs-default" not found Jul 02 20:33:56.812381 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:56.812312 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-metrics-certs\") pod \"router-default-6bcf6499df-kdlwt\" (UID: \"23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3\") " pod="openshift-ingress/router-default-6bcf6499df-kdlwt" Jul 02 20:33:56.812831 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:56.812419 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-service-ca-bundle\") pod \"router-default-6bcf6499df-kdlwt\" (UID: \"23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3\") " pod="openshift-ingress/router-default-6bcf6499df-kdlwt" Jul 02 20:33:56.812831 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:56.812467 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 20:33:56.812831 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:56.812531 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-metrics-certs podName:23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:58.812517553 +0000 UTC m=+77.265438629 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-metrics-certs") pod "router-default-6bcf6499df-kdlwt" (UID: "23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3") : secret "router-metrics-certs-default" not found Jul 02 20:33:56.812831 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:56.812546 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-service-ca-bundle podName:23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3 nodeName:}" failed. No retries permitted until 2026-07-02 20:33:58.812539661 +0000 UTC m=+77.265460737 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-service-ca-bundle") pod "router-default-6bcf6499df-kdlwt" (UID: "23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3") : configmap references non-existent config key: service-ca.crt Jul 02 20:33:58.731993 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:58.731948 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rjw76" event={"ID":"04592575-7bc0-4f9f-9396-e286c6b76413","Type":"ContainerStarted","Data":"32e318bd0aaca5b905fd7b305a7e6c6f267c4188faef33777bd2401f2401011b"} Jul 02 20:33:58.733620 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:58.733591 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-6n7zw" event={"ID":"9119d7cb-306a-4d98-a453-f123ab249419","Type":"ContainerStarted","Data":"bccbc84891d952db05ef54172e4313c9a80f8f2901d0073198b094feb0d4e83e"} Jul 02 20:33:58.735270 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:58.735240 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lsjxx" event={"ID":"27355627-e4c9-456a-9820-da0513c338db","Type":"ContainerStarted","Data":"6e7b2a1ae775645070d0d88c164e9bd07408f1cf5a0de0f44dd0426be04a491a"} Jul 02 20:33:58.747762 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:58.747713 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rjw76" podStartSLOduration=1.951029234 podStartE2EDuration="4.747695597s" totalImagesPullingTime="2.796666363s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:33:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:58.746162775 +0000 UTC m=+77.199083874" watchObservedRunningTime="2026-07-02 20:33:58.747695597 +0000 UTC m=+77.200616697" Jul 02 20:33:58.760431 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:58.760387 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lsjxx" podStartSLOduration=1.9556959 podStartE2EDuration="4.76036865s" totalImagesPullingTime="2.80467275s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:33:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:58.760084416 +0000 UTC m=+77.213005515" watchObservedRunningTime="2026-07-02 20:33:58.76036865 +0000 UTC m=+77.213289747" Jul 02 20:33:58.783016 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:58.782876 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-6n7zw" podStartSLOduration=1.763841679 podStartE2EDuration="4.782860868s" totalImagesPullingTime="3.019019189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:33:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:33:58.78214653 +0000 UTC m=+77.235067628" watchObservedRunningTime="2026-07-02 20:33:58.782860868 +0000 UTC m=+77.235781958" Jul 02 20:33:58.827736 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:58.827708 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-service-ca-bundle\") pod \"router-default-6bcf6499df-kdlwt\" (UID: \"23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3\") " pod="openshift-ingress/router-default-6bcf6499df-kdlwt" Jul 02 20:33:58.827863 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:33:58.827784 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-metrics-certs\") pod \"router-default-6bcf6499df-kdlwt\" (UID: \"23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3\") " pod="openshift-ingress/router-default-6bcf6499df-kdlwt" Jul 02 20:33:58.827935 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:58.827901 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 20:33:58.827935 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:58.827905 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-service-ca-bundle podName:23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:02.827884187 +0000 UTC m=+81.280805269 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-service-ca-bundle") pod "router-default-6bcf6499df-kdlwt" (UID: "23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3") : configmap references non-existent config key: service-ca.crt Jul 02 20:33:58.828047 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:33:58.827955 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-metrics-certs podName:23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:02.827940702 +0000 UTC m=+81.280861782 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-metrics-certs") pod "router-default-6bcf6499df-kdlwt" (UID: "23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3") : secret "router-metrics-certs-default" not found Jul 02 20:34:00.569706 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:00.569673 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-xlr9j"] Jul 02 20:34:00.573991 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:00.573964 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xlr9j" Jul 02 20:34:00.576424 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:00.576398 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 02 20:34:00.576542 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:00.576438 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 02 20:34:00.576782 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:00.576768 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-p6z6g\"" Jul 02 20:34:00.581290 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:00.581268 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xlr9j"] Jul 02 20:34:00.641746 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:00.641718 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xlr9j\" (UID: \"4588daf7-7cbc-4731-a3f5-de94d6fc9d60\") " pod="openshift-insights/insights-runtime-extractor-xlr9j" Jul 02 20:34:00.641908 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:00.641751 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xlr9j\" (UID: \"4588daf7-7cbc-4731-a3f5-de94d6fc9d60\") " pod="openshift-insights/insights-runtime-extractor-xlr9j" Jul 02 20:34:00.641908 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:00.641771 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ltqwj\" (UniqueName: \"kubernetes.io/projected/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-kube-api-access-ltqwj\") pod \"insights-runtime-extractor-xlr9j\" (UID: \"4588daf7-7cbc-4731-a3f5-de94d6fc9d60\") " pod="openshift-insights/insights-runtime-extractor-xlr9j" Jul 02 20:34:00.641908 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:00.641820 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-crio-socket\") pod \"insights-runtime-extractor-xlr9j\" (UID: \"4588daf7-7cbc-4731-a3f5-de94d6fc9d60\") " pod="openshift-insights/insights-runtime-extractor-xlr9j" Jul 02 20:34:00.642049 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:00.641950 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-data-volume\") pod \"insights-runtime-extractor-xlr9j\" (UID: \"4588daf7-7cbc-4731-a3f5-de94d6fc9d60\") " pod="openshift-insights/insights-runtime-extractor-xlr9j" Jul 02 20:34:00.742911 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:00.742881 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xlr9j\" (UID: \"4588daf7-7cbc-4731-a3f5-de94d6fc9d60\") " pod="openshift-insights/insights-runtime-extractor-xlr9j" Jul 02 20:34:00.742911 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:00.742916 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xlr9j\" (UID: \"4588daf7-7cbc-4731-a3f5-de94d6fc9d60\") " pod="openshift-insights/insights-runtime-extractor-xlr9j" Jul 02 20:34:00.743102 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:00.742932 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ltqwj\" (UniqueName: \"kubernetes.io/projected/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-kube-api-access-ltqwj\") pod \"insights-runtime-extractor-xlr9j\" (UID: \"4588daf7-7cbc-4731-a3f5-de94d6fc9d60\") " pod="openshift-insights/insights-runtime-extractor-xlr9j" Jul 02 20:34:00.743102 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:00.742954 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-crio-socket\") pod \"insights-runtime-extractor-xlr9j\" (UID: \"4588daf7-7cbc-4731-a3f5-de94d6fc9d60\") " pod="openshift-insights/insights-runtime-extractor-xlr9j" Jul 02 20:34:00.743102 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:34:00.743004 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 20:34:00.743102 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:00.743017 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-data-volume\") pod \"insights-runtime-extractor-xlr9j\" (UID: \"4588daf7-7cbc-4731-a3f5-de94d6fc9d60\") " pod="openshift-insights/insights-runtime-extractor-xlr9j" Jul 02 20:34:00.743102 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:34:00.743025 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 20:34:00.743102 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:34:00.743076 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-insights-runtime-extractor-tls podName:4588daf7-7cbc-4731-a3f5-de94d6fc9d60 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:01.243062119 +0000 UTC m=+79.695983196 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xlr9j" (UID: "4588daf7-7cbc-4731-a3f5-de94d6fc9d60") : secret "insights-runtime-extractor-tls" not found Jul 02 20:34:00.743102 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:34:00.743090 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-kube-rbac-proxy-cm podName:4588daf7-7cbc-4731-a3f5-de94d6fc9d60 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:01.243084255 +0000 UTC m=+79.696005331 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xlr9j" (UID: "4588daf7-7cbc-4731-a3f5-de94d6fc9d60") : configmap "kube-rbac-proxy" not found Jul 02 20:34:00.743353 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:00.743106 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-crio-socket\") pod \"insights-runtime-extractor-xlr9j\" (UID: \"4588daf7-7cbc-4731-a3f5-de94d6fc9d60\") " pod="openshift-insights/insights-runtime-extractor-xlr9j" Jul 02 20:34:00.743353 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:00.743304 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-data-volume\") pod \"insights-runtime-extractor-xlr9j\" (UID: \"4588daf7-7cbc-4731-a3f5-de94d6fc9d60\") " pod="openshift-insights/insights-runtime-extractor-xlr9j" Jul 02 20:34:00.751122 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:00.751094 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ltqwj\" (UniqueName: \"kubernetes.io/projected/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-kube-api-access-ltqwj\") pod \"insights-runtime-extractor-xlr9j\" (UID: \"4588daf7-7cbc-4731-a3f5-de94d6fc9d60\") " pod="openshift-insights/insights-runtime-extractor-xlr9j" Jul 02 20:34:01.245593 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:01.245560 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xlr9j\" (UID: \"4588daf7-7cbc-4731-a3f5-de94d6fc9d60\") " pod="openshift-insights/insights-runtime-extractor-xlr9j" Jul 02 20:34:01.245593 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:01.245597 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xlr9j\" (UID: \"4588daf7-7cbc-4731-a3f5-de94d6fc9d60\") " pod="openshift-insights/insights-runtime-extractor-xlr9j" Jul 02 20:34:01.245804 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:34:01.245678 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 20:34:01.245804 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:34:01.245696 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 20:34:01.245804 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:34:01.245749 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-insights-runtime-extractor-tls podName:4588daf7-7cbc-4731-a3f5-de94d6fc9d60 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:02.245735192 +0000 UTC m=+80.698656268 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xlr9j" (UID: "4588daf7-7cbc-4731-a3f5-de94d6fc9d60") : secret "insights-runtime-extractor-tls" not found Jul 02 20:34:01.245804 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:34:01.245765 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-kube-rbac-proxy-cm podName:4588daf7-7cbc-4731-a3f5-de94d6fc9d60 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:02.245756615 +0000 UTC m=+80.698677691 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xlr9j" (UID: "4588daf7-7cbc-4731-a3f5-de94d6fc9d60") : configmap "kube-rbac-proxy" not found Jul 02 20:34:02.253438 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:02.253393 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xlr9j\" (UID: \"4588daf7-7cbc-4731-a3f5-de94d6fc9d60\") " pod="openshift-insights/insights-runtime-extractor-xlr9j" Jul 02 20:34:02.253438 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:02.253445 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xlr9j\" (UID: \"4588daf7-7cbc-4731-a3f5-de94d6fc9d60\") " pod="openshift-insights/insights-runtime-extractor-xlr9j" Jul 02 20:34:02.253938 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:34:02.253513 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 20:34:02.253938 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:34:02.253590 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-kube-rbac-proxy-cm podName:4588daf7-7cbc-4731-a3f5-de94d6fc9d60 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:04.253570604 +0000 UTC m=+82.706491682 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xlr9j" (UID: "4588daf7-7cbc-4731-a3f5-de94d6fc9d60") : configmap "kube-rbac-proxy" not found Jul 02 20:34:02.253938 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:34:02.253605 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 20:34:02.253938 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:34:02.253648 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-insights-runtime-extractor-tls podName:4588daf7-7cbc-4731-a3f5-de94d6fc9d60 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:04.253634324 +0000 UTC m=+82.706555404 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xlr9j" (UID: "4588daf7-7cbc-4731-a3f5-de94d6fc9d60") : secret "insights-runtime-extractor-tls" not found Jul 02 20:34:02.342051 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:02.342018 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hlj5p_2f642606-1324-47e9-a987-6007d50f7707/dns-node-resolver/0.log" Jul 02 20:34:02.583876 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:02.583793 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-fdhhm"] Jul 02 20:34:02.586704 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:02.586683 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-fdhhm" Jul 02 20:34:02.589067 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:02.589049 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 02 20:34:02.589859 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:02.589826 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 02 20:34:02.589933 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:02.589904 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-74ppb\"" Jul 02 20:34:02.589933 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:02.589917 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 02 20:34:02.590026 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:02.589968 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 02 20:34:02.595440 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:02.595421 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-fdhhm"] Jul 02 20:34:02.656709 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:02.656679 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a7855b82-cf8f-42b4-8839-e6c2db6425c7-signing-key\") pod \"service-ca-758f599c5-fdhhm\" (UID: \"a7855b82-cf8f-42b4-8839-e6c2db6425c7\") " pod="openshift-service-ca/service-ca-758f599c5-fdhhm" Jul 02 20:34:02.656864 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:02.656788 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a7855b82-cf8f-42b4-8839-e6c2db6425c7-signing-cabundle\") pod \"service-ca-758f599c5-fdhhm\" (UID: \"a7855b82-cf8f-42b4-8839-e6c2db6425c7\") " pod="openshift-service-ca/service-ca-758f599c5-fdhhm" Jul 02 20:34:02.656864 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:02.656816 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5v7zb\" (UniqueName: \"kubernetes.io/projected/a7855b82-cf8f-42b4-8839-e6c2db6425c7-kube-api-access-5v7zb\") pod \"service-ca-758f599c5-fdhhm\" (UID: \"a7855b82-cf8f-42b4-8839-e6c2db6425c7\") " pod="openshift-service-ca/service-ca-758f599c5-fdhhm" Jul 02 20:34:02.757984 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:02.757959 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a7855b82-cf8f-42b4-8839-e6c2db6425c7-signing-key\") pod \"service-ca-758f599c5-fdhhm\" (UID: \"a7855b82-cf8f-42b4-8839-e6c2db6425c7\") " pod="openshift-service-ca/service-ca-758f599c5-fdhhm" Jul 02 20:34:02.758174 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:02.758081 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a7855b82-cf8f-42b4-8839-e6c2db6425c7-signing-cabundle\") pod \"service-ca-758f599c5-fdhhm\" (UID: \"a7855b82-cf8f-42b4-8839-e6c2db6425c7\") " pod="openshift-service-ca/service-ca-758f599c5-fdhhm" Jul 02 20:34:02.758174 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:02.758108 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5v7zb\" (UniqueName: \"kubernetes.io/projected/a7855b82-cf8f-42b4-8839-e6c2db6425c7-kube-api-access-5v7zb\") pod \"service-ca-758f599c5-fdhhm\" (UID: \"a7855b82-cf8f-42b4-8839-e6c2db6425c7\") " pod="openshift-service-ca/service-ca-758f599c5-fdhhm" Jul 02 20:34:02.758681 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:02.758660 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/a7855b82-cf8f-42b4-8839-e6c2db6425c7-signing-cabundle\") pod \"service-ca-758f599c5-fdhhm\" (UID: \"a7855b82-cf8f-42b4-8839-e6c2db6425c7\") " pod="openshift-service-ca/service-ca-758f599c5-fdhhm" Jul 02 20:34:02.760132 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:02.760115 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/a7855b82-cf8f-42b4-8839-e6c2db6425c7-signing-key\") pod \"service-ca-758f599c5-fdhhm\" (UID: \"a7855b82-cf8f-42b4-8839-e6c2db6425c7\") " pod="openshift-service-ca/service-ca-758f599c5-fdhhm" Jul 02 20:34:02.767310 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:02.767286 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5v7zb\" (UniqueName: \"kubernetes.io/projected/a7855b82-cf8f-42b4-8839-e6c2db6425c7-kube-api-access-5v7zb\") pod \"service-ca-758f599c5-fdhhm\" (UID: \"a7855b82-cf8f-42b4-8839-e6c2db6425c7\") " pod="openshift-service-ca/service-ca-758f599c5-fdhhm" Jul 02 20:34:02.858870 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:02.858795 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-metrics-certs\") pod \"router-default-6bcf6499df-kdlwt\" (UID: \"23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3\") " pod="openshift-ingress/router-default-6bcf6499df-kdlwt" Jul 02 20:34:02.858870 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:02.858867 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-service-ca-bundle\") pod \"router-default-6bcf6499df-kdlwt\" (UID: \"23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3\") " pod="openshift-ingress/router-default-6bcf6499df-kdlwt" Jul 02 20:34:02.858988 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:34:02.858930 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 20:34:02.858988 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:34:02.858981 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-service-ca-bundle podName:23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:10.858968205 +0000 UTC m=+89.311889281 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-service-ca-bundle") pod "router-default-6bcf6499df-kdlwt" (UID: "23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3") : configmap references non-existent config key: service-ca.crt Jul 02 20:34:02.859054 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:34:02.858997 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-metrics-certs podName:23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:10.858990797 +0000 UTC m=+89.311911873 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-metrics-certs") pod "router-default-6bcf6499df-kdlwt" (UID: "23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3") : secret "router-metrics-certs-default" not found Jul 02 20:34:02.894991 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:02.894971 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-fdhhm" Jul 02 20:34:03.013230 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:03.013203 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-fdhhm"] Jul 02 20:34:03.016034 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:34:03.015992 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7855b82_cf8f_42b4_8839_e6c2db6425c7.slice/crio-8829a5257c03c14cbab5eacc8f2948f44ea7ae56237770941edf9ed8dd25265b WatchSource:0}: Error finding container 8829a5257c03c14cbab5eacc8f2948f44ea7ae56237770941edf9ed8dd25265b: Status 404 returned error can't find the container with id 8829a5257c03c14cbab5eacc8f2948f44ea7ae56237770941edf9ed8dd25265b Jul 02 20:34:03.537478 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:03.537452 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q8p8n_b7d5983b-3afb-4507-abeb-871f909d6414/node-ca/0.log" Jul 02 20:34:03.753408 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:03.753376 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-fdhhm" event={"ID":"a7855b82-cf8f-42b4-8839-e6c2db6425c7","Type":"ContainerStarted","Data":"ea78c4aac813de22970a793c5b9f753b18a90bc35af56aab35ad7c4e652d4419"} Jul 02 20:34:03.753587 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:03.753436 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-fdhhm" event={"ID":"a7855b82-cf8f-42b4-8839-e6c2db6425c7","Type":"ContainerStarted","Data":"8829a5257c03c14cbab5eacc8f2948f44ea7ae56237770941edf9ed8dd25265b"} Jul 02 20:34:03.770025 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:03.769980 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-fdhhm" podStartSLOduration=1.769965686 podStartE2EDuration="1.769965686s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:34:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:03.769596509 +0000 UTC m=+82.222517618" watchObservedRunningTime="2026-07-02 20:34:03.769965686 +0000 UTC m=+82.222886780" Jul 02 20:34:04.271023 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:04.270899 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xlr9j\" (UID: \"4588daf7-7cbc-4731-a3f5-de94d6fc9d60\") " pod="openshift-insights/insights-runtime-extractor-xlr9j" Jul 02 20:34:04.271023 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:04.270938 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xlr9j\" (UID: \"4588daf7-7cbc-4731-a3f5-de94d6fc9d60\") " pod="openshift-insights/insights-runtime-extractor-xlr9j" Jul 02 20:34:04.271023 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:34:04.271018 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 20:34:04.271277 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:34:04.271046 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 20:34:04.271277 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:34:04.271081 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-kube-rbac-proxy-cm podName:4588daf7-7cbc-4731-a3f5-de94d6fc9d60 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:08.271062547 +0000 UTC m=+86.723983642 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xlr9j" (UID: "4588daf7-7cbc-4731-a3f5-de94d6fc9d60") : configmap "kube-rbac-proxy" not found Jul 02 20:34:04.271277 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:34:04.271098 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-insights-runtime-extractor-tls podName:4588daf7-7cbc-4731-a3f5-de94d6fc9d60 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:08.271089237 +0000 UTC m=+86.724010313 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xlr9j" (UID: "4588daf7-7cbc-4731-a3f5-de94d6fc9d60") : secret "insights-runtime-extractor-tls" not found Jul 02 20:34:04.539999 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:04.539925 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s2t78_a5763ddc-b57e-4b60-9779-a16c70e04461/serve-healthcheck-canary/0.log" Jul 02 20:34:08.299959 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:08.299923 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xlr9j\" (UID: \"4588daf7-7cbc-4731-a3f5-de94d6fc9d60\") " pod="openshift-insights/insights-runtime-extractor-xlr9j" Jul 02 20:34:08.299959 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:08.299957 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xlr9j\" (UID: \"4588daf7-7cbc-4731-a3f5-de94d6fc9d60\") " pod="openshift-insights/insights-runtime-extractor-xlr9j" Jul 02 20:34:08.300413 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:34:08.300044 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 20:34:08.300413 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:34:08.300064 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 20:34:08.300413 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:34:08.300107 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-insights-runtime-extractor-tls podName:4588daf7-7cbc-4731-a3f5-de94d6fc9d60 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:16.300094078 +0000 UTC m=+94.753015154 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-insights-runtime-extractor-tls") pod "insights-runtime-extractor-xlr9j" (UID: "4588daf7-7cbc-4731-a3f5-de94d6fc9d60") : secret "insights-runtime-extractor-tls" not found Jul 02 20:34:08.300413 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:34:08.300123 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-kube-rbac-proxy-cm podName:4588daf7-7cbc-4731-a3f5-de94d6fc9d60 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:16.300114957 +0000 UTC m=+94.753036034 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-kube-rbac-proxy-cm") pod "insights-runtime-extractor-xlr9j" (UID: "4588daf7-7cbc-4731-a3f5-de94d6fc9d60") : configmap "kube-rbac-proxy" not found Jul 02 20:34:10.922614 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:10.922583 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-metrics-certs\") pod \"router-default-6bcf6499df-kdlwt\" (UID: \"23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3\") " pod="openshift-ingress/router-default-6bcf6499df-kdlwt" Jul 02 20:34:10.923011 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:10.922633 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-service-ca-bundle\") pod \"router-default-6bcf6499df-kdlwt\" (UID: \"23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3\") " pod="openshift-ingress/router-default-6bcf6499df-kdlwt" Jul 02 20:34:10.923200 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:10.923183 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-service-ca-bundle\") pod \"router-default-6bcf6499df-kdlwt\" (UID: \"23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3\") " pod="openshift-ingress/router-default-6bcf6499df-kdlwt" Jul 02 20:34:10.924807 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:10.924788 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3-metrics-certs\") pod \"router-default-6bcf6499df-kdlwt\" (UID: \"23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3\") " pod="openshift-ingress/router-default-6bcf6499df-kdlwt" Jul 02 20:34:11.223367 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:11.223293 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6bcf6499df-kdlwt" Jul 02 20:34:11.344945 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:11.344919 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6bcf6499df-kdlwt"] Jul 02 20:34:11.348243 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:34:11.348218 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod23c9bbc2_b5d6_42c6_b5eb_c573692bb5b3.slice/crio-17327ab47bcf0d3fde230683b76767c0d11bfe5c66d66692eac1c11ac952067f WatchSource:0}: Error finding container 17327ab47bcf0d3fde230683b76767c0d11bfe5c66d66692eac1c11ac952067f: Status 404 returned error can't find the container with id 17327ab47bcf0d3fde230683b76767c0d11bfe5c66d66692eac1c11ac952067f Jul 02 20:34:11.784210 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:11.784173 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6bcf6499df-kdlwt" event={"ID":"23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3","Type":"ContainerStarted","Data":"3f88c7d50e15fb1d8b511ccd3237d2b5ccf32384622d54559b8ffcfcf7070297"} Jul 02 20:34:11.784378 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:11.784221 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6bcf6499df-kdlwt" event={"ID":"23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3","Type":"ContainerStarted","Data":"17327ab47bcf0d3fde230683b76767c0d11bfe5c66d66692eac1c11ac952067f"} Jul 02 20:34:11.803290 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:11.803235 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6bcf6499df-kdlwt" podStartSLOduration=17.803220267 podStartE2EDuration="17.803220267s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:33:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:11.802902635 +0000 UTC m=+90.255823738" watchObservedRunningTime="2026-07-02 20:34:11.803220267 +0000 UTC m=+90.256141364" Jul 02 20:34:12.224327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:12.224293 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6bcf6499df-kdlwt" Jul 02 20:34:12.226946 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:12.226925 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6bcf6499df-kdlwt" Jul 02 20:34:12.788062 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:12.788031 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6bcf6499df-kdlwt" Jul 02 20:34:12.789236 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:12.789215 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6bcf6499df-kdlwt" Jul 02 20:34:16.366987 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:16.366961 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xlr9j\" (UID: \"4588daf7-7cbc-4731-a3f5-de94d6fc9d60\") " pod="openshift-insights/insights-runtime-extractor-xlr9j" Jul 02 20:34:16.366987 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:16.366992 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xlr9j\" (UID: \"4588daf7-7cbc-4731-a3f5-de94d6fc9d60\") " pod="openshift-insights/insights-runtime-extractor-xlr9j" Jul 02 20:34:16.367456 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:16.367437 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-xlr9j\" (UID: \"4588daf7-7cbc-4731-a3f5-de94d6fc9d60\") " pod="openshift-insights/insights-runtime-extractor-xlr9j" Jul 02 20:34:16.369136 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:16.369117 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/4588daf7-7cbc-4731-a3f5-de94d6fc9d60-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-xlr9j\" (UID: \"4588daf7-7cbc-4731-a3f5-de94d6fc9d60\") " pod="openshift-insights/insights-runtime-extractor-xlr9j" Jul 02 20:34:16.483097 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:16.483063 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-xlr9j" Jul 02 20:34:16.611118 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:16.611076 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-xlr9j"] Jul 02 20:34:16.616171 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:34:16.616147 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4588daf7_7cbc_4731_a3f5_de94d6fc9d60.slice/crio-68fcb0696d72d1d9586b024278ca77e5501dd5ebff62e6ee94b24d7dd5593898 WatchSource:0}: Error finding container 68fcb0696d72d1d9586b024278ca77e5501dd5ebff62e6ee94b24d7dd5593898: Status 404 returned error can't find the container with id 68fcb0696d72d1d9586b024278ca77e5501dd5ebff62e6ee94b24d7dd5593898 Jul 02 20:34:16.799404 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:16.799370 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xlr9j" event={"ID":"4588daf7-7cbc-4731-a3f5-de94d6fc9d60","Type":"ContainerStarted","Data":"68fcb0696d72d1d9586b024278ca77e5501dd5ebff62e6ee94b24d7dd5593898"} Jul 02 20:34:20.818788 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:20.818715 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xlr9j" event={"ID":"4588daf7-7cbc-4731-a3f5-de94d6fc9d60","Type":"ContainerStarted","Data":"4248b2a5be8c1f7d275fdf5d9a068cc79c762be3f6397d1867a624f8010c4388"} Jul 02 20:34:21.305777 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:21.305732 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1705bb5f-096c-48a1-84ec-bd013e7d0349-metrics-tls\") pod \"dns-default-xmprk\" (UID: \"1705bb5f-096c-48a1-84ec-bd013e7d0349\") " pod="openshift-dns/dns-default-xmprk" Jul 02 20:34:21.308288 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:21.308266 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/1705bb5f-096c-48a1-84ec-bd013e7d0349-metrics-tls\") pod \"dns-default-xmprk\" (UID: \"1705bb5f-096c-48a1-84ec-bd013e7d0349\") " pod="openshift-dns/dns-default-xmprk" Jul 02 20:34:21.327991 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:21.327970 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w7dxd\"" Jul 02 20:34:21.336776 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:21.336762 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xmprk" Jul 02 20:34:21.479316 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:21.479290 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xmprk"] Jul 02 20:34:21.539658 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:34:21.539631 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1705bb5f_096c_48a1_84ec_bd013e7d0349.slice/crio-796dc64065918104588dbd91518412f94518ddf9600c633221b27355510c349f WatchSource:0}: Error finding container 796dc64065918104588dbd91518412f94518ddf9600c633221b27355510c349f: Status 404 returned error can't find the container with id 796dc64065918104588dbd91518412f94518ddf9600c633221b27355510c349f Jul 02 20:34:21.822567 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:21.822525 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xmprk" event={"ID":"1705bb5f-096c-48a1-84ec-bd013e7d0349","Type":"ContainerStarted","Data":"796dc64065918104588dbd91518412f94518ddf9600c633221b27355510c349f"} Jul 02 20:34:22.828153 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:22.828062 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xlr9j" event={"ID":"4588daf7-7cbc-4731-a3f5-de94d6fc9d60","Type":"ContainerStarted","Data":"bacd72c41ef54ba2c7fb9b7d4e906f2f07b88721a6dcdb49e2dbf51684dece2d"} Jul 02 20:34:23.717191 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:23.717112 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-65xk9" Jul 02 20:34:23.833870 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:23.833828 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xmprk" event={"ID":"1705bb5f-096c-48a1-84ec-bd013e7d0349","Type":"ContainerStarted","Data":"1242164824c349016491aa502c8dabf8a11a0ccd27831360cadb6907ef792b7a"} Jul 02 20:34:23.892733 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:23.892690 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-97476cf77-2ww79"] Jul 02 20:34:23.899301 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:23.899282 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-97476cf77-2ww79" Jul 02 20:34:23.902092 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:23.902069 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jul 02 20:34:23.902428 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:23.902232 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jul 02 20:34:23.902538 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:23.902479 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jul 02 20:34:23.905348 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:23.905323 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-h9hft"] Jul 02 20:34:23.905639 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:23.905618 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jul 02 20:34:23.912250 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:23.912228 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-h9hft" Jul 02 20:34:23.915336 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:23.915284 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 02 20:34:23.915433 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:23.915337 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-fg7lz\"" Jul 02 20:34:23.915433 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:23.915376 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 02 20:34:23.951764 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:23.951737 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-h9hft"] Jul 02 20:34:23.953905 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:23.953878 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-97476cf77-2ww79"] Jul 02 20:34:23.990150 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:23.990058 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-685bfb5f64-9spck"] Jul 02 20:34:23.996827 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:23.996797 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-9spck" Jul 02 20:34:23.999272 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:23.999247 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 02 20:34:23.999431 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:23.999398 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 02 20:34:23.999747 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:23.999731 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-cs7qn\"" Jul 02 20:34:24.010800 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.010745 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-9spck"] Jul 02 20:34:24.024635 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.024611 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6df6c84d95-l9gpq"] Jul 02 20:34:24.027517 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.027488 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqmtf\" (UniqueName: \"kubernetes.io/projected/7f91a98b-e345-4705-9559-3536ac92e10d-kube-api-access-wqmtf\") pod \"klusterlet-addon-workmgr-97476cf77-2ww79\" (UID: \"7f91a98b-e345-4705-9559-3536ac92e10d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-97476cf77-2ww79" Jul 02 20:34:24.027999 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.027588 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f91a98b-e345-4705-9559-3536ac92e10d-tmp\") pod \"klusterlet-addon-workmgr-97476cf77-2ww79\" (UID: \"7f91a98b-e345-4705-9559-3536ac92e10d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-97476cf77-2ww79" Jul 02 20:34:24.027999 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.027658 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e3e8f80d-94d0-41f1-aac8-7107b503496d-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-h9hft\" (UID: \"e3e8f80d-94d0-41f1-aac8-7107b503496d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-h9hft" Jul 02 20:34:24.027999 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.027864 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e3e8f80d-94d0-41f1-aac8-7107b503496d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-h9hft\" (UID: \"e3e8f80d-94d0-41f1-aac8-7107b503496d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-h9hft" Jul 02 20:34:24.027999 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.027911 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7f91a98b-e345-4705-9559-3536ac92e10d-klusterlet-config\") pod \"klusterlet-addon-workmgr-97476cf77-2ww79\" (UID: \"7f91a98b-e345-4705-9559-3536ac92e10d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-97476cf77-2ww79" Jul 02 20:34:24.033427 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.033408 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6df6c84d95-l9gpq" Jul 02 20:34:24.036892 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.036631 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-kxfdk\"" Jul 02 20:34:24.036892 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.036648 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 02 20:34:24.037045 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.036990 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 02 20:34:24.037045 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.037009 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 02 20:34:24.042922 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.042898 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 02 20:34:24.044183 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.044130 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6df6c84d95-l9gpq"] Jul 02 20:34:24.129269 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.129219 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f91a98b-e345-4705-9559-3536ac92e10d-tmp\") pod \"klusterlet-addon-workmgr-97476cf77-2ww79\" (UID: \"7f91a98b-e345-4705-9559-3536ac92e10d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-97476cf77-2ww79" Jul 02 20:34:24.129442 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.129350 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f82f44ef-89ff-44e6-a7c5-12b0e0fb3433-registry-tls\") pod \"image-registry-6df6c84d95-l9gpq\" (UID: \"f82f44ef-89ff-44e6-a7c5-12b0e0fb3433\") " pod="openshift-image-registry/image-registry-6df6c84d95-l9gpq" Jul 02 20:34:24.129442 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.129416 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tt9v8\" (UniqueName: \"kubernetes.io/projected/19fac57d-e5fc-4182-8cd3-60bd9a80d34f-kube-api-access-tt9v8\") pod \"downloads-685bfb5f64-9spck\" (UID: \"19fac57d-e5fc-4182-8cd3-60bd9a80d34f\") " pod="openshift-console/downloads-685bfb5f64-9spck" Jul 02 20:34:24.129562 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.129452 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e3e8f80d-94d0-41f1-aac8-7107b503496d-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-h9hft\" (UID: \"e3e8f80d-94d0-41f1-aac8-7107b503496d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-h9hft" Jul 02 20:34:24.129562 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.129479 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f82f44ef-89ff-44e6-a7c5-12b0e0fb3433-image-registry-private-configuration\") pod \"image-registry-6df6c84d95-l9gpq\" (UID: \"f82f44ef-89ff-44e6-a7c5-12b0e0fb3433\") " pod="openshift-image-registry/image-registry-6df6c84d95-l9gpq" Jul 02 20:34:24.129562 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.129541 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e3e8f80d-94d0-41f1-aac8-7107b503496d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-h9hft\" (UID: \"e3e8f80d-94d0-41f1-aac8-7107b503496d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-h9hft" Jul 02 20:34:24.129687 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.129571 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f82f44ef-89ff-44e6-a7c5-12b0e0fb3433-ca-trust-extracted\") pod \"image-registry-6df6c84d95-l9gpq\" (UID: \"f82f44ef-89ff-44e6-a7c5-12b0e0fb3433\") " pod="openshift-image-registry/image-registry-6df6c84d95-l9gpq" Jul 02 20:34:24.129687 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.129595 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f82f44ef-89ff-44e6-a7c5-12b0e0fb3433-registry-certificates\") pod \"image-registry-6df6c84d95-l9gpq\" (UID: \"f82f44ef-89ff-44e6-a7c5-12b0e0fb3433\") " pod="openshift-image-registry/image-registry-6df6c84d95-l9gpq" Jul 02 20:34:24.129687 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.129621 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f82f44ef-89ff-44e6-a7c5-12b0e0fb3433-installation-pull-secrets\") pod \"image-registry-6df6c84d95-l9gpq\" (UID: \"f82f44ef-89ff-44e6-a7c5-12b0e0fb3433\") " pod="openshift-image-registry/image-registry-6df6c84d95-l9gpq" Jul 02 20:34:24.129687 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.129623 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f91a98b-e345-4705-9559-3536ac92e10d-tmp\") pod \"klusterlet-addon-workmgr-97476cf77-2ww79\" (UID: \"7f91a98b-e345-4705-9559-3536ac92e10d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-97476cf77-2ww79" Jul 02 20:34:24.129687 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.129647 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f82f44ef-89ff-44e6-a7c5-12b0e0fb3433-trusted-ca\") pod \"image-registry-6df6c84d95-l9gpq\" (UID: \"f82f44ef-89ff-44e6-a7c5-12b0e0fb3433\") " pod="openshift-image-registry/image-registry-6df6c84d95-l9gpq" Jul 02 20:34:24.129959 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.129700 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7f91a98b-e345-4705-9559-3536ac92e10d-klusterlet-config\") pod \"klusterlet-addon-workmgr-97476cf77-2ww79\" (UID: \"7f91a98b-e345-4705-9559-3536ac92e10d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-97476cf77-2ww79" Jul 02 20:34:24.129959 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.129734 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f82f44ef-89ff-44e6-a7c5-12b0e0fb3433-bound-sa-token\") pod \"image-registry-6df6c84d95-l9gpq\" (UID: \"f82f44ef-89ff-44e6-a7c5-12b0e0fb3433\") " pod="openshift-image-registry/image-registry-6df6c84d95-l9gpq" Jul 02 20:34:24.129959 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.129770 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-255pd\" (UniqueName: \"kubernetes.io/projected/f82f44ef-89ff-44e6-a7c5-12b0e0fb3433-kube-api-access-255pd\") pod \"image-registry-6df6c84d95-l9gpq\" (UID: \"f82f44ef-89ff-44e6-a7c5-12b0e0fb3433\") " pod="openshift-image-registry/image-registry-6df6c84d95-l9gpq" Jul 02 20:34:24.129959 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.129795 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqmtf\" (UniqueName: \"kubernetes.io/projected/7f91a98b-e345-4705-9559-3536ac92e10d-kube-api-access-wqmtf\") pod \"klusterlet-addon-workmgr-97476cf77-2ww79\" (UID: \"7f91a98b-e345-4705-9559-3536ac92e10d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-97476cf77-2ww79" Jul 02 20:34:24.131189 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.131097 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/e3e8f80d-94d0-41f1-aac8-7107b503496d-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-h9hft\" (UID: \"e3e8f80d-94d0-41f1-aac8-7107b503496d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-h9hft" Jul 02 20:34:24.137422 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.137400 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/e3e8f80d-94d0-41f1-aac8-7107b503496d-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-h9hft\" (UID: \"e3e8f80d-94d0-41f1-aac8-7107b503496d\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-h9hft" Jul 02 20:34:24.137594 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.137516 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/7f91a98b-e345-4705-9559-3536ac92e10d-klusterlet-config\") pod \"klusterlet-addon-workmgr-97476cf77-2ww79\" (UID: \"7f91a98b-e345-4705-9559-3536ac92e10d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-97476cf77-2ww79" Jul 02 20:34:24.139654 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.139612 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqmtf\" (UniqueName: \"kubernetes.io/projected/7f91a98b-e345-4705-9559-3536ac92e10d-kube-api-access-wqmtf\") pod \"klusterlet-addon-workmgr-97476cf77-2ww79\" (UID: \"7f91a98b-e345-4705-9559-3536ac92e10d\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-97476cf77-2ww79" Jul 02 20:34:24.211978 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.211907 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-97476cf77-2ww79" Jul 02 20:34:24.224382 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.224355 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-h9hft" Jul 02 20:34:24.230345 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.230319 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f82f44ef-89ff-44e6-a7c5-12b0e0fb3433-registry-tls\") pod \"image-registry-6df6c84d95-l9gpq\" (UID: \"f82f44ef-89ff-44e6-a7c5-12b0e0fb3433\") " pod="openshift-image-registry/image-registry-6df6c84d95-l9gpq" Jul 02 20:34:24.230467 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.230366 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tt9v8\" (UniqueName: \"kubernetes.io/projected/19fac57d-e5fc-4182-8cd3-60bd9a80d34f-kube-api-access-tt9v8\") pod \"downloads-685bfb5f64-9spck\" (UID: \"19fac57d-e5fc-4182-8cd3-60bd9a80d34f\") " pod="openshift-console/downloads-685bfb5f64-9spck" Jul 02 20:34:24.230467 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.230396 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f82f44ef-89ff-44e6-a7c5-12b0e0fb3433-image-registry-private-configuration\") pod \"image-registry-6df6c84d95-l9gpq\" (UID: \"f82f44ef-89ff-44e6-a7c5-12b0e0fb3433\") " pod="openshift-image-registry/image-registry-6df6c84d95-l9gpq" Jul 02 20:34:24.230579 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.230466 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f82f44ef-89ff-44e6-a7c5-12b0e0fb3433-ca-trust-extracted\") pod \"image-registry-6df6c84d95-l9gpq\" (UID: \"f82f44ef-89ff-44e6-a7c5-12b0e0fb3433\") " pod="openshift-image-registry/image-registry-6df6c84d95-l9gpq" Jul 02 20:34:24.230579 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.230490 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f82f44ef-89ff-44e6-a7c5-12b0e0fb3433-registry-certificates\") pod \"image-registry-6df6c84d95-l9gpq\" (UID: \"f82f44ef-89ff-44e6-a7c5-12b0e0fb3433\") " pod="openshift-image-registry/image-registry-6df6c84d95-l9gpq" Jul 02 20:34:24.230579 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.230516 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f82f44ef-89ff-44e6-a7c5-12b0e0fb3433-installation-pull-secrets\") pod \"image-registry-6df6c84d95-l9gpq\" (UID: \"f82f44ef-89ff-44e6-a7c5-12b0e0fb3433\") " pod="openshift-image-registry/image-registry-6df6c84d95-l9gpq" Jul 02 20:34:24.230579 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.230544 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f82f44ef-89ff-44e6-a7c5-12b0e0fb3433-trusted-ca\") pod \"image-registry-6df6c84d95-l9gpq\" (UID: \"f82f44ef-89ff-44e6-a7c5-12b0e0fb3433\") " pod="openshift-image-registry/image-registry-6df6c84d95-l9gpq" Jul 02 20:34:24.230763 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.230584 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f82f44ef-89ff-44e6-a7c5-12b0e0fb3433-bound-sa-token\") pod \"image-registry-6df6c84d95-l9gpq\" (UID: \"f82f44ef-89ff-44e6-a7c5-12b0e0fb3433\") " pod="openshift-image-registry/image-registry-6df6c84d95-l9gpq" Jul 02 20:34:24.230763 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.230617 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-255pd\" (UniqueName: \"kubernetes.io/projected/f82f44ef-89ff-44e6-a7c5-12b0e0fb3433-kube-api-access-255pd\") pod \"image-registry-6df6c84d95-l9gpq\" (UID: \"f82f44ef-89ff-44e6-a7c5-12b0e0fb3433\") " pod="openshift-image-registry/image-registry-6df6c84d95-l9gpq" Jul 02 20:34:24.231474 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.231446 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f82f44ef-89ff-44e6-a7c5-12b0e0fb3433-ca-trust-extracted\") pod \"image-registry-6df6c84d95-l9gpq\" (UID: \"f82f44ef-89ff-44e6-a7c5-12b0e0fb3433\") " pod="openshift-image-registry/image-registry-6df6c84d95-l9gpq" Jul 02 20:34:24.231575 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.231504 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f82f44ef-89ff-44e6-a7c5-12b0e0fb3433-registry-certificates\") pod \"image-registry-6df6c84d95-l9gpq\" (UID: \"f82f44ef-89ff-44e6-a7c5-12b0e0fb3433\") " pod="openshift-image-registry/image-registry-6df6c84d95-l9gpq" Jul 02 20:34:24.231773 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.231716 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f82f44ef-89ff-44e6-a7c5-12b0e0fb3433-trusted-ca\") pod \"image-registry-6df6c84d95-l9gpq\" (UID: \"f82f44ef-89ff-44e6-a7c5-12b0e0fb3433\") " pod="openshift-image-registry/image-registry-6df6c84d95-l9gpq" Jul 02 20:34:24.234240 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.234218 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f82f44ef-89ff-44e6-a7c5-12b0e0fb3433-registry-tls\") pod \"image-registry-6df6c84d95-l9gpq\" (UID: \"f82f44ef-89ff-44e6-a7c5-12b0e0fb3433\") " pod="openshift-image-registry/image-registry-6df6c84d95-l9gpq" Jul 02 20:34:24.234336 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.234268 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f82f44ef-89ff-44e6-a7c5-12b0e0fb3433-installation-pull-secrets\") pod \"image-registry-6df6c84d95-l9gpq\" (UID: \"f82f44ef-89ff-44e6-a7c5-12b0e0fb3433\") " pod="openshift-image-registry/image-registry-6df6c84d95-l9gpq" Jul 02 20:34:24.235102 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.235074 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f82f44ef-89ff-44e6-a7c5-12b0e0fb3433-image-registry-private-configuration\") pod \"image-registry-6df6c84d95-l9gpq\" (UID: \"f82f44ef-89ff-44e6-a7c5-12b0e0fb3433\") " pod="openshift-image-registry/image-registry-6df6c84d95-l9gpq" Jul 02 20:34:24.241799 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.241680 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tt9v8\" (UniqueName: \"kubernetes.io/projected/19fac57d-e5fc-4182-8cd3-60bd9a80d34f-kube-api-access-tt9v8\") pod \"downloads-685bfb5f64-9spck\" (UID: \"19fac57d-e5fc-4182-8cd3-60bd9a80d34f\") " pod="openshift-console/downloads-685bfb5f64-9spck" Jul 02 20:34:24.242301 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.242221 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-255pd\" (UniqueName: \"kubernetes.io/projected/f82f44ef-89ff-44e6-a7c5-12b0e0fb3433-kube-api-access-255pd\") pod \"image-registry-6df6c84d95-l9gpq\" (UID: \"f82f44ef-89ff-44e6-a7c5-12b0e0fb3433\") " pod="openshift-image-registry/image-registry-6df6c84d95-l9gpq" Jul 02 20:34:24.243052 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.243002 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f82f44ef-89ff-44e6-a7c5-12b0e0fb3433-bound-sa-token\") pod \"image-registry-6df6c84d95-l9gpq\" (UID: \"f82f44ef-89ff-44e6-a7c5-12b0e0fb3433\") " pod="openshift-image-registry/image-registry-6df6c84d95-l9gpq" Jul 02 20:34:24.307191 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.307152 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-685bfb5f64-9spck" Jul 02 20:34:24.346112 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.346077 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6df6c84d95-l9gpq" Jul 02 20:34:24.842329 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.841821 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-xlr9j" event={"ID":"4588daf7-7cbc-4731-a3f5-de94d6fc9d60","Type":"ContainerStarted","Data":"05b09f886c9bb0388f9383d617790569ef85e0e1c136f74754360cbbd13924fa"} Jul 02 20:34:24.844029 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.844006 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xmprk" event={"ID":"1705bb5f-096c-48a1-84ec-bd013e7d0349","Type":"ContainerStarted","Data":"a8d65cee88939c3b08f9a955e7c594f405cc7f19db2d926b76ca861f7e58b8ba"} Jul 02 20:34:24.844226 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.844211 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xmprk" Jul 02 20:34:24.851277 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.851229 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-685bfb5f64-9spck"] Jul 02 20:34:24.860154 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.859609 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-xlr9j" podStartSLOduration=16.957106163 podStartE2EDuration="24.859591847s" totalImagesPullingTime="7.902485684s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:34:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:24.858629751 +0000 UTC m=+103.311550850" watchObservedRunningTime="2026-07-02 20:34:24.859591847 +0000 UTC m=+103.312512947" Jul 02 20:34:24.870270 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.870248 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-h9hft"] Jul 02 20:34:24.874054 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:34:24.874031 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode3e8f80d_94d0_41f1_aac8_7107b503496d.slice/crio-b01ea9c75e42177f4116571f4861e7d5456c30792c719e1a08e667c1eacea814 WatchSource:0}: Error finding container b01ea9c75e42177f4116571f4861e7d5456c30792c719e1a08e667c1eacea814: Status 404 returned error can't find the container with id b01ea9c75e42177f4116571f4861e7d5456c30792c719e1a08e667c1eacea814 Jul 02 20:34:24.875455 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:24.875420 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xmprk" podStartSLOduration=66.014096142 podStartE2EDuration="1m7.875406655s" totalImagesPullingTime="1.861310513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:33:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:24.87484203 +0000 UTC m=+103.327763128" watchObservedRunningTime="2026-07-02 20:34:24.875406655 +0000 UTC m=+103.328327752" Jul 02 20:34:25.099284 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:25.099262 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-97476cf77-2ww79"] Jul 02 20:34:25.101677 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:34:25.101649 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7f91a98b_e345_4705_9559_3536ac92e10d.slice/crio-cdafc63b3e96b01cc39efeb7941b41c58df0585a5fdcc64c7a992b9d44f95e4e WatchSource:0}: Error finding container cdafc63b3e96b01cc39efeb7941b41c58df0585a5fdcc64c7a992b9d44f95e4e: Status 404 returned error can't find the container with id cdafc63b3e96b01cc39efeb7941b41c58df0585a5fdcc64c7a992b9d44f95e4e Jul 02 20:34:25.102604 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:25.102576 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6df6c84d95-l9gpq"] Jul 02 20:34:25.104974 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:34:25.104952 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf82f44ef_89ff_44e6_a7c5_12b0e0fb3433.slice/crio-7681aeac7d55cb6cf3250ba5830fc0310468eff61c12690d4f2bad82bb8e598a WatchSource:0}: Error finding container 7681aeac7d55cb6cf3250ba5830fc0310468eff61c12690d4f2bad82bb8e598a: Status 404 returned error can't find the container with id 7681aeac7d55cb6cf3250ba5830fc0310468eff61c12690d4f2bad82bb8e598a Jul 02 20:34:25.849183 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:25.849141 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-9spck" event={"ID":"19fac57d-e5fc-4182-8cd3-60bd9a80d34f","Type":"ContainerStarted","Data":"e32d362e6edf2365c122495e95bfe593e4dba5eb238c6c72e2e1fe9b62c2529e"} Jul 02 20:34:25.850469 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:25.850434 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-97476cf77-2ww79" event={"ID":"7f91a98b-e345-4705-9559-3536ac92e10d","Type":"ContainerStarted","Data":"cdafc63b3e96b01cc39efeb7941b41c58df0585a5fdcc64c7a992b9d44f95e4e"} Jul 02 20:34:25.851681 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:25.851651 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-h9hft" event={"ID":"e3e8f80d-94d0-41f1-aac8-7107b503496d","Type":"ContainerStarted","Data":"b01ea9c75e42177f4116571f4861e7d5456c30792c719e1a08e667c1eacea814"} Jul 02 20:34:25.853741 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:25.853711 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6df6c84d95-l9gpq" event={"ID":"f82f44ef-89ff-44e6-a7c5-12b0e0fb3433","Type":"ContainerStarted","Data":"0d013de6a3ca8d160febd27c109089dcec47cd0c05fe8f1f88cf9435c02ae17b"} Jul 02 20:34:25.853834 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:25.853760 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6df6c84d95-l9gpq" event={"ID":"f82f44ef-89ff-44e6-a7c5-12b0e0fb3433","Type":"ContainerStarted","Data":"7681aeac7d55cb6cf3250ba5830fc0310468eff61c12690d4f2bad82bb8e598a"} Jul 02 20:34:25.872513 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:25.872455 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6df6c84d95-l9gpq" podStartSLOduration=1.8724368679999999 podStartE2EDuration="1.872436868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:34:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:25.871920097 +0000 UTC m=+104.324841195" watchObservedRunningTime="2026-07-02 20:34:25.872436868 +0000 UTC m=+104.325357975" Jul 02 20:34:26.863888 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:26.863756 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-h9hft" event={"ID":"e3e8f80d-94d0-41f1-aac8-7107b503496d","Type":"ContainerStarted","Data":"9a9cf48433da351a908e08e71d9958005ef0bcb1c1fdefdd116da244d1ab3c76"} Jul 02 20:34:26.864306 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:26.864157 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6df6c84d95-l9gpq" Jul 02 20:34:26.880261 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:26.880204 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-h9hft" podStartSLOduration=2.478724392 podStartE2EDuration="3.880184095s" totalImagesPullingTime="1.401459703s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:26.878368139 +0000 UTC m=+105.331289238" watchObservedRunningTime="2026-07-02 20:34:26.880184095 +0000 UTC m=+105.333105196" Jul 02 20:34:34.856835 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:34.856771 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xmprk" Jul 02 20:34:35.901232 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:35.901196 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-97476cf77-2ww79" event={"ID":"7f91a98b-e345-4705-9559-3536ac92e10d","Type":"ContainerStarted","Data":"7def743dc43e548b6da0e517b2b62162483449c13f08903bdef838490c861b42"} Jul 02 20:34:35.901692 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:35.901349 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-97476cf77-2ww79" Jul 02 20:34:35.903205 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:35.903184 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-97476cf77-2ww79" Jul 02 20:34:35.918819 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:35.918733 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-97476cf77-2ww79" podStartSLOduration=2.593865441 podStartE2EDuration="12.918714274s" totalImagesPullingTime="10.324848833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:35.918438871 +0000 UTC m=+114.371359970" watchObservedRunningTime="2026-07-02 20:34:35.918714274 +0000 UTC m=+114.371635372" Jul 02 20:34:38.490246 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.488802 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-c99pw"] Jul 02 20:34:38.493500 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.493467 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-47sv5"] Jul 02 20:34:38.493636 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.493616 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-c99pw" Jul 02 20:34:38.502470 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.499275 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 02 20:34:38.502470 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.500057 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 02 20:34:38.502470 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.501171 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 02 20:34:38.502470 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.501367 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 02 20:34:38.502470 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.501761 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-4q4jw\"" Jul 02 20:34:38.502470 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.502017 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 02 20:34:38.510321 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.505569 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-47sv5" Jul 02 20:34:38.510321 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.509119 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-c99pw"] Jul 02 20:34:38.510321 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.509381 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 02 20:34:38.510321 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.509513 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-l8f5g\"" Jul 02 20:34:38.510321 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.509606 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 02 20:34:38.510321 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.509635 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 02 20:34:38.510321 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.509957 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 02 20:34:38.660631 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.660601 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jmv7x\" (UniqueName: \"kubernetes.io/projected/93ba4cee-8bca-48f6-8ae3-5b69ee3967f3-kube-api-access-jmv7x\") pod \"node-exporter-47sv5\" (UID: \"93ba4cee-8bca-48f6-8ae3-5b69ee3967f3\") " pod="openshift-monitoring/node-exporter-47sv5" Jul 02 20:34:38.660811 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.660638 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/93ba4cee-8bca-48f6-8ae3-5b69ee3967f3-node-exporter-accelerators-collector-config\") pod \"node-exporter-47sv5\" (UID: \"93ba4cee-8bca-48f6-8ae3-5b69ee3967f3\") " pod="openshift-monitoring/node-exporter-47sv5" Jul 02 20:34:38.660811 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.660675 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ee7e6d8-0e22-4375-9960-f84947ae2770-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-c99pw\" (UID: \"0ee7e6d8-0e22-4375-9960-f84947ae2770\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-c99pw" Jul 02 20:34:38.660811 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.660693 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/93ba4cee-8bca-48f6-8ae3-5b69ee3967f3-node-exporter-textfile\") pod \"node-exporter-47sv5\" (UID: \"93ba4cee-8bca-48f6-8ae3-5b69ee3967f3\") " pod="openshift-monitoring/node-exporter-47sv5" Jul 02 20:34:38.660811 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.660708 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93ba4cee-8bca-48f6-8ae3-5b69ee3967f3-sys\") pod \"node-exporter-47sv5\" (UID: \"93ba4cee-8bca-48f6-8ae3-5b69ee3967f3\") " pod="openshift-monitoring/node-exporter-47sv5" Jul 02 20:34:38.660811 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.660729 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ee7e6d8-0e22-4375-9960-f84947ae2770-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-c99pw\" (UID: \"0ee7e6d8-0e22-4375-9960-f84947ae2770\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-c99pw" Jul 02 20:34:38.660811 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.660745 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0ee7e6d8-0e22-4375-9960-f84947ae2770-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-c99pw\" (UID: \"0ee7e6d8-0e22-4375-9960-f84947ae2770\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-c99pw" Jul 02 20:34:38.660811 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.660759 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/93ba4cee-8bca-48f6-8ae3-5b69ee3967f3-root\") pod \"node-exporter-47sv5\" (UID: \"93ba4cee-8bca-48f6-8ae3-5b69ee3967f3\") " pod="openshift-monitoring/node-exporter-47sv5" Jul 02 20:34:38.660811 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.660773 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93ba4cee-8bca-48f6-8ae3-5b69ee3967f3-metrics-client-ca\") pod \"node-exporter-47sv5\" (UID: \"93ba4cee-8bca-48f6-8ae3-5b69ee3967f3\") " pod="openshift-monitoring/node-exporter-47sv5" Jul 02 20:34:38.660811 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.660792 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/93ba4cee-8bca-48f6-8ae3-5b69ee3967f3-node-exporter-wtmp\") pod \"node-exporter-47sv5\" (UID: \"93ba4cee-8bca-48f6-8ae3-5b69ee3967f3\") " pod="openshift-monitoring/node-exporter-47sv5" Jul 02 20:34:38.660811 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.660811 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0ee7e6d8-0e22-4375-9960-f84947ae2770-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-c99pw\" (UID: \"0ee7e6d8-0e22-4375-9960-f84947ae2770\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-c99pw" Jul 02 20:34:38.661326 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.660826 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ee7e6d8-0e22-4375-9960-f84947ae2770-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-c99pw\" (UID: \"0ee7e6d8-0e22-4375-9960-f84947ae2770\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-c99pw" Jul 02 20:34:38.661326 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.660920 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/93ba4cee-8bca-48f6-8ae3-5b69ee3967f3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-47sv5\" (UID: \"93ba4cee-8bca-48f6-8ae3-5b69ee3967f3\") " pod="openshift-monitoring/node-exporter-47sv5" Jul 02 20:34:38.661326 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.660964 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qmbcj\" (UniqueName: \"kubernetes.io/projected/0ee7e6d8-0e22-4375-9960-f84947ae2770-kube-api-access-qmbcj\") pod \"kube-state-metrics-7c9dbb8b7d-c99pw\" (UID: \"0ee7e6d8-0e22-4375-9960-f84947ae2770\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-c99pw" Jul 02 20:34:38.661326 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.661009 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/93ba4cee-8bca-48f6-8ae3-5b69ee3967f3-node-exporter-tls\") pod \"node-exporter-47sv5\" (UID: \"93ba4cee-8bca-48f6-8ae3-5b69ee3967f3\") " pod="openshift-monitoring/node-exporter-47sv5" Jul 02 20:34:38.762296 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.762218 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qmbcj\" (UniqueName: \"kubernetes.io/projected/0ee7e6d8-0e22-4375-9960-f84947ae2770-kube-api-access-qmbcj\") pod \"kube-state-metrics-7c9dbb8b7d-c99pw\" (UID: \"0ee7e6d8-0e22-4375-9960-f84947ae2770\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-c99pw" Jul 02 20:34:38.762296 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.762282 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/93ba4cee-8bca-48f6-8ae3-5b69ee3967f3-node-exporter-tls\") pod \"node-exporter-47sv5\" (UID: \"93ba4cee-8bca-48f6-8ae3-5b69ee3967f3\") " pod="openshift-monitoring/node-exporter-47sv5" Jul 02 20:34:38.762503 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.762317 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jmv7x\" (UniqueName: \"kubernetes.io/projected/93ba4cee-8bca-48f6-8ae3-5b69ee3967f3-kube-api-access-jmv7x\") pod \"node-exporter-47sv5\" (UID: \"93ba4cee-8bca-48f6-8ae3-5b69ee3967f3\") " pod="openshift-monitoring/node-exporter-47sv5" Jul 02 20:34:38.762503 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.762351 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/93ba4cee-8bca-48f6-8ae3-5b69ee3967f3-node-exporter-accelerators-collector-config\") pod \"node-exporter-47sv5\" (UID: \"93ba4cee-8bca-48f6-8ae3-5b69ee3967f3\") " pod="openshift-monitoring/node-exporter-47sv5" Jul 02 20:34:38.762503 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.762397 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ee7e6d8-0e22-4375-9960-f84947ae2770-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-c99pw\" (UID: \"0ee7e6d8-0e22-4375-9960-f84947ae2770\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-c99pw" Jul 02 20:34:38.762503 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.762420 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/93ba4cee-8bca-48f6-8ae3-5b69ee3967f3-node-exporter-textfile\") pod \"node-exporter-47sv5\" (UID: \"93ba4cee-8bca-48f6-8ae3-5b69ee3967f3\") " pod="openshift-monitoring/node-exporter-47sv5" Jul 02 20:34:38.762503 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.762445 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93ba4cee-8bca-48f6-8ae3-5b69ee3967f3-sys\") pod \"node-exporter-47sv5\" (UID: \"93ba4cee-8bca-48f6-8ae3-5b69ee3967f3\") " pod="openshift-monitoring/node-exporter-47sv5" Jul 02 20:34:38.762503 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.762472 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ee7e6d8-0e22-4375-9960-f84947ae2770-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-c99pw\" (UID: \"0ee7e6d8-0e22-4375-9960-f84947ae2770\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-c99pw" Jul 02 20:34:38.762503 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.762495 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0ee7e6d8-0e22-4375-9960-f84947ae2770-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-c99pw\" (UID: \"0ee7e6d8-0e22-4375-9960-f84947ae2770\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-c99pw" Jul 02 20:34:38.762871 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.762519 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/93ba4cee-8bca-48f6-8ae3-5b69ee3967f3-root\") pod \"node-exporter-47sv5\" (UID: \"93ba4cee-8bca-48f6-8ae3-5b69ee3967f3\") " pod="openshift-monitoring/node-exporter-47sv5" Jul 02 20:34:38.762871 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.762542 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93ba4cee-8bca-48f6-8ae3-5b69ee3967f3-metrics-client-ca\") pod \"node-exporter-47sv5\" (UID: \"93ba4cee-8bca-48f6-8ae3-5b69ee3967f3\") " pod="openshift-monitoring/node-exporter-47sv5" Jul 02 20:34:38.762871 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.762575 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/93ba4cee-8bca-48f6-8ae3-5b69ee3967f3-node-exporter-wtmp\") pod \"node-exporter-47sv5\" (UID: \"93ba4cee-8bca-48f6-8ae3-5b69ee3967f3\") " pod="openshift-monitoring/node-exporter-47sv5" Jul 02 20:34:38.762871 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.762603 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0ee7e6d8-0e22-4375-9960-f84947ae2770-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-c99pw\" (UID: \"0ee7e6d8-0e22-4375-9960-f84947ae2770\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-c99pw" Jul 02 20:34:38.762871 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.762628 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ee7e6d8-0e22-4375-9960-f84947ae2770-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-c99pw\" (UID: \"0ee7e6d8-0e22-4375-9960-f84947ae2770\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-c99pw" Jul 02 20:34:38.762871 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.762679 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/93ba4cee-8bca-48f6-8ae3-5b69ee3967f3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-47sv5\" (UID: \"93ba4cee-8bca-48f6-8ae3-5b69ee3967f3\") " pod="openshift-monitoring/node-exporter-47sv5" Jul 02 20:34:38.763149 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.762878 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/93ba4cee-8bca-48f6-8ae3-5b69ee3967f3-root\") pod \"node-exporter-47sv5\" (UID: \"93ba4cee-8bca-48f6-8ae3-5b69ee3967f3\") " pod="openshift-monitoring/node-exporter-47sv5" Jul 02 20:34:38.763149 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:34:38.762953 2568 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 02 20:34:38.763149 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:34:38.763026 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/93ba4cee-8bca-48f6-8ae3-5b69ee3967f3-node-exporter-tls podName:93ba4cee-8bca-48f6-8ae3-5b69ee3967f3 nodeName:}" failed. No retries permitted until 2026-07-02 20:34:39.263007529 +0000 UTC m=+117.715928609 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/93ba4cee-8bca-48f6-8ae3-5b69ee3967f3-node-exporter-tls") pod "node-exporter-47sv5" (UID: "93ba4cee-8bca-48f6-8ae3-5b69ee3967f3") : secret "node-exporter-tls" not found Jul 02 20:34:38.763301 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.763210 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/93ba4cee-8bca-48f6-8ae3-5b69ee3967f3-node-exporter-textfile\") pod \"node-exporter-47sv5\" (UID: \"93ba4cee-8bca-48f6-8ae3-5b69ee3967f3\") " pod="openshift-monitoring/node-exporter-47sv5" Jul 02 20:34:38.763348 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.763296 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0ee7e6d8-0e22-4375-9960-f84947ae2770-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-c99pw\" (UID: \"0ee7e6d8-0e22-4375-9960-f84947ae2770\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-c99pw" Jul 02 20:34:38.763348 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.763335 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/93ba4cee-8bca-48f6-8ae3-5b69ee3967f3-node-exporter-wtmp\") pod \"node-exporter-47sv5\" (UID: \"93ba4cee-8bca-48f6-8ae3-5b69ee3967f3\") " pod="openshift-monitoring/node-exporter-47sv5" Jul 02 20:34:38.763887 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.763546 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/93ba4cee-8bca-48f6-8ae3-5b69ee3967f3-sys\") pod \"node-exporter-47sv5\" (UID: \"93ba4cee-8bca-48f6-8ae3-5b69ee3967f3\") " pod="openshift-monitoring/node-exporter-47sv5" Jul 02 20:34:38.763887 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.763793 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/93ba4cee-8bca-48f6-8ae3-5b69ee3967f3-node-exporter-accelerators-collector-config\") pod \"node-exporter-47sv5\" (UID: \"93ba4cee-8bca-48f6-8ae3-5b69ee3967f3\") " pod="openshift-monitoring/node-exporter-47sv5" Jul 02 20:34:38.763887 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.763804 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/93ba4cee-8bca-48f6-8ae3-5b69ee3967f3-metrics-client-ca\") pod \"node-exporter-47sv5\" (UID: \"93ba4cee-8bca-48f6-8ae3-5b69ee3967f3\") " pod="openshift-monitoring/node-exporter-47sv5" Jul 02 20:34:38.763887 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.763822 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/0ee7e6d8-0e22-4375-9960-f84947ae2770-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-c99pw\" (UID: \"0ee7e6d8-0e22-4375-9960-f84947ae2770\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-c99pw" Jul 02 20:34:38.763887 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.763832 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/0ee7e6d8-0e22-4375-9960-f84947ae2770-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-c99pw\" (UID: \"0ee7e6d8-0e22-4375-9960-f84947ae2770\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-c99pw" Jul 02 20:34:38.766726 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.766683 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0ee7e6d8-0e22-4375-9960-f84947ae2770-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-c99pw\" (UID: \"0ee7e6d8-0e22-4375-9960-f84947ae2770\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-c99pw" Jul 02 20:34:38.767196 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.767135 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/93ba4cee-8bca-48f6-8ae3-5b69ee3967f3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-47sv5\" (UID: \"93ba4cee-8bca-48f6-8ae3-5b69ee3967f3\") " pod="openshift-monitoring/node-exporter-47sv5" Jul 02 20:34:38.767196 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.767139 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0ee7e6d8-0e22-4375-9960-f84947ae2770-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-c99pw\" (UID: \"0ee7e6d8-0e22-4375-9960-f84947ae2770\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-c99pw" Jul 02 20:34:38.775437 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.775397 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jmv7x\" (UniqueName: \"kubernetes.io/projected/93ba4cee-8bca-48f6-8ae3-5b69ee3967f3-kube-api-access-jmv7x\") pod \"node-exporter-47sv5\" (UID: \"93ba4cee-8bca-48f6-8ae3-5b69ee3967f3\") " pod="openshift-monitoring/node-exporter-47sv5" Jul 02 20:34:38.781214 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.781175 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qmbcj\" (UniqueName: \"kubernetes.io/projected/0ee7e6d8-0e22-4375-9960-f84947ae2770-kube-api-access-qmbcj\") pod \"kube-state-metrics-7c9dbb8b7d-c99pw\" (UID: \"0ee7e6d8-0e22-4375-9960-f84947ae2770\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-c99pw" Jul 02 20:34:38.823770 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:38.823736 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-c99pw" Jul 02 20:34:39.268386 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:39.268353 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/93ba4cee-8bca-48f6-8ae3-5b69ee3967f3-node-exporter-tls\") pod \"node-exporter-47sv5\" (UID: \"93ba4cee-8bca-48f6-8ae3-5b69ee3967f3\") " pod="openshift-monitoring/node-exporter-47sv5" Jul 02 20:34:39.270987 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:39.270964 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/93ba4cee-8bca-48f6-8ae3-5b69ee3967f3-node-exporter-tls\") pod \"node-exporter-47sv5\" (UID: \"93ba4cee-8bca-48f6-8ae3-5b69ee3967f3\") " pod="openshift-monitoring/node-exporter-47sv5" Jul 02 20:34:39.430329 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:39.430289 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-47sv5" Jul 02 20:34:41.488419 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:41.488384 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-576648f479-7nhsg"] Jul 02 20:34:41.492399 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:41.492378 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-576648f479-7nhsg" Jul 02 20:34:41.496305 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:41.496284 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 02 20:34:41.496404 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:41.496284 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-fc93lf0504lff\"" Jul 02 20:34:41.496800 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:41.496588 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 02 20:34:41.496800 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:41.496648 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-qsv9h\"" Jul 02 20:34:41.496800 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:41.496589 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 02 20:34:41.497033 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:41.496945 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 02 20:34:41.497179 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:41.497162 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 02 20:34:41.504825 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:41.504802 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-576648f479-7nhsg"] Jul 02 20:34:41.592399 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:41.592371 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/72f7a0ca-962c-4f3e-a451-b0a03b267c2e-secret-thanos-querier-tls\") pod \"thanos-querier-576648f479-7nhsg\" (UID: \"72f7a0ca-962c-4f3e-a451-b0a03b267c2e\") " pod="openshift-monitoring/thanos-querier-576648f479-7nhsg" Jul 02 20:34:41.592574 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:41.592426 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/72f7a0ca-962c-4f3e-a451-b0a03b267c2e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-576648f479-7nhsg\" (UID: \"72f7a0ca-962c-4f3e-a451-b0a03b267c2e\") " pod="openshift-monitoring/thanos-querier-576648f479-7nhsg" Jul 02 20:34:41.592574 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:41.592451 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72f7a0ca-962c-4f3e-a451-b0a03b267c2e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-576648f479-7nhsg\" (UID: \"72f7a0ca-962c-4f3e-a451-b0a03b267c2e\") " pod="openshift-monitoring/thanos-querier-576648f479-7nhsg" Jul 02 20:34:41.592574 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:41.592506 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gfflx\" (UniqueName: \"kubernetes.io/projected/72f7a0ca-962c-4f3e-a451-b0a03b267c2e-kube-api-access-gfflx\") pod \"thanos-querier-576648f479-7nhsg\" (UID: \"72f7a0ca-962c-4f3e-a451-b0a03b267c2e\") " pod="openshift-monitoring/thanos-querier-576648f479-7nhsg" Jul 02 20:34:41.592574 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:41.592547 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72f7a0ca-962c-4f3e-a451-b0a03b267c2e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-576648f479-7nhsg\" (UID: \"72f7a0ca-962c-4f3e-a451-b0a03b267c2e\") " pod="openshift-monitoring/thanos-querier-576648f479-7nhsg" Jul 02 20:34:41.592787 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:41.592576 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/72f7a0ca-962c-4f3e-a451-b0a03b267c2e-secret-grpc-tls\") pod \"thanos-querier-576648f479-7nhsg\" (UID: \"72f7a0ca-962c-4f3e-a451-b0a03b267c2e\") " pod="openshift-monitoring/thanos-querier-576648f479-7nhsg" Jul 02 20:34:41.592787 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:41.592651 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/72f7a0ca-962c-4f3e-a451-b0a03b267c2e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-576648f479-7nhsg\" (UID: \"72f7a0ca-962c-4f3e-a451-b0a03b267c2e\") " pod="openshift-monitoring/thanos-querier-576648f479-7nhsg" Jul 02 20:34:41.592787 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:41.592672 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72f7a0ca-962c-4f3e-a451-b0a03b267c2e-metrics-client-ca\") pod \"thanos-querier-576648f479-7nhsg\" (UID: \"72f7a0ca-962c-4f3e-a451-b0a03b267c2e\") " pod="openshift-monitoring/thanos-querier-576648f479-7nhsg" Jul 02 20:34:41.693668 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:41.693636 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gfflx\" (UniqueName: \"kubernetes.io/projected/72f7a0ca-962c-4f3e-a451-b0a03b267c2e-kube-api-access-gfflx\") pod \"thanos-querier-576648f479-7nhsg\" (UID: \"72f7a0ca-962c-4f3e-a451-b0a03b267c2e\") " pod="openshift-monitoring/thanos-querier-576648f479-7nhsg" Jul 02 20:34:41.693824 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:41.693679 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72f7a0ca-962c-4f3e-a451-b0a03b267c2e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-576648f479-7nhsg\" (UID: \"72f7a0ca-962c-4f3e-a451-b0a03b267c2e\") " pod="openshift-monitoring/thanos-querier-576648f479-7nhsg" Jul 02 20:34:41.693824 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:41.693728 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/72f7a0ca-962c-4f3e-a451-b0a03b267c2e-secret-grpc-tls\") pod \"thanos-querier-576648f479-7nhsg\" (UID: \"72f7a0ca-962c-4f3e-a451-b0a03b267c2e\") " pod="openshift-monitoring/thanos-querier-576648f479-7nhsg" Jul 02 20:34:41.693824 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:41.693770 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/72f7a0ca-962c-4f3e-a451-b0a03b267c2e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-576648f479-7nhsg\" (UID: \"72f7a0ca-962c-4f3e-a451-b0a03b267c2e\") " pod="openshift-monitoring/thanos-querier-576648f479-7nhsg" Jul 02 20:34:41.693824 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:41.693800 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72f7a0ca-962c-4f3e-a451-b0a03b267c2e-metrics-client-ca\") pod \"thanos-querier-576648f479-7nhsg\" (UID: \"72f7a0ca-962c-4f3e-a451-b0a03b267c2e\") " pod="openshift-monitoring/thanos-querier-576648f479-7nhsg" Jul 02 20:34:41.694050 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:41.693843 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/72f7a0ca-962c-4f3e-a451-b0a03b267c2e-secret-thanos-querier-tls\") pod \"thanos-querier-576648f479-7nhsg\" (UID: \"72f7a0ca-962c-4f3e-a451-b0a03b267c2e\") " pod="openshift-monitoring/thanos-querier-576648f479-7nhsg" Jul 02 20:34:41.694050 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:41.693902 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/72f7a0ca-962c-4f3e-a451-b0a03b267c2e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-576648f479-7nhsg\" (UID: \"72f7a0ca-962c-4f3e-a451-b0a03b267c2e\") " pod="openshift-monitoring/thanos-querier-576648f479-7nhsg" Jul 02 20:34:41.694050 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:41.693921 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72f7a0ca-962c-4f3e-a451-b0a03b267c2e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-576648f479-7nhsg\" (UID: \"72f7a0ca-962c-4f3e-a451-b0a03b267c2e\") " pod="openshift-monitoring/thanos-querier-576648f479-7nhsg" Jul 02 20:34:41.695144 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:41.695065 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/72f7a0ca-962c-4f3e-a451-b0a03b267c2e-metrics-client-ca\") pod \"thanos-querier-576648f479-7nhsg\" (UID: \"72f7a0ca-962c-4f3e-a451-b0a03b267c2e\") " pod="openshift-monitoring/thanos-querier-576648f479-7nhsg" Jul 02 20:34:41.696911 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:41.696864 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/72f7a0ca-962c-4f3e-a451-b0a03b267c2e-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-576648f479-7nhsg\" (UID: \"72f7a0ca-962c-4f3e-a451-b0a03b267c2e\") " pod="openshift-monitoring/thanos-querier-576648f479-7nhsg" Jul 02 20:34:41.697460 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:41.697400 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/72f7a0ca-962c-4f3e-a451-b0a03b267c2e-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-576648f479-7nhsg\" (UID: \"72f7a0ca-962c-4f3e-a451-b0a03b267c2e\") " pod="openshift-monitoring/thanos-querier-576648f479-7nhsg" Jul 02 20:34:41.698296 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:41.698054 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/72f7a0ca-962c-4f3e-a451-b0a03b267c2e-secret-thanos-querier-tls\") pod \"thanos-querier-576648f479-7nhsg\" (UID: \"72f7a0ca-962c-4f3e-a451-b0a03b267c2e\") " pod="openshift-monitoring/thanos-querier-576648f479-7nhsg" Jul 02 20:34:41.698296 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:41.698249 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/72f7a0ca-962c-4f3e-a451-b0a03b267c2e-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-576648f479-7nhsg\" (UID: \"72f7a0ca-962c-4f3e-a451-b0a03b267c2e\") " pod="openshift-monitoring/thanos-querier-576648f479-7nhsg" Jul 02 20:34:41.699239 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:41.699208 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/72f7a0ca-962c-4f3e-a451-b0a03b267c2e-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-576648f479-7nhsg\" (UID: \"72f7a0ca-962c-4f3e-a451-b0a03b267c2e\") " pod="openshift-monitoring/thanos-querier-576648f479-7nhsg" Jul 02 20:34:41.699513 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:41.699479 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/72f7a0ca-962c-4f3e-a451-b0a03b267c2e-secret-grpc-tls\") pod \"thanos-querier-576648f479-7nhsg\" (UID: \"72f7a0ca-962c-4f3e-a451-b0a03b267c2e\") " pod="openshift-monitoring/thanos-querier-576648f479-7nhsg" Jul 02 20:34:41.703890 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:41.703866 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gfflx\" (UniqueName: \"kubernetes.io/projected/72f7a0ca-962c-4f3e-a451-b0a03b267c2e-kube-api-access-gfflx\") pod \"thanos-querier-576648f479-7nhsg\" (UID: \"72f7a0ca-962c-4f3e-a451-b0a03b267c2e\") " pod="openshift-monitoring/thanos-querier-576648f479-7nhsg" Jul 02 20:34:41.805176 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:41.805091 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-576648f479-7nhsg" Jul 02 20:34:43.252182 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:43.252152 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-8z9pk"] Jul 02 20:34:43.265297 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:43.265271 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-8z9pk" Jul 02 20:34:43.266382 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:43.266314 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-8z9pk"] Jul 02 20:34:43.267670 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:43.267648 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-8ftgh\"" Jul 02 20:34:43.268906 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:43.268689 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 02 20:34:43.411774 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:43.411740 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lkggt\" (UniqueName: \"kubernetes.io/projected/a239902c-ff93-4680-828e-7bce6705a027-kube-api-access-lkggt\") pod \"monitoring-plugin-d5dcff7cf-8z9pk\" (UID: \"a239902c-ff93-4680-828e-7bce6705a027\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-8z9pk" Jul 02 20:34:43.411965 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:43.411798 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a239902c-ff93-4680-828e-7bce6705a027-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-8z9pk\" (UID: \"a239902c-ff93-4680-828e-7bce6705a027\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-8z9pk" Jul 02 20:34:43.513035 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:43.512956 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a239902c-ff93-4680-828e-7bce6705a027-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-8z9pk\" (UID: \"a239902c-ff93-4680-828e-7bce6705a027\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-8z9pk" Jul 02 20:34:43.513191 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:43.513073 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lkggt\" (UniqueName: \"kubernetes.io/projected/a239902c-ff93-4680-828e-7bce6705a027-kube-api-access-lkggt\") pod \"monitoring-plugin-d5dcff7cf-8z9pk\" (UID: \"a239902c-ff93-4680-828e-7bce6705a027\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-8z9pk" Jul 02 20:34:43.515387 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:43.515355 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/a239902c-ff93-4680-828e-7bce6705a027-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-8z9pk\" (UID: \"a239902c-ff93-4680-828e-7bce6705a027\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-8z9pk" Jul 02 20:34:43.521461 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:43.521440 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lkggt\" (UniqueName: \"kubernetes.io/projected/a239902c-ff93-4680-828e-7bce6705a027-kube-api-access-lkggt\") pod \"monitoring-plugin-d5dcff7cf-8z9pk\" (UID: \"a239902c-ff93-4680-828e-7bce6705a027\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-8z9pk" Jul 02 20:34:43.529543 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:34:43.529517 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93ba4cee_8bca_48f6_8ae3_5b69ee3967f3.slice/crio-0268518703a4537f2bc3b5cdbaefbaa997e1295b3a25255df8c3b99c9dbe7277 WatchSource:0}: Error finding container 0268518703a4537f2bc3b5cdbaefbaa997e1295b3a25255df8c3b99c9dbe7277: Status 404 returned error can't find the container with id 0268518703a4537f2bc3b5cdbaefbaa997e1295b3a25255df8c3b99c9dbe7277 Jul 02 20:34:43.578918 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:43.578621 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-8z9pk" Jul 02 20:34:43.676082 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:43.676060 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-576648f479-7nhsg"] Jul 02 20:34:43.678736 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:34:43.678712 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72f7a0ca_962c_4f3e_a451_b0a03b267c2e.slice/crio-60fc5c1f7f205fcd84b61751efe4c41d647e8d0327660a421a7bb3a06786729e WatchSource:0}: Error finding container 60fc5c1f7f205fcd84b61751efe4c41d647e8d0327660a421a7bb3a06786729e: Status 404 returned error can't find the container with id 60fc5c1f7f205fcd84b61751efe4c41d647e8d0327660a421a7bb3a06786729e Jul 02 20:34:43.692891 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:43.692865 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-c99pw"] Jul 02 20:34:43.697430 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:34:43.697395 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ee7e6d8_0e22_4375_9960_f84947ae2770.slice/crio-5dd0d8e83de5a818554606f89fc634639ae9d8500c81b9367c4190530697f59e WatchSource:0}: Error finding container 5dd0d8e83de5a818554606f89fc634639ae9d8500c81b9367c4190530697f59e: Status 404 returned error can't find the container with id 5dd0d8e83de5a818554606f89fc634639ae9d8500c81b9367c4190530697f59e Jul 02 20:34:43.743905 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:43.743876 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-8z9pk"] Jul 02 20:34:43.746370 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:34:43.746340 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda239902c_ff93_4680_828e_7bce6705a027.slice/crio-2d91791cdfbda3a21e3df681273499b333c4380100fd5dea1edf809dd10a8003 WatchSource:0}: Error finding container 2d91791cdfbda3a21e3df681273499b333c4380100fd5dea1edf809dd10a8003: Status 404 returned error can't find the container with id 2d91791cdfbda3a21e3df681273499b333c4380100fd5dea1edf809dd10a8003 Jul 02 20:34:43.937267 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:43.937228 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-8z9pk" event={"ID":"a239902c-ff93-4680-828e-7bce6705a027","Type":"ContainerStarted","Data":"2d91791cdfbda3a21e3df681273499b333c4380100fd5dea1edf809dd10a8003"} Jul 02 20:34:43.939160 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:43.939126 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-c99pw" event={"ID":"0ee7e6d8-0e22-4375-9960-f84947ae2770","Type":"ContainerStarted","Data":"5dd0d8e83de5a818554606f89fc634639ae9d8500c81b9367c4190530697f59e"} Jul 02 20:34:43.940454 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:43.940424 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-576648f479-7nhsg" event={"ID":"72f7a0ca-962c-4f3e-a451-b0a03b267c2e","Type":"ContainerStarted","Data":"60fc5c1f7f205fcd84b61751efe4c41d647e8d0327660a421a7bb3a06786729e"} Jul 02 20:34:43.942218 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:43.942193 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-685bfb5f64-9spck" event={"ID":"19fac57d-e5fc-4182-8cd3-60bd9a80d34f","Type":"ContainerStarted","Data":"c4b1f5d71bdf7a46ad9bc5c16dbfefede698efa1b9ac3e4b8c589f5668b4a758"} Jul 02 20:34:43.942452 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:43.942432 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-685bfb5f64-9spck" Jul 02 20:34:43.944154 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:43.944112 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-47sv5" event={"ID":"93ba4cee-8bca-48f6-8ae3-5b69ee3967f3","Type":"ContainerStarted","Data":"0268518703a4537f2bc3b5cdbaefbaa997e1295b3a25255df8c3b99c9dbe7277"} Jul 02 20:34:43.957687 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:43.957659 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-685bfb5f64-9spck" Jul 02 20:34:43.962169 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:43.962126 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-685bfb5f64-9spck" podStartSLOduration=2.187934141 podStartE2EDuration="20.962112969s" totalImagesPullingTime="18.774178828s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:43.960538115 +0000 UTC m=+122.413459228" watchObservedRunningTime="2026-07-02 20:34:43.962112969 +0000 UTC m=+122.415034067" Jul 02 20:34:44.750017 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.749842 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 20:34:44.779984 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.778004 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:44.779984 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.778212 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 20:34:44.781462 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.781239 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-ncdlb\"" Jul 02 20:34:44.781462 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.781334 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 02 20:34:44.781656 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.781583 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 02 20:34:44.781656 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.781617 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 02 20:34:44.782300 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.781772 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 02 20:34:44.782300 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.781813 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 02 20:34:44.782300 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.782034 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 02 20:34:44.783795 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.783775 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 02 20:34:44.783975 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.783959 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-daa4apheo5db6\"" Jul 02 20:34:44.785444 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.784798 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 02 20:34:44.785444 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.785071 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 02 20:34:44.785444 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.785289 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 02 20:34:44.786416 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.786382 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 02 20:34:44.786885 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.786574 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 02 20:34:44.786970 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.786900 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 02 20:34:44.787674 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.787655 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 02 20:34:44.791963 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.791563 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 02 20:34:44.926971 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.926931 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/95d00282-87de-4c17-a64a-aa4c88e6a01e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:44.927144 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.926994 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/95d00282-87de-4c17-a64a-aa4c88e6a01e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:44.927144 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.927028 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/95d00282-87de-4c17-a64a-aa4c88e6a01e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:44.927144 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.927055 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/95d00282-87de-4c17-a64a-aa4c88e6a01e-config\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:44.927144 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.927084 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95d00282-87de-4c17-a64a-aa4c88e6a01e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:44.927352 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.927176 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nxr9k\" (UniqueName: \"kubernetes.io/projected/95d00282-87de-4c17-a64a-aa4c88e6a01e-kube-api-access-nxr9k\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:44.927352 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.927230 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/95d00282-87de-4c17-a64a-aa4c88e6a01e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:44.927352 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.927258 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/95d00282-87de-4c17-a64a-aa4c88e6a01e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:44.927352 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.927287 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/95d00282-87de-4c17-a64a-aa4c88e6a01e-web-config\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:44.927352 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.927314 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/95d00282-87de-4c17-a64a-aa4c88e6a01e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:44.927352 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.927341 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/95d00282-87de-4c17-a64a-aa4c88e6a01e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:44.927625 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.927370 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95d00282-87de-4c17-a64a-aa4c88e6a01e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:44.927625 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.927421 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/95d00282-87de-4c17-a64a-aa4c88e6a01e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:44.927625 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.927447 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/95d00282-87de-4c17-a64a-aa4c88e6a01e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:44.927625 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.927496 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95d00282-87de-4c17-a64a-aa4c88e6a01e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:44.927625 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.927573 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95d00282-87de-4c17-a64a-aa4c88e6a01e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:44.927625 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.927600 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/95d00282-87de-4c17-a64a-aa4c88e6a01e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:44.927939 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.927626 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/95d00282-87de-4c17-a64a-aa4c88e6a01e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:44.927939 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.927650 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/95d00282-87de-4c17-a64a-aa4c88e6a01e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:44.927939 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:44.927678 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/95d00282-87de-4c17-a64a-aa4c88e6a01e-config-out\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.029368 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.029169 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95d00282-87de-4c17-a64a-aa4c88e6a01e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.029368 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.029219 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/95d00282-87de-4c17-a64a-aa4c88e6a01e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.029368 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.029250 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/95d00282-87de-4c17-a64a-aa4c88e6a01e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.029368 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.029276 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/95d00282-87de-4c17-a64a-aa4c88e6a01e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.029368 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.029307 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/95d00282-87de-4c17-a64a-aa4c88e6a01e-config-out\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.029368 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.029369 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/95d00282-87de-4c17-a64a-aa4c88e6a01e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.029787 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.029408 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/95d00282-87de-4c17-a64a-aa4c88e6a01e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.029787 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.029505 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/95d00282-87de-4c17-a64a-aa4c88e6a01e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.029787 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.029533 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/95d00282-87de-4c17-a64a-aa4c88e6a01e-config\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.029787 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.029564 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95d00282-87de-4c17-a64a-aa4c88e6a01e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.029787 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.029600 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nxr9k\" (UniqueName: \"kubernetes.io/projected/95d00282-87de-4c17-a64a-aa4c88e6a01e-kube-api-access-nxr9k\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.029787 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.029643 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/95d00282-87de-4c17-a64a-aa4c88e6a01e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.029787 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.029668 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/95d00282-87de-4c17-a64a-aa4c88e6a01e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.029787 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.029693 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/95d00282-87de-4c17-a64a-aa4c88e6a01e-web-config\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.029787 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.029723 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/95d00282-87de-4c17-a64a-aa4c88e6a01e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.029787 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.029749 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/95d00282-87de-4c17-a64a-aa4c88e6a01e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.029787 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.029776 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95d00282-87de-4c17-a64a-aa4c88e6a01e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.030388 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.029816 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/95d00282-87de-4c17-a64a-aa4c88e6a01e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.030388 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.029840 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/95d00282-87de-4c17-a64a-aa4c88e6a01e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.030388 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.029906 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95d00282-87de-4c17-a64a-aa4c88e6a01e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.031182 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.030877 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95d00282-87de-4c17-a64a-aa4c88e6a01e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.032923 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.031545 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/95d00282-87de-4c17-a64a-aa4c88e6a01e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.032923 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.031575 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/95d00282-87de-4c17-a64a-aa4c88e6a01e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.032923 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.031929 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95d00282-87de-4c17-a64a-aa4c88e6a01e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.038024 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.034692 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/95d00282-87de-4c17-a64a-aa4c88e6a01e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.038024 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.035274 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95d00282-87de-4c17-a64a-aa4c88e6a01e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.038024 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.035460 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/95d00282-87de-4c17-a64a-aa4c88e6a01e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.038024 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.037804 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/95d00282-87de-4c17-a64a-aa4c88e6a01e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.048070 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.048004 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/95d00282-87de-4c17-a64a-aa4c88e6a01e-config\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.048805 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.048771 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/95d00282-87de-4c17-a64a-aa4c88e6a01e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.051018 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.050994 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nxr9k\" (UniqueName: \"kubernetes.io/projected/95d00282-87de-4c17-a64a-aa4c88e6a01e-kube-api-access-nxr9k\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.052932 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.051807 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/95d00282-87de-4c17-a64a-aa4c88e6a01e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.055812 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.055761 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/95d00282-87de-4c17-a64a-aa4c88e6a01e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.062304 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.056447 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/95d00282-87de-4c17-a64a-aa4c88e6a01e-web-config\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.062304 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.056798 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/95d00282-87de-4c17-a64a-aa4c88e6a01e-config-out\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.062304 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.057379 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/95d00282-87de-4c17-a64a-aa4c88e6a01e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.062304 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.062188 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/95d00282-87de-4c17-a64a-aa4c88e6a01e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.062304 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.062221 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/95d00282-87de-4c17-a64a-aa4c88e6a01e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.062304 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.062242 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/95d00282-87de-4c17-a64a-aa4c88e6a01e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.062679 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.062481 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/95d00282-87de-4c17-a64a-aa4c88e6a01e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"95d00282-87de-4c17-a64a-aa4c88e6a01e\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.096198 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.095912 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:45.307126 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.307031 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 02 20:34:45.467660 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:34:45.467627 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95d00282_87de_4c17_a64a_aa4c88e6a01e.slice/crio-9fe38980847dd18e38df66bbe1da9954132b0fe3111bdb8934a67b53e4f578c0 WatchSource:0}: Error finding container 9fe38980847dd18e38df66bbe1da9954132b0fe3111bdb8934a67b53e4f578c0: Status 404 returned error can't find the container with id 9fe38980847dd18e38df66bbe1da9954132b0fe3111bdb8934a67b53e4f578c0 Jul 02 20:34:45.957400 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:45.957362 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95d00282-87de-4c17-a64a-aa4c88e6a01e","Type":"ContainerStarted","Data":"9fe38980847dd18e38df66bbe1da9954132b0fe3111bdb8934a67b53e4f578c0"} Jul 02 20:34:47.874690 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:47.874605 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-6df6c84d95-l9gpq" Jul 02 20:34:47.975012 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:47.974882 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-8z9pk" event={"ID":"a239902c-ff93-4680-828e-7bce6705a027","Type":"ContainerStarted","Data":"021197c40d1f7ac120ffe27614d6e6a13e4d97257e2d4df2e29128abd4f86b55"} Jul 02 20:34:47.976531 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:47.976512 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-8z9pk" Jul 02 20:34:47.989097 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:47.987515 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-c99pw" event={"ID":"0ee7e6d8-0e22-4375-9960-f84947ae2770","Type":"ContainerStarted","Data":"39e9b73c43f021c6d706a463da807866bcd9e70e3e73ea66d555ff1c43600046"} Jul 02 20:34:47.997077 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:47.995760 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-8z9pk" podStartSLOduration=1.052689162 podStartE2EDuration="4.9957404s" totalImagesPullingTime="3.943051238s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:34:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:47.994912674 +0000 UTC m=+126.447833773" watchObservedRunningTime="2026-07-02 20:34:47.9957404 +0000 UTC m=+126.448661499" Jul 02 20:34:47.997512 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:47.997488 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-8z9pk" Jul 02 20:34:48.003042 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:48.003016 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-576648f479-7nhsg" event={"ID":"72f7a0ca-962c-4f3e-a451-b0a03b267c2e","Type":"ContainerStarted","Data":"2318059d3419d256a793b3ad311d08e1433ad9601cbcd74a7f985f582ff82790"} Jul 02 20:34:48.010546 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:48.010510 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-47sv5" event={"ID":"93ba4cee-8bca-48f6-8ae3-5b69ee3967f3","Type":"ContainerStarted","Data":"fec7d406db6d38af2f4d7388ffd4eb73e2932c5233a6acfff148d926b1122268"} Jul 02 20:34:49.018260 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:49.018219 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-c99pw" event={"ID":"0ee7e6d8-0e22-4375-9960-f84947ae2770","Type":"ContainerStarted","Data":"7a20ede7c0990890799e21bfdd017476b40878e10724b4db04faee390525ee89"} Jul 02 20:34:49.018710 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:49.018296 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-c99pw" event={"ID":"0ee7e6d8-0e22-4375-9960-f84947ae2770","Type":"ContainerStarted","Data":"737e37ff19bea2db505783b13489b0063b4359804585adf1d71c3299b308eb28"} Jul 02 20:34:49.021811 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:49.021772 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-576648f479-7nhsg" event={"ID":"72f7a0ca-962c-4f3e-a451-b0a03b267c2e","Type":"ContainerStarted","Data":"27b580d202a73d5d2706d5318afaf8b59915e260e3a6c28c37faa706db874ddd"} Jul 02 20:34:49.021970 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:49.021873 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-576648f479-7nhsg" event={"ID":"72f7a0ca-962c-4f3e-a451-b0a03b267c2e","Type":"ContainerStarted","Data":"a768c7ef46aaccf414d324f82a282838e15fd85f3e852d2403f39cb5a8de0512"} Jul 02 20:34:49.026651 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:49.026620 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95d00282-87de-4c17-a64a-aa4c88e6a01e","Type":"ContainerStarted","Data":"b6f4224f542b4b6e46c5048a2a2e3972df839fb9327605f11b3c61b82866e9ee"} Jul 02 20:34:49.030047 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:49.030004 2568 generic.go:356] "Generic (PLEG): container finished" podID="93ba4cee-8bca-48f6-8ae3-5b69ee3967f3" containerID="fec7d406db6d38af2f4d7388ffd4eb73e2932c5233a6acfff148d926b1122268" exitCode=0 Jul 02 20:34:49.031182 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:49.031157 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-47sv5" event={"ID":"93ba4cee-8bca-48f6-8ae3-5b69ee3967f3","Type":"ContainerDied","Data":"fec7d406db6d38af2f4d7388ffd4eb73e2932c5233a6acfff148d926b1122268"} Jul 02 20:34:49.044634 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:49.042823 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-c99pw" podStartSLOduration=7.051011724 podStartE2EDuration="11.042804327s" totalImagesPullingTime="3.991792603s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:34:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:49.042031256 +0000 UTC m=+127.494952359" watchObservedRunningTime="2026-07-02 20:34:49.042804327 +0000 UTC m=+127.495725427" Jul 02 20:34:50.041262 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:50.041231 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-576648f479-7nhsg" event={"ID":"72f7a0ca-962c-4f3e-a451-b0a03b267c2e","Type":"ContainerStarted","Data":"8d9bbbeccec0cccc386ab6d726bac4afb9c3cd288547df4c273f850d02b4bb2f"} Jul 02 20:34:50.042960 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:50.042934 2568 generic.go:356] "Generic (PLEG): container finished" podID="95d00282-87de-4c17-a64a-aa4c88e6a01e" containerID="b6f4224f542b4b6e46c5048a2a2e3972df839fb9327605f11b3c61b82866e9ee" exitCode=0 Jul 02 20:34:50.043073 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:50.043015 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95d00282-87de-4c17-a64a-aa4c88e6a01e","Type":"ContainerDied","Data":"b6f4224f542b4b6e46c5048a2a2e3972df839fb9327605f11b3c61b82866e9ee"} Jul 02 20:34:50.045464 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:50.045428 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-47sv5" event={"ID":"93ba4cee-8bca-48f6-8ae3-5b69ee3967f3","Type":"ContainerStarted","Data":"f1c9ba1e8c681ac397dc3389057c9b160a4fd13aecbeb49bf740c0df87c3029a"} Jul 02 20:34:50.045550 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:50.045490 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-47sv5" event={"ID":"93ba4cee-8bca-48f6-8ae3-5b69ee3967f3","Type":"ContainerStarted","Data":"404cc01c0a9325c738d55c19e1a84e99a4238b411a3ea7325f4a4f3c05985220"} Jul 02 20:34:50.091469 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:50.091415 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-47sv5" podStartSLOduration=8.12782289 podStartE2EDuration="12.091393346s" totalImagesPullingTime="3.765999209s" totalInitContainerRuntime="197.571247ms" isStatefulPod=true podCreationTimestamp="2026-07-02 20:34:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:50.090742949 +0000 UTC m=+128.543664047" watchObservedRunningTime="2026-07-02 20:34:50.091393346 +0000 UTC m=+128.544314445" Jul 02 20:34:50.896538 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:50.896494 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56e0a8da-b013-4d0c-b5e9-b9431f944da3-metrics-certs\") pod \"network-metrics-daemon-ls998\" (UID: \"56e0a8da-b013-4d0c-b5e9-b9431f944da3\") " pod="openshift-multus/network-metrics-daemon-ls998" Jul 02 20:34:50.900219 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:50.900173 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/56e0a8da-b013-4d0c-b5e9-b9431f944da3-metrics-certs\") pod \"network-metrics-daemon-ls998\" (UID: \"56e0a8da-b013-4d0c-b5e9-b9431f944da3\") " pod="openshift-multus/network-metrics-daemon-ls998" Jul 02 20:34:51.057966 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:51.057931 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-576648f479-7nhsg" event={"ID":"72f7a0ca-962c-4f3e-a451-b0a03b267c2e","Type":"ContainerStarted","Data":"ff7fa4866e63fd86489333955e6ebea2e558b6e57d0a15042ac24282820e2be7"} Jul 02 20:34:51.058407 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:51.058013 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-576648f479-7nhsg" event={"ID":"72f7a0ca-962c-4f3e-a451-b0a03b267c2e","Type":"ContainerStarted","Data":"183286a58a383605a87def1d5bf8786188910b3e5eb11318309ee7da13a93e83"} Jul 02 20:34:51.058407 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:51.058062 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-576648f479-7nhsg" Jul 02 20:34:51.085706 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:51.085613 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-576648f479-7nhsg" podStartSLOduration=4.784870363 podStartE2EDuration="10.085592892s" totalImagesPullingTime="5.300722529s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:34:41 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:51.084585375 +0000 UTC m=+129.537506473" watchObservedRunningTime="2026-07-02 20:34:51.085592892 +0000 UTC m=+129.538513992" Jul 02 20:34:51.182707 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:51.182470 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-zddh5\"" Jul 02 20:34:51.190623 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:51.190594 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ls998" Jul 02 20:34:51.420273 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:51.420201 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ls998"] Jul 02 20:34:51.424311 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:34:51.424278 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56e0a8da_b013_4d0c_b5e9_b9431f944da3.slice/crio-7e0cb705fcf7fd919470802f3cc1e67472e654eb2d5343dc01f53fc480744488 WatchSource:0}: Error finding container 7e0cb705fcf7fd919470802f3cc1e67472e654eb2d5343dc01f53fc480744488: Status 404 returned error can't find the container with id 7e0cb705fcf7fd919470802f3cc1e67472e654eb2d5343dc01f53fc480744488 Jul 02 20:34:52.064520 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:52.064448 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ls998" event={"ID":"56e0a8da-b013-4d0c-b5e9-b9431f944da3","Type":"ContainerStarted","Data":"7e0cb705fcf7fd919470802f3cc1e67472e654eb2d5343dc01f53fc480744488"} Jul 02 20:34:55.080964 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:55.080934 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95d00282-87de-4c17-a64a-aa4c88e6a01e","Type":"ContainerStarted","Data":"af6e9208cf2880eb7b1eb8f815d0e12617c8b97212a7519b975abbc800058cb5"} Jul 02 20:34:55.081405 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:55.081009 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95d00282-87de-4c17-a64a-aa4c88e6a01e","Type":"ContainerStarted","Data":"d58a6397e02f7516cfa8997498435989634766e74326e215839effd288dc7669"} Jul 02 20:34:55.081405 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:55.081050 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95d00282-87de-4c17-a64a-aa4c88e6a01e","Type":"ContainerStarted","Data":"c99fb4f540189db8a27068393360cd924884381e339e501d8a677a69a7c0647e"} Jul 02 20:34:55.081405 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:55.081084 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95d00282-87de-4c17-a64a-aa4c88e6a01e","Type":"ContainerStarted","Data":"d16954f0d8f0e0aadcb74bac802b9b378d9342fac9602851ff851183319e2134"} Jul 02 20:34:55.081405 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:55.081108 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95d00282-87de-4c17-a64a-aa4c88e6a01e","Type":"ContainerStarted","Data":"4329dc85764bbeb2d34871f808905ed9a5f496fddc16564f2b81507a5a3cdad7"} Jul 02 20:34:55.081405 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:55.081140 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"95d00282-87de-4c17-a64a-aa4c88e6a01e","Type":"ContainerStarted","Data":"d368e16f5d9f8d81bc0aae928763d74517961b255679a1ac5d65f53de4c4f958"} Jul 02 20:34:55.082753 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:55.082724 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ls998" event={"ID":"56e0a8da-b013-4d0c-b5e9-b9431f944da3","Type":"ContainerStarted","Data":"31c1fbd2cedbea1f4b607ee3e48794a6e92699501c897da3c20cd793c684c236"} Jul 02 20:34:55.082909 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:55.082775 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ls998" event={"ID":"56e0a8da-b013-4d0c-b5e9-b9431f944da3","Type":"ContainerStarted","Data":"cf73ef0945a6f35f5189cbaf68f9f0f6da4f4d0d9715cbbd3a4697de419ae1b6"} Jul 02 20:34:55.096832 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:55.096807 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:34:55.114499 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:55.114446 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.563690478 podStartE2EDuration="11.114428366s" totalImagesPullingTime="7.52803181s" totalInitContainerRuntime="22.706078ms" isStatefulPod=false podCreationTimestamp="2026-07-02 20:34:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:55.112386191 +0000 UTC m=+133.565307291" watchObservedRunningTime="2026-07-02 20:34:55.114428366 +0000 UTC m=+133.567349470" Jul 02 20:34:55.130234 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:55.130198 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ls998" podStartSLOduration=129.361840743 podStartE2EDuration="2m12.130186634s" totalImagesPullingTime="2.768345891s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:32:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:34:55.129110114 +0000 UTC m=+133.582031213" watchObservedRunningTime="2026-07-02 20:34:55.130186634 +0000 UTC m=+133.583107731" Jul 02 20:34:57.070373 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:34:57.070343 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-576648f479-7nhsg" Jul 02 20:35:05.122892 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:35:05.122842 2568 generic.go:356] "Generic (PLEG): container finished" podID="04592575-7bc0-4f9f-9396-e286c6b76413" containerID="32e318bd0aaca5b905fd7b305a7e6c6f267c4188faef33777bd2401f2401011b" exitCode=0 Jul 02 20:35:05.123446 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:35:05.123422 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rjw76" event={"ID":"04592575-7bc0-4f9f-9396-e286c6b76413","Type":"ContainerDied","Data":"32e318bd0aaca5b905fd7b305a7e6c6f267c4188faef33777bd2401f2401011b"} Jul 02 20:35:05.124065 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:35:05.124041 2568 scope.go:117] "RemoveContainer" containerID="32e318bd0aaca5b905fd7b305a7e6c6f267c4188faef33777bd2401f2401011b" Jul 02 20:35:06.129164 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:35:06.129129 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-rjw76" event={"ID":"04592575-7bc0-4f9f-9396-e286c6b76413","Type":"ContainerStarted","Data":"517fe015a61aa1ac8598a0fbd5e7cf4edb73a0cf01f69c1b24f01601d775e171"} Jul 02 20:35:25.204697 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:35:25.204663 2568 generic.go:356] "Generic (PLEG): container finished" podID="9119d7cb-306a-4d98-a453-f123ab249419" containerID="bccbc84891d952db05ef54172e4313c9a80f8f2901d0073198b094feb0d4e83e" exitCode=0 Jul 02 20:35:25.205204 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:35:25.204740 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-6n7zw" event={"ID":"9119d7cb-306a-4d98-a453-f123ab249419","Type":"ContainerDied","Data":"bccbc84891d952db05ef54172e4313c9a80f8f2901d0073198b094feb0d4e83e"} Jul 02 20:35:25.205204 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:35:25.205137 2568 scope.go:117] "RemoveContainer" containerID="bccbc84891d952db05ef54172e4313c9a80f8f2901d0073198b094feb0d4e83e" Jul 02 20:35:25.206338 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:35:25.206318 2568 generic.go:356] "Generic (PLEG): container finished" podID="27355627-e4c9-456a-9820-da0513c338db" containerID="6e7b2a1ae775645070d0d88c164e9bd07408f1cf5a0de0f44dd0426be04a491a" exitCode=0 Jul 02 20:35:25.206424 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:35:25.206388 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lsjxx" event={"ID":"27355627-e4c9-456a-9820-da0513c338db","Type":"ContainerDied","Data":"6e7b2a1ae775645070d0d88c164e9bd07408f1cf5a0de0f44dd0426be04a491a"} Jul 02 20:35:25.206649 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:35:25.206637 2568 scope.go:117] "RemoveContainer" containerID="6e7b2a1ae775645070d0d88c164e9bd07408f1cf5a0de0f44dd0426be04a491a" Jul 02 20:35:26.212531 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:35:26.212493 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-6n7zw" event={"ID":"9119d7cb-306a-4d98-a453-f123ab249419","Type":"ContainerStarted","Data":"f1df70dabf7f391c36a15aad205b813cea9cff40253ab1db8c67a42b2a330f98"} Jul 02 20:35:26.214031 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:35:26.214006 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-lsjxx" event={"ID":"27355627-e4c9-456a-9820-da0513c338db","Type":"ContainerStarted","Data":"e10f01e03f9dde6d0d87a6df65fcf2b591abd80a7793fbf1aadccf74e5c19669"} Jul 02 20:35:45.096713 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:35:45.096629 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:35:45.112111 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:35:45.112087 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:35:45.311126 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:35:45.311099 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 02 20:37:41.897289 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:37:41.897261 2568 kubelet.go:1648] "Image garbage collection succeeded" Jul 02 20:38:18.622018 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:18.621985 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-857d77d4-wnfrc"] Jul 02 20:38:18.625440 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:18.625424 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-wnfrc" Jul 02 20:38:18.629717 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:18.629698 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 02 20:38:18.629808 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:18.629704 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 02 20:38:18.630396 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:18.630373 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 02 20:38:18.630633 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:18.630615 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 02 20:38:18.630733 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:18.630633 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-cc4jb\"" Jul 02 20:38:18.642464 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:18.642441 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-857d77d4-wnfrc"] Jul 02 20:38:18.768618 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:18.768587 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8ef0a4c4-44e7-4db8-a3e1-fc4f8157fd3c-manifests\") pod \"opendatahub-operator-controller-manager-857d77d4-wnfrc\" (UID: \"8ef0a4c4-44e7-4db8-a3e1-fc4f8157fd3c\") " pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-wnfrc" Jul 02 20:38:18.768769 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:18.768656 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pz4mb\" (UniqueName: \"kubernetes.io/projected/8ef0a4c4-44e7-4db8-a3e1-fc4f8157fd3c-kube-api-access-pz4mb\") pod \"opendatahub-operator-controller-manager-857d77d4-wnfrc\" (UID: \"8ef0a4c4-44e7-4db8-a3e1-fc4f8157fd3c\") " pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-wnfrc" Jul 02 20:38:18.768769 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:18.768693 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ef0a4c4-44e7-4db8-a3e1-fc4f8157fd3c-tmp\") pod \"opendatahub-operator-controller-manager-857d77d4-wnfrc\" (UID: \"8ef0a4c4-44e7-4db8-a3e1-fc4f8157fd3c\") " pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-wnfrc" Jul 02 20:38:18.768769 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:18.768716 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8ef0a4c4-44e7-4db8-a3e1-fc4f8157fd3c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-857d77d4-wnfrc\" (UID: \"8ef0a4c4-44e7-4db8-a3e1-fc4f8157fd3c\") " pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-wnfrc" Jul 02 20:38:18.768769 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:18.768759 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8ef0a4c4-44e7-4db8-a3e1-fc4f8157fd3c-webhook-cert\") pod \"opendatahub-operator-controller-manager-857d77d4-wnfrc\" (UID: \"8ef0a4c4-44e7-4db8-a3e1-fc4f8157fd3c\") " pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-wnfrc" Jul 02 20:38:18.870123 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:18.870090 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pz4mb\" (UniqueName: \"kubernetes.io/projected/8ef0a4c4-44e7-4db8-a3e1-fc4f8157fd3c-kube-api-access-pz4mb\") pod \"opendatahub-operator-controller-manager-857d77d4-wnfrc\" (UID: \"8ef0a4c4-44e7-4db8-a3e1-fc4f8157fd3c\") " pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-wnfrc" Jul 02 20:38:18.870252 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:18.870129 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ef0a4c4-44e7-4db8-a3e1-fc4f8157fd3c-tmp\") pod \"opendatahub-operator-controller-manager-857d77d4-wnfrc\" (UID: \"8ef0a4c4-44e7-4db8-a3e1-fc4f8157fd3c\") " pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-wnfrc" Jul 02 20:38:18.870252 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:18.870157 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8ef0a4c4-44e7-4db8-a3e1-fc4f8157fd3c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-857d77d4-wnfrc\" (UID: \"8ef0a4c4-44e7-4db8-a3e1-fc4f8157fd3c\") " pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-wnfrc" Jul 02 20:38:18.870252 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:18.870186 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8ef0a4c4-44e7-4db8-a3e1-fc4f8157fd3c-webhook-cert\") pod \"opendatahub-operator-controller-manager-857d77d4-wnfrc\" (UID: \"8ef0a4c4-44e7-4db8-a3e1-fc4f8157fd3c\") " pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-wnfrc" Jul 02 20:38:18.870252 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:18.870240 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8ef0a4c4-44e7-4db8-a3e1-fc4f8157fd3c-manifests\") pod \"opendatahub-operator-controller-manager-857d77d4-wnfrc\" (UID: \"8ef0a4c4-44e7-4db8-a3e1-fc4f8157fd3c\") " pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-wnfrc" Jul 02 20:38:18.870601 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:18.870580 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8ef0a4c4-44e7-4db8-a3e1-fc4f8157fd3c-manifests\") pod \"opendatahub-operator-controller-manager-857d77d4-wnfrc\" (UID: \"8ef0a4c4-44e7-4db8-a3e1-fc4f8157fd3c\") " pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-wnfrc" Jul 02 20:38:18.872358 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:18.872311 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8ef0a4c4-44e7-4db8-a3e1-fc4f8157fd3c-tmp\") pod \"opendatahub-operator-controller-manager-857d77d4-wnfrc\" (UID: \"8ef0a4c4-44e7-4db8-a3e1-fc4f8157fd3c\") " pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-wnfrc" Jul 02 20:38:18.872549 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:18.872531 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8ef0a4c4-44e7-4db8-a3e1-fc4f8157fd3c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-857d77d4-wnfrc\" (UID: \"8ef0a4c4-44e7-4db8-a3e1-fc4f8157fd3c\") " pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-wnfrc" Jul 02 20:38:18.872655 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:18.872635 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8ef0a4c4-44e7-4db8-a3e1-fc4f8157fd3c-webhook-cert\") pod \"opendatahub-operator-controller-manager-857d77d4-wnfrc\" (UID: \"8ef0a4c4-44e7-4db8-a3e1-fc4f8157fd3c\") " pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-wnfrc" Jul 02 20:38:18.881146 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:18.881122 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pz4mb\" (UniqueName: \"kubernetes.io/projected/8ef0a4c4-44e7-4db8-a3e1-fc4f8157fd3c-kube-api-access-pz4mb\") pod \"opendatahub-operator-controller-manager-857d77d4-wnfrc\" (UID: \"8ef0a4c4-44e7-4db8-a3e1-fc4f8157fd3c\") " pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-wnfrc" Jul 02 20:38:18.935996 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:18.935974 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-wnfrc" Jul 02 20:38:19.074947 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:19.074904 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-857d77d4-wnfrc"] Jul 02 20:38:19.077792 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:38:19.077766 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8ef0a4c4_44e7_4db8_a3e1_fc4f8157fd3c.slice/crio-73952f3a6fa9a9f45d9ea0ccce32c8d5453e60654d7c00d00b1b97a23ce99a13 WatchSource:0}: Error finding container 73952f3a6fa9a9f45d9ea0ccce32c8d5453e60654d7c00d00b1b97a23ce99a13: Status 404 returned error can't find the container with id 73952f3a6fa9a9f45d9ea0ccce32c8d5453e60654d7c00d00b1b97a23ce99a13 Jul 02 20:38:19.079513 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:19.079497 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 20:38:19.886271 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:19.886219 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-wnfrc" event={"ID":"8ef0a4c4-44e7-4db8-a3e1-fc4f8157fd3c","Type":"ContainerStarted","Data":"73952f3a6fa9a9f45d9ea0ccce32c8d5453e60654d7c00d00b1b97a23ce99a13"} Jul 02 20:38:22.907741 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:22.907705 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-wnfrc" event={"ID":"8ef0a4c4-44e7-4db8-a3e1-fc4f8157fd3c","Type":"ContainerStarted","Data":"adbbad6f1af3fe811f57b3a632bae5a3d7572383a27edc122a19fbab60d01d6e"} Jul 02 20:38:23.912897 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:23.912842 2568 generic.go:356] "Generic (PLEG): container finished" podID="8ef0a4c4-44e7-4db8-a3e1-fc4f8157fd3c" containerID="adbbad6f1af3fe811f57b3a632bae5a3d7572383a27edc122a19fbab60d01d6e" exitCode=0 Jul 02 20:38:23.913256 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:23.912942 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-wnfrc" event={"ID":"8ef0a4c4-44e7-4db8-a3e1-fc4f8157fd3c","Type":"ContainerDied","Data":"adbbad6f1af3fe811f57b3a632bae5a3d7572383a27edc122a19fbab60d01d6e"} Jul 02 20:38:24.918755 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:24.918718 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-wnfrc" event={"ID":"8ef0a4c4-44e7-4db8-a3e1-fc4f8157fd3c","Type":"ContainerStarted","Data":"f8953b33b9f2618bad4e0c4504b89f2ba4c3753da6a8c35c901d2aa9a3a54ebe"} Jul 02 20:38:24.919137 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:24.918882 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-wnfrc" Jul 02 20:38:24.939918 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:24.939879 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-wnfrc" podStartSLOduration=2.740469654 podStartE2EDuration="6.939866738s" totalImagesPullingTime="3.170089531s" totalInitContainerRuntime="1.029307553s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:38:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:38:24.938710502 +0000 UTC m=+343.391631601" watchObservedRunningTime="2026-07-02 20:38:24.939866738 +0000 UTC m=+343.392787827" Jul 02 20:38:35.924963 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:35.924887 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-857d77d4-wnfrc" Jul 02 20:38:38.703379 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:38.703346 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-84bc744f59-646fq"] Jul 02 20:38:38.711221 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:38.711200 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-84bc744f59-646fq" Jul 02 20:38:38.713929 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:38.713904 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 02 20:38:38.714440 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:38.714418 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 02 20:38:38.721943 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:38.721921 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vwqwk\" (UniqueName: \"kubernetes.io/projected/d681a289-1348-42c3-b53c-2b2dfaa77d0c-kube-api-access-vwqwk\") pod \"kube-auth-proxy-84bc744f59-646fq\" (UID: \"d681a289-1348-42c3-b53c-2b2dfaa77d0c\") " pod="openshift-ingress/kube-auth-proxy-84bc744f59-646fq" Jul 02 20:38:38.722179 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:38.722162 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d681a289-1348-42c3-b53c-2b2dfaa77d0c-tmp\") pod \"kube-auth-proxy-84bc744f59-646fq\" (UID: \"d681a289-1348-42c3-b53c-2b2dfaa77d0c\") " pod="openshift-ingress/kube-auth-proxy-84bc744f59-646fq" Jul 02 20:38:38.722343 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:38.722323 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d681a289-1348-42c3-b53c-2b2dfaa77d0c-tls-certs\") pod \"kube-auth-proxy-84bc744f59-646fq\" (UID: \"d681a289-1348-42c3-b53c-2b2dfaa77d0c\") " pod="openshift-ingress/kube-auth-proxy-84bc744f59-646fq" Jul 02 20:38:38.723424 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:38.723406 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-84bc744f59-646fq"] Jul 02 20:38:38.767693 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:38.767668 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-nht7x"] Jul 02 20:38:38.770744 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:38.770728 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-nht7x" Jul 02 20:38:38.773051 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:38.773032 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-tv4bn\"" Jul 02 20:38:38.773338 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:38.773323 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 02 20:38:38.785893 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:38.785875 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-nht7x"] Jul 02 20:38:38.824687 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:38.824664 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d681a289-1348-42c3-b53c-2b2dfaa77d0c-tmp\") pod \"kube-auth-proxy-84bc744f59-646fq\" (UID: \"d681a289-1348-42c3-b53c-2b2dfaa77d0c\") " pod="openshift-ingress/kube-auth-proxy-84bc744f59-646fq" Jul 02 20:38:38.824794 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:38.824715 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2d88b\" (UniqueName: \"kubernetes.io/projected/bf997017-5106-439c-b4c0-cd0a5cac8a45-kube-api-access-2d88b\") pod \"odh-model-controller-7998c67dc4-nht7x\" (UID: \"bf997017-5106-439c-b4c0-cd0a5cac8a45\") " pod="opendatahub/odh-model-controller-7998c67dc4-nht7x" Jul 02 20:38:38.824876 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:38.824830 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d681a289-1348-42c3-b53c-2b2dfaa77d0c-tls-certs\") pod \"kube-auth-proxy-84bc744f59-646fq\" (UID: \"d681a289-1348-42c3-b53c-2b2dfaa77d0c\") " pod="openshift-ingress/kube-auth-proxy-84bc744f59-646fq" Jul 02 20:38:38.824970 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:38.824939 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vwqwk\" (UniqueName: \"kubernetes.io/projected/d681a289-1348-42c3-b53c-2b2dfaa77d0c-kube-api-access-vwqwk\") pod \"kube-auth-proxy-84bc744f59-646fq\" (UID: \"d681a289-1348-42c3-b53c-2b2dfaa77d0c\") " pod="openshift-ingress/kube-auth-proxy-84bc744f59-646fq" Jul 02 20:38:38.825053 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:38.825035 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf997017-5106-439c-b4c0-cd0a5cac8a45-cert\") pod \"odh-model-controller-7998c67dc4-nht7x\" (UID: \"bf997017-5106-439c-b4c0-cd0a5cac8a45\") " pod="opendatahub/odh-model-controller-7998c67dc4-nht7x" Jul 02 20:38:38.825111 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:38:38.824961 2568 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 02 20:38:38.825161 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:38:38.825146 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d681a289-1348-42c3-b53c-2b2dfaa77d0c-tls-certs podName:d681a289-1348-42c3-b53c-2b2dfaa77d0c nodeName:}" failed. No retries permitted until 2026-07-02 20:38:39.325122651 +0000 UTC m=+357.778043739 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/d681a289-1348-42c3-b53c-2b2dfaa77d0c-tls-certs") pod "kube-auth-proxy-84bc744f59-646fq" (UID: "d681a289-1348-42c3-b53c-2b2dfaa77d0c") : secret "kube-auth-proxy-tls" not found Jul 02 20:38:38.826825 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:38.826807 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d681a289-1348-42c3-b53c-2b2dfaa77d0c-tmp\") pod \"kube-auth-proxy-84bc744f59-646fq\" (UID: \"d681a289-1348-42c3-b53c-2b2dfaa77d0c\") " pod="openshift-ingress/kube-auth-proxy-84bc744f59-646fq" Jul 02 20:38:38.843743 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:38.843722 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vwqwk\" (UniqueName: \"kubernetes.io/projected/d681a289-1348-42c3-b53c-2b2dfaa77d0c-kube-api-access-vwqwk\") pod \"kube-auth-proxy-84bc744f59-646fq\" (UID: \"d681a289-1348-42c3-b53c-2b2dfaa77d0c\") " pod="openshift-ingress/kube-auth-proxy-84bc744f59-646fq" Jul 02 20:38:38.926045 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:38.926021 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf997017-5106-439c-b4c0-cd0a5cac8a45-cert\") pod \"odh-model-controller-7998c67dc4-nht7x\" (UID: \"bf997017-5106-439c-b4c0-cd0a5cac8a45\") " pod="opendatahub/odh-model-controller-7998c67dc4-nht7x" Jul 02 20:38:38.926169 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:38.926070 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2d88b\" (UniqueName: \"kubernetes.io/projected/bf997017-5106-439c-b4c0-cd0a5cac8a45-kube-api-access-2d88b\") pod \"odh-model-controller-7998c67dc4-nht7x\" (UID: \"bf997017-5106-439c-b4c0-cd0a5cac8a45\") " pod="opendatahub/odh-model-controller-7998c67dc4-nht7x" Jul 02 20:38:38.926210 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:38:38.926181 2568 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 02 20:38:38.926262 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:38:38.926251 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bf997017-5106-439c-b4c0-cd0a5cac8a45-cert podName:bf997017-5106-439c-b4c0-cd0a5cac8a45 nodeName:}" failed. No retries permitted until 2026-07-02 20:38:39.426233014 +0000 UTC m=+357.879154094 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/bf997017-5106-439c-b4c0-cd0a5cac8a45-cert") pod "odh-model-controller-7998c67dc4-nht7x" (UID: "bf997017-5106-439c-b4c0-cd0a5cac8a45") : secret "odh-model-controller-webhook-cert" not found Jul 02 20:38:38.941154 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:38.941130 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2d88b\" (UniqueName: \"kubernetes.io/projected/bf997017-5106-439c-b4c0-cd0a5cac8a45-kube-api-access-2d88b\") pod \"odh-model-controller-7998c67dc4-nht7x\" (UID: \"bf997017-5106-439c-b4c0-cd0a5cac8a45\") " pod="opendatahub/odh-model-controller-7998c67dc4-nht7x" Jul 02 20:38:39.330925 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:39.330890 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d681a289-1348-42c3-b53c-2b2dfaa77d0c-tls-certs\") pod \"kube-auth-proxy-84bc744f59-646fq\" (UID: \"d681a289-1348-42c3-b53c-2b2dfaa77d0c\") " pod="openshift-ingress/kube-auth-proxy-84bc744f59-646fq" Jul 02 20:38:39.333333 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:39.333291 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d681a289-1348-42c3-b53c-2b2dfaa77d0c-tls-certs\") pod \"kube-auth-proxy-84bc744f59-646fq\" (UID: \"d681a289-1348-42c3-b53c-2b2dfaa77d0c\") " pod="openshift-ingress/kube-auth-proxy-84bc744f59-646fq" Jul 02 20:38:39.432266 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:39.432235 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf997017-5106-439c-b4c0-cd0a5cac8a45-cert\") pod \"odh-model-controller-7998c67dc4-nht7x\" (UID: \"bf997017-5106-439c-b4c0-cd0a5cac8a45\") " pod="opendatahub/odh-model-controller-7998c67dc4-nht7x" Jul 02 20:38:39.434462 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:39.434444 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bf997017-5106-439c-b4c0-cd0a5cac8a45-cert\") pod \"odh-model-controller-7998c67dc4-nht7x\" (UID: \"bf997017-5106-439c-b4c0-cd0a5cac8a45\") " pod="opendatahub/odh-model-controller-7998c67dc4-nht7x" Jul 02 20:38:39.620645 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:39.620579 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-84bc744f59-646fq" Jul 02 20:38:39.669205 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:39.669118 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jqhb2"] Jul 02 20:38:39.673342 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:39.673299 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-jqhb2" Jul 02 20:38:39.675835 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:39.675809 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 02 20:38:39.680885 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:39.680624 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-nht7x" Jul 02 20:38:39.691609 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:39.691568 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jqhb2"] Jul 02 20:38:39.734975 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:39.734754 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vswdv\" (UniqueName: \"kubernetes.io/projected/ef87df6e-102e-4922-a871-25cffbd425b5-kube-api-access-vswdv\") pod \"model-serving-api-54d89bd5fc-jqhb2\" (UID: \"ef87df6e-102e-4922-a871-25cffbd425b5\") " pod="opendatahub/model-serving-api-54d89bd5fc-jqhb2" Jul 02 20:38:39.734975 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:39.734825 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef87df6e-102e-4922-a871-25cffbd425b5-tls-certs\") pod \"model-serving-api-54d89bd5fc-jqhb2\" (UID: \"ef87df6e-102e-4922-a871-25cffbd425b5\") " pod="opendatahub/model-serving-api-54d89bd5fc-jqhb2" Jul 02 20:38:39.775391 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:39.768788 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-84bc744f59-646fq"] Jul 02 20:38:39.780522 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:38:39.780491 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd681a289_1348_42c3_b53c_2b2dfaa77d0c.slice/crio-8140ac95257eb2399b097a9d723af22beb6762369e00801972f9fedbea6d686f WatchSource:0}: Error finding container 8140ac95257eb2399b097a9d723af22beb6762369e00801972f9fedbea6d686f: Status 404 returned error can't find the container with id 8140ac95257eb2399b097a9d723af22beb6762369e00801972f9fedbea6d686f Jul 02 20:38:39.835750 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:39.835717 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vswdv\" (UniqueName: \"kubernetes.io/projected/ef87df6e-102e-4922-a871-25cffbd425b5-kube-api-access-vswdv\") pod \"model-serving-api-54d89bd5fc-jqhb2\" (UID: \"ef87df6e-102e-4922-a871-25cffbd425b5\") " pod="opendatahub/model-serving-api-54d89bd5fc-jqhb2" Jul 02 20:38:39.835921 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:39.835777 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef87df6e-102e-4922-a871-25cffbd425b5-tls-certs\") pod \"model-serving-api-54d89bd5fc-jqhb2\" (UID: \"ef87df6e-102e-4922-a871-25cffbd425b5\") " pod="opendatahub/model-serving-api-54d89bd5fc-jqhb2" Jul 02 20:38:39.835990 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:38:39.835918 2568 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 02 20:38:39.835990 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:38:39.835985 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef87df6e-102e-4922-a871-25cffbd425b5-tls-certs podName:ef87df6e-102e-4922-a871-25cffbd425b5 nodeName:}" failed. No retries permitted until 2026-07-02 20:38:40.335961739 +0000 UTC m=+358.788882839 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/ef87df6e-102e-4922-a871-25cffbd425b5-tls-certs") pod "model-serving-api-54d89bd5fc-jqhb2" (UID: "ef87df6e-102e-4922-a871-25cffbd425b5") : secret "model-serving-api-tls" not found Jul 02 20:38:39.841515 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:39.841490 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-nht7x"] Jul 02 20:38:39.845246 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:38:39.845218 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf997017_5106_439c_b4c0_cd0a5cac8a45.slice/crio-e7c1c0e0bc2338754af51a5040f767c2b40b41b9c6b1c42622444e0e76bba69d WatchSource:0}: Error finding container e7c1c0e0bc2338754af51a5040f767c2b40b41b9c6b1c42622444e0e76bba69d: Status 404 returned error can't find the container with id e7c1c0e0bc2338754af51a5040f767c2b40b41b9c6b1c42622444e0e76bba69d Jul 02 20:38:39.856546 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:39.856516 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vswdv\" (UniqueName: \"kubernetes.io/projected/ef87df6e-102e-4922-a871-25cffbd425b5-kube-api-access-vswdv\") pod \"model-serving-api-54d89bd5fc-jqhb2\" (UID: \"ef87df6e-102e-4922-a871-25cffbd425b5\") " pod="opendatahub/model-serving-api-54d89bd5fc-jqhb2" Jul 02 20:38:39.986108 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:39.986061 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-84bc744f59-646fq" event={"ID":"d681a289-1348-42c3-b53c-2b2dfaa77d0c","Type":"ContainerStarted","Data":"8140ac95257eb2399b097a9d723af22beb6762369e00801972f9fedbea6d686f"} Jul 02 20:38:39.987273 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:39.987243 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-nht7x" event={"ID":"bf997017-5106-439c-b4c0-cd0a5cac8a45","Type":"ContainerStarted","Data":"e7c1c0e0bc2338754af51a5040f767c2b40b41b9c6b1c42622444e0e76bba69d"} Jul 02 20:38:40.310155 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:40.310072 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh"] Jul 02 20:38:40.314203 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:40.313999 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh" Jul 02 20:38:40.316491 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:40.316331 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 02 20:38:40.316491 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:40.316348 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 02 20:38:40.317353 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:40.316841 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-7w7vc\"" Jul 02 20:38:40.317353 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:40.317083 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 02 20:38:40.317353 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:40.317243 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 02 20:38:40.342590 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:40.341247 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-db29c\" (UniqueName: \"kubernetes.io/projected/ec844500-a4c8-4f49-9469-7d4d4952fa8b-kube-api-access-db29c\") pod \"istiod-openshift-gateway-7574459656-9fjqh\" (UID: \"ec844500-a4c8-4f49-9469-7d4d4952fa8b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh" Jul 02 20:38:40.342590 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:40.341297 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec844500-a4c8-4f49-9469-7d4d4952fa8b-istio-token\") pod \"istiod-openshift-gateway-7574459656-9fjqh\" (UID: \"ec844500-a4c8-4f49-9469-7d4d4952fa8b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh" Jul 02 20:38:40.342590 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:40.341324 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ec844500-a4c8-4f49-9469-7d4d4952fa8b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-9fjqh\" (UID: \"ec844500-a4c8-4f49-9469-7d4d4952fa8b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh" Jul 02 20:38:40.342590 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:40.341369 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ec844500-a4c8-4f49-9469-7d4d4952fa8b-cacerts\") pod \"istiod-openshift-gateway-7574459656-9fjqh\" (UID: \"ec844500-a4c8-4f49-9469-7d4d4952fa8b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh" Jul 02 20:38:40.342590 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:40.341414 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec844500-a4c8-4f49-9469-7d4d4952fa8b-local-certs\") pod \"istiod-openshift-gateway-7574459656-9fjqh\" (UID: \"ec844500-a4c8-4f49-9469-7d4d4952fa8b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh" Jul 02 20:38:40.342590 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:40.341434 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ec844500-a4c8-4f49-9469-7d4d4952fa8b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-9fjqh\" (UID: \"ec844500-a4c8-4f49-9469-7d4d4952fa8b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh" Jul 02 20:38:40.342590 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:40.341469 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ec844500-a4c8-4f49-9469-7d4d4952fa8b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-9fjqh\" (UID: \"ec844500-a4c8-4f49-9469-7d4d4952fa8b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh" Jul 02 20:38:40.342590 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:40.341512 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef87df6e-102e-4922-a871-25cffbd425b5-tls-certs\") pod \"model-serving-api-54d89bd5fc-jqhb2\" (UID: \"ef87df6e-102e-4922-a871-25cffbd425b5\") " pod="opendatahub/model-serving-api-54d89bd5fc-jqhb2" Jul 02 20:38:40.342590 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:38:40.341792 2568 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 02 20:38:40.342590 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:38:40.341935 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ef87df6e-102e-4922-a871-25cffbd425b5-tls-certs podName:ef87df6e-102e-4922-a871-25cffbd425b5 nodeName:}" failed. No retries permitted until 2026-07-02 20:38:41.341887545 +0000 UTC m=+359.794808634 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/ef87df6e-102e-4922-a871-25cffbd425b5-tls-certs") pod "model-serving-api-54d89bd5fc-jqhb2" (UID: "ef87df6e-102e-4922-a871-25cffbd425b5") : secret "model-serving-api-tls" not found Jul 02 20:38:40.343265 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:40.343243 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh"] Jul 02 20:38:40.442952 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:40.442914 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-db29c\" (UniqueName: \"kubernetes.io/projected/ec844500-a4c8-4f49-9469-7d4d4952fa8b-kube-api-access-db29c\") pod \"istiod-openshift-gateway-7574459656-9fjqh\" (UID: \"ec844500-a4c8-4f49-9469-7d4d4952fa8b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh" Jul 02 20:38:40.443140 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:40.442978 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec844500-a4c8-4f49-9469-7d4d4952fa8b-istio-token\") pod \"istiod-openshift-gateway-7574459656-9fjqh\" (UID: \"ec844500-a4c8-4f49-9469-7d4d4952fa8b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh" Jul 02 20:38:40.443140 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:40.443018 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ec844500-a4c8-4f49-9469-7d4d4952fa8b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-9fjqh\" (UID: \"ec844500-a4c8-4f49-9469-7d4d4952fa8b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh" Jul 02 20:38:40.443140 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:40.443086 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ec844500-a4c8-4f49-9469-7d4d4952fa8b-cacerts\") pod \"istiod-openshift-gateway-7574459656-9fjqh\" (UID: \"ec844500-a4c8-4f49-9469-7d4d4952fa8b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh" Jul 02 20:38:40.443140 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:40.443136 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec844500-a4c8-4f49-9469-7d4d4952fa8b-local-certs\") pod \"istiod-openshift-gateway-7574459656-9fjqh\" (UID: \"ec844500-a4c8-4f49-9469-7d4d4952fa8b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh" Jul 02 20:38:40.443357 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:40.443166 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ec844500-a4c8-4f49-9469-7d4d4952fa8b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-9fjqh\" (UID: \"ec844500-a4c8-4f49-9469-7d4d4952fa8b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh" Jul 02 20:38:40.443357 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:40.443199 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ec844500-a4c8-4f49-9469-7d4d4952fa8b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-9fjqh\" (UID: \"ec844500-a4c8-4f49-9469-7d4d4952fa8b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh" Jul 02 20:38:40.446467 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:40.446437 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ec844500-a4c8-4f49-9469-7d4d4952fa8b-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-9fjqh\" (UID: \"ec844500-a4c8-4f49-9469-7d4d4952fa8b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh" Jul 02 20:38:40.446467 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:40.446450 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ec844500-a4c8-4f49-9469-7d4d4952fa8b-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-9fjqh\" (UID: \"ec844500-a4c8-4f49-9469-7d4d4952fa8b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh" Jul 02 20:38:40.446651 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:40.446635 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec844500-a4c8-4f49-9469-7d4d4952fa8b-local-certs\") pod \"istiod-openshift-gateway-7574459656-9fjqh\" (UID: \"ec844500-a4c8-4f49-9469-7d4d4952fa8b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh" Jul 02 20:38:40.447115 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:40.447062 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ec844500-a4c8-4f49-9469-7d4d4952fa8b-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-9fjqh\" (UID: \"ec844500-a4c8-4f49-9469-7d4d4952fa8b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh" Jul 02 20:38:40.448785 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:40.448746 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ec844500-a4c8-4f49-9469-7d4d4952fa8b-cacerts\") pod \"istiod-openshift-gateway-7574459656-9fjqh\" (UID: \"ec844500-a4c8-4f49-9469-7d4d4952fa8b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh" Jul 02 20:38:40.455245 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:40.455220 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec844500-a4c8-4f49-9469-7d4d4952fa8b-istio-token\") pod \"istiod-openshift-gateway-7574459656-9fjqh\" (UID: \"ec844500-a4c8-4f49-9469-7d4d4952fa8b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh" Jul 02 20:38:40.457445 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:40.457418 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-db29c\" (UniqueName: \"kubernetes.io/projected/ec844500-a4c8-4f49-9469-7d4d4952fa8b-kube-api-access-db29c\") pod \"istiod-openshift-gateway-7574459656-9fjqh\" (UID: \"ec844500-a4c8-4f49-9469-7d4d4952fa8b\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh" Jul 02 20:38:40.628659 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:40.628576 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh" Jul 02 20:38:40.783174 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:40.782921 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh"] Jul 02 20:38:40.787060 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:38:40.786990 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec844500_a4c8_4f49_9469_7d4d4952fa8b.slice/crio-92cd9e32aefeaca34ac545c08270d1675b4248c1f9ad41db52bd6c9002dae83d WatchSource:0}: Error finding container 92cd9e32aefeaca34ac545c08270d1675b4248c1f9ad41db52bd6c9002dae83d: Status 404 returned error can't find the container with id 92cd9e32aefeaca34ac545c08270d1675b4248c1f9ad41db52bd6c9002dae83d Jul 02 20:38:40.995000 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:40.994960 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh" event={"ID":"ec844500-a4c8-4f49-9469-7d4d4952fa8b","Type":"ContainerStarted","Data":"92cd9e32aefeaca34ac545c08270d1675b4248c1f9ad41db52bd6c9002dae83d"} Jul 02 20:38:41.352402 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:41.352307 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef87df6e-102e-4922-a871-25cffbd425b5-tls-certs\") pod \"model-serving-api-54d89bd5fc-jqhb2\" (UID: \"ef87df6e-102e-4922-a871-25cffbd425b5\") " pod="opendatahub/model-serving-api-54d89bd5fc-jqhb2" Jul 02 20:38:41.355239 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:41.355200 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ef87df6e-102e-4922-a871-25cffbd425b5-tls-certs\") pod \"model-serving-api-54d89bd5fc-jqhb2\" (UID: \"ef87df6e-102e-4922-a871-25cffbd425b5\") " pod="opendatahub/model-serving-api-54d89bd5fc-jqhb2" Jul 02 20:38:41.491869 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:41.491825 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-jqhb2" Jul 02 20:38:41.670167 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:41.670001 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jqhb2"] Jul 02 20:38:41.674935 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:38:41.674905 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef87df6e_102e_4922_a871_25cffbd425b5.slice/crio-85af1cdf22045d2b623826cb207e37bd78516134f383c8e1eb6fbb1340653280 WatchSource:0}: Error finding container 85af1cdf22045d2b623826cb207e37bd78516134f383c8e1eb6fbb1340653280: Status 404 returned error can't find the container with id 85af1cdf22045d2b623826cb207e37bd78516134f383c8e1eb6fbb1340653280 Jul 02 20:38:42.002696 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:42.002659 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-jqhb2" event={"ID":"ef87df6e-102e-4922-a871-25cffbd425b5","Type":"ContainerStarted","Data":"85af1cdf22045d2b623826cb207e37bd78516134f383c8e1eb6fbb1340653280"} Jul 02 20:38:45.291418 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:45.291397 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 02 20:38:45.319121 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:45.319082 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:38:45.319209 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:45.319164 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:38:46.025982 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:46.025951 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-nht7x" event={"ID":"bf997017-5106-439c-b4c0-cd0a5cac8a45","Type":"ContainerStarted","Data":"e6fc856f78cb214e8a9ef6b0fabe98b2118bdc2b1ff0850974d24eb1663ff4a6"} Jul 02 20:38:46.026167 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:46.026082 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-nht7x" Jul 02 20:38:46.027823 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:46.027795 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh" event={"ID":"ec844500-a4c8-4f49-9469-7d4d4952fa8b","Type":"ContainerStarted","Data":"14ecb07ed76fef3f4011a67444e335476d9f6097e63c82af223064c7354d8ff6"} Jul 02 20:38:46.027955 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:46.027842 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh" Jul 02 20:38:46.029514 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:46.029487 2568 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-9fjqh container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 02 20:38:46.029629 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:46.029544 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-84bc744f59-646fq" event={"ID":"d681a289-1348-42c3-b53c-2b2dfaa77d0c","Type":"ContainerStarted","Data":"fbf84a5bc0811bd2b4d68fbd5e6435d188ea83552f262605b775443aeff4d53f"} Jul 02 20:38:46.029629 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:46.029538 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh" podUID="ec844500-a4c8-4f49-9469-7d4d4952fa8b" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 02 20:38:46.031129 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:46.031109 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-jqhb2" event={"ID":"ef87df6e-102e-4922-a871-25cffbd425b5","Type":"ContainerStarted","Data":"c7cf104b731057141985d61aa3382c535c2f19634bec7f38861af574dc78075b"} Jul 02 20:38:46.031236 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:46.031153 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-jqhb2" Jul 02 20:38:46.046429 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:46.046375 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-nht7x" podStartSLOduration=2.607380523 podStartE2EDuration="8.04636136s" totalImagesPullingTime="5.438980837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:38:46.045710503 +0000 UTC m=+364.498631604" watchObservedRunningTime="2026-07-02 20:38:46.04636136 +0000 UTC m=+364.499282457" Jul 02 20:38:46.064004 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:46.063955 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-84bc744f59-646fq" podStartSLOduration=2.557391183 podStartE2EDuration="8.063939193s" totalImagesPullingTime="5.50654801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:38:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:38:46.063234661 +0000 UTC m=+364.516155769" watchObservedRunningTime="2026-07-02 20:38:46.063939193 +0000 UTC m=+364.516860292" Jul 02 20:38:46.091164 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:46.091118 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh" podStartSLOduration=1.562807016 podStartE2EDuration="6.091102511s" totalImagesPullingTime="4.528295495s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:38:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:38:46.089939798 +0000 UTC m=+364.542860907" watchObservedRunningTime="2026-07-02 20:38:46.091102511 +0000 UTC m=+364.544023610" Jul 02 20:38:46.109759 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:46.109718 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-jqhb2" podStartSLOduration=3.463710165 podStartE2EDuration="7.109704492s" totalImagesPullingTime="3.645994327s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:38:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:38:46.109172339 +0000 UTC m=+364.562093437" watchObservedRunningTime="2026-07-02 20:38:46.109704492 +0000 UTC m=+364.562625590" Jul 02 20:38:47.037691 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:47.037648 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh" Jul 02 20:38:47.056280 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:47.056252 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n6fvr"] Jul 02 20:38:47.059660 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:47.059638 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n6fvr" Jul 02 20:38:47.064655 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:47.064627 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-vq6m6\"" Jul 02 20:38:47.079632 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:47.079602 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n6fvr"] Jul 02 20:38:47.113595 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:47.113560 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37e0a6e2-fadc-4db4-818e-e62b0ccecbc6-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n6fvr\" (UID: \"37e0a6e2-fadc-4db4-818e-e62b0ccecbc6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n6fvr" Jul 02 20:38:47.113774 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:47.113696 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37e0a6e2-fadc-4db4-818e-e62b0ccecbc6-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n6fvr\" (UID: \"37e0a6e2-fadc-4db4-818e-e62b0ccecbc6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n6fvr" Jul 02 20:38:47.113774 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:47.113769 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37e0a6e2-fadc-4db4-818e-e62b0ccecbc6-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n6fvr\" (UID: \"37e0a6e2-fadc-4db4-818e-e62b0ccecbc6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n6fvr" Jul 02 20:38:47.113921 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:47.113795 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37e0a6e2-fadc-4db4-818e-e62b0ccecbc6-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n6fvr\" (UID: \"37e0a6e2-fadc-4db4-818e-e62b0ccecbc6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n6fvr" Jul 02 20:38:47.113921 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:47.113827 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37e0a6e2-fadc-4db4-818e-e62b0ccecbc6-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n6fvr\" (UID: \"37e0a6e2-fadc-4db4-818e-e62b0ccecbc6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n6fvr" Jul 02 20:38:47.113921 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:47.113895 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37e0a6e2-fadc-4db4-818e-e62b0ccecbc6-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n6fvr\" (UID: \"37e0a6e2-fadc-4db4-818e-e62b0ccecbc6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n6fvr" Jul 02 20:38:47.114075 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:47.113957 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37e0a6e2-fadc-4db4-818e-e62b0ccecbc6-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n6fvr\" (UID: \"37e0a6e2-fadc-4db4-818e-e62b0ccecbc6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n6fvr" Jul 02 20:38:47.114075 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:47.113983 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37e0a6e2-fadc-4db4-818e-e62b0ccecbc6-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n6fvr\" (UID: \"37e0a6e2-fadc-4db4-818e-e62b0ccecbc6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n6fvr" Jul 02 20:38:47.114174 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:47.114101 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65q87\" (UniqueName: \"kubernetes.io/projected/37e0a6e2-fadc-4db4-818e-e62b0ccecbc6-kube-api-access-65q87\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n6fvr\" (UID: \"37e0a6e2-fadc-4db4-818e-e62b0ccecbc6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n6fvr" Jul 02 20:38:47.215359 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:47.215329 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65q87\" (UniqueName: \"kubernetes.io/projected/37e0a6e2-fadc-4db4-818e-e62b0ccecbc6-kube-api-access-65q87\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n6fvr\" (UID: \"37e0a6e2-fadc-4db4-818e-e62b0ccecbc6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n6fvr" Jul 02 20:38:47.215510 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:47.215371 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37e0a6e2-fadc-4db4-818e-e62b0ccecbc6-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n6fvr\" (UID: \"37e0a6e2-fadc-4db4-818e-e62b0ccecbc6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n6fvr" Jul 02 20:38:47.215510 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:47.215408 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37e0a6e2-fadc-4db4-818e-e62b0ccecbc6-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n6fvr\" (UID: \"37e0a6e2-fadc-4db4-818e-e62b0ccecbc6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n6fvr" Jul 02 20:38:47.215510 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:47.215438 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37e0a6e2-fadc-4db4-818e-e62b0ccecbc6-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n6fvr\" (UID: \"37e0a6e2-fadc-4db4-818e-e62b0ccecbc6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n6fvr" Jul 02 20:38:47.215510 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:47.215458 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37e0a6e2-fadc-4db4-818e-e62b0ccecbc6-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n6fvr\" (UID: \"37e0a6e2-fadc-4db4-818e-e62b0ccecbc6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n6fvr" Jul 02 20:38:47.215510 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:47.215476 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37e0a6e2-fadc-4db4-818e-e62b0ccecbc6-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n6fvr\" (UID: \"37e0a6e2-fadc-4db4-818e-e62b0ccecbc6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n6fvr" Jul 02 20:38:47.215510 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:47.215494 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37e0a6e2-fadc-4db4-818e-e62b0ccecbc6-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n6fvr\" (UID: \"37e0a6e2-fadc-4db4-818e-e62b0ccecbc6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n6fvr" Jul 02 20:38:47.215887 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:47.215516 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37e0a6e2-fadc-4db4-818e-e62b0ccecbc6-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n6fvr\" (UID: \"37e0a6e2-fadc-4db4-818e-e62b0ccecbc6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n6fvr" Jul 02 20:38:47.215887 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:47.215691 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37e0a6e2-fadc-4db4-818e-e62b0ccecbc6-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n6fvr\" (UID: \"37e0a6e2-fadc-4db4-818e-e62b0ccecbc6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n6fvr" Jul 02 20:38:47.215887 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:47.215776 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/37e0a6e2-fadc-4db4-818e-e62b0ccecbc6-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n6fvr\" (UID: \"37e0a6e2-fadc-4db4-818e-e62b0ccecbc6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n6fvr" Jul 02 20:38:47.215887 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:47.215792 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/37e0a6e2-fadc-4db4-818e-e62b0ccecbc6-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n6fvr\" (UID: \"37e0a6e2-fadc-4db4-818e-e62b0ccecbc6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n6fvr" Jul 02 20:38:47.216097 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:47.216055 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/37e0a6e2-fadc-4db4-818e-e62b0ccecbc6-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n6fvr\" (UID: \"37e0a6e2-fadc-4db4-818e-e62b0ccecbc6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n6fvr" Jul 02 20:38:47.216172 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:47.216150 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/37e0a6e2-fadc-4db4-818e-e62b0ccecbc6-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n6fvr\" (UID: \"37e0a6e2-fadc-4db4-818e-e62b0ccecbc6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n6fvr" Jul 02 20:38:47.216371 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:47.216352 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/37e0a6e2-fadc-4db4-818e-e62b0ccecbc6-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n6fvr\" (UID: \"37e0a6e2-fadc-4db4-818e-e62b0ccecbc6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n6fvr" Jul 02 20:38:47.217792 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:47.217771 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/37e0a6e2-fadc-4db4-818e-e62b0ccecbc6-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n6fvr\" (UID: \"37e0a6e2-fadc-4db4-818e-e62b0ccecbc6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n6fvr" Jul 02 20:38:47.217897 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:47.217793 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/37e0a6e2-fadc-4db4-818e-e62b0ccecbc6-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n6fvr\" (UID: \"37e0a6e2-fadc-4db4-818e-e62b0ccecbc6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n6fvr" Jul 02 20:38:47.225129 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:47.225101 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65q87\" (UniqueName: \"kubernetes.io/projected/37e0a6e2-fadc-4db4-818e-e62b0ccecbc6-kube-api-access-65q87\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n6fvr\" (UID: \"37e0a6e2-fadc-4db4-818e-e62b0ccecbc6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n6fvr" Jul 02 20:38:47.226271 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:47.226241 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/37e0a6e2-fadc-4db4-818e-e62b0ccecbc6-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4n6fvr\" (UID: \"37e0a6e2-fadc-4db4-818e-e62b0ccecbc6\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n6fvr" Jul 02 20:38:47.369567 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:47.369495 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n6fvr" Jul 02 20:38:47.561466 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:47.561437 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n6fvr"] Jul 02 20:38:47.563438 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:38:47.563402 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37e0a6e2_fadc_4db4_818e_e62b0ccecbc6.slice/crio-ca90313f6016359e2f030bac8464239089677aef5404a833fe5c5bd6adadc0f2 WatchSource:0}: Error finding container ca90313f6016359e2f030bac8464239089677aef5404a833fe5c5bd6adadc0f2: Status 404 returned error can't find the container with id ca90313f6016359e2f030bac8464239089677aef5404a833fe5c5bd6adadc0f2 Jul 02 20:38:48.052122 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:48.052081 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n6fvr" event={"ID":"37e0a6e2-fadc-4db4-818e-e62b0ccecbc6","Type":"ContainerStarted","Data":"ca90313f6016359e2f030bac8464239089677aef5404a833fe5c5bd6adadc0f2"} Jul 02 20:38:49.416346 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:49.416310 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-svgb4"] Jul 02 20:38:49.424281 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:49.424253 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-svgb4" Jul 02 20:38:49.431725 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:49.430909 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 02 20:38:49.431725 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:49.430927 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-s76vk\"" Jul 02 20:38:49.438128 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:49.438021 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-dngrh"] Jul 02 20:38:49.444411 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:49.444390 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-svgb4"] Jul 02 20:38:49.444528 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:49.444510 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dngrh" Jul 02 20:38:49.447091 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:49.447064 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 02 20:38:49.447257 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:49.447066 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-w4jss\"" Jul 02 20:38:49.460800 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:49.460780 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-dngrh"] Jul 02 20:38:49.540903 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:49.540861 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/667003da-7aff-4b8c-acf4-68288835814d-cert\") pod \"kserve-controller-manager-d6f4b65b8-svgb4\" (UID: \"667003da-7aff-4b8c-acf4-68288835814d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-svgb4" Jul 02 20:38:49.541181 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:49.540923 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tqnhh\" (UniqueName: \"kubernetes.io/projected/e059fe1a-b773-4a3c-be9b-e679d5f763e5-kube-api-access-tqnhh\") pod \"llmisvc-controller-manager-777c6bd7d5-dngrh\" (UID: \"e059fe1a-b773-4a3c-be9b-e679d5f763e5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dngrh" Jul 02 20:38:49.541181 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:49.540953 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmh75\" (UniqueName: \"kubernetes.io/projected/667003da-7aff-4b8c-acf4-68288835814d-kube-api-access-kmh75\") pod \"kserve-controller-manager-d6f4b65b8-svgb4\" (UID: \"667003da-7aff-4b8c-acf4-68288835814d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-svgb4" Jul 02 20:38:49.541181 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:49.540990 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e059fe1a-b773-4a3c-be9b-e679d5f763e5-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dngrh\" (UID: \"e059fe1a-b773-4a3c-be9b-e679d5f763e5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dngrh" Jul 02 20:38:49.642811 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:49.642244 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/667003da-7aff-4b8c-acf4-68288835814d-cert\") pod \"kserve-controller-manager-d6f4b65b8-svgb4\" (UID: \"667003da-7aff-4b8c-acf4-68288835814d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-svgb4" Jul 02 20:38:49.642811 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:49.642297 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tqnhh\" (UniqueName: \"kubernetes.io/projected/e059fe1a-b773-4a3c-be9b-e679d5f763e5-kube-api-access-tqnhh\") pod \"llmisvc-controller-manager-777c6bd7d5-dngrh\" (UID: \"e059fe1a-b773-4a3c-be9b-e679d5f763e5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dngrh" Jul 02 20:38:49.642811 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:49.642328 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmh75\" (UniqueName: \"kubernetes.io/projected/667003da-7aff-4b8c-acf4-68288835814d-kube-api-access-kmh75\") pod \"kserve-controller-manager-d6f4b65b8-svgb4\" (UID: \"667003da-7aff-4b8c-acf4-68288835814d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-svgb4" Jul 02 20:38:49.642811 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:49.642361 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e059fe1a-b773-4a3c-be9b-e679d5f763e5-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dngrh\" (UID: \"e059fe1a-b773-4a3c-be9b-e679d5f763e5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dngrh" Jul 02 20:38:49.642811 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:38:49.642419 2568 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 02 20:38:49.642811 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:38:49.642509 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/667003da-7aff-4b8c-acf4-68288835814d-cert podName:667003da-7aff-4b8c-acf4-68288835814d nodeName:}" failed. No retries permitted until 2026-07-02 20:38:50.142485452 +0000 UTC m=+368.595406535 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/667003da-7aff-4b8c-acf4-68288835814d-cert") pod "kserve-controller-manager-d6f4b65b8-svgb4" (UID: "667003da-7aff-4b8c-acf4-68288835814d") : secret "kserve-webhook-server-cert" not found Jul 02 20:38:49.645245 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:49.645220 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e059fe1a-b773-4a3c-be9b-e679d5f763e5-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-dngrh\" (UID: \"e059fe1a-b773-4a3c-be9b-e679d5f763e5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dngrh" Jul 02 20:38:49.658141 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:49.658091 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmh75\" (UniqueName: \"kubernetes.io/projected/667003da-7aff-4b8c-acf4-68288835814d-kube-api-access-kmh75\") pod \"kserve-controller-manager-d6f4b65b8-svgb4\" (UID: \"667003da-7aff-4b8c-acf4-68288835814d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-svgb4" Jul 02 20:38:49.658909 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:49.658886 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tqnhh\" (UniqueName: \"kubernetes.io/projected/e059fe1a-b773-4a3c-be9b-e679d5f763e5-kube-api-access-tqnhh\") pod \"llmisvc-controller-manager-777c6bd7d5-dngrh\" (UID: \"e059fe1a-b773-4a3c-be9b-e679d5f763e5\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dngrh" Jul 02 20:38:49.761720 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:49.761640 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dngrh" Jul 02 20:38:50.142928 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:50.142897 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh"] Jul 02 20:38:50.143102 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:50.143079 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh" podUID="ec844500-a4c8-4f49-9469-7d4d4952fa8b" containerName="discovery" containerID="cri-o://14ecb07ed76fef3f4011a67444e335476d9f6097e63c82af223064c7354d8ff6" gracePeriod=30 Jul 02 20:38:50.148125 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:50.148038 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/667003da-7aff-4b8c-acf4-68288835814d-cert\") pod \"kserve-controller-manager-d6f4b65b8-svgb4\" (UID: \"667003da-7aff-4b8c-acf4-68288835814d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-svgb4" Jul 02 20:38:50.150546 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:50.150522 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/667003da-7aff-4b8c-acf4-68288835814d-cert\") pod \"kserve-controller-manager-d6f4b65b8-svgb4\" (UID: \"667003da-7aff-4b8c-acf4-68288835814d\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-svgb4" Jul 02 20:38:50.198348 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:50.198318 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:38:50.198443 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:50.198387 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:38:50.198443 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:50.198419 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:38:50.269572 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:38:50.269540 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode059fe1a_b773_4a3c_be9b_e679d5f763e5.slice/crio-1fc54033366168bbc49e733ef06836724723ac812e650bb337bc7ad8c2d100ee WatchSource:0}: Error finding container 1fc54033366168bbc49e733ef06836724723ac812e650bb337bc7ad8c2d100ee: Status 404 returned error can't find the container with id 1fc54033366168bbc49e733ef06836724723ac812e650bb337bc7ad8c2d100ee Jul 02 20:38:50.270974 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:50.270951 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-dngrh"] Jul 02 20:38:50.348399 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:50.348368 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-svgb4" Jul 02 20:38:50.390258 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:50.390228 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh" Jul 02 20:38:50.450435 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:50.450408 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ec844500-a4c8-4f49-9469-7d4d4952fa8b-istio-csr-dns-cert\") pod \"ec844500-a4c8-4f49-9469-7d4d4952fa8b\" (UID: \"ec844500-a4c8-4f49-9469-7d4d4952fa8b\") " Jul 02 20:38:50.450812 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:50.450537 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ec844500-a4c8-4f49-9469-7d4d4952fa8b-istio-csr-ca-configmap\") pod \"ec844500-a4c8-4f49-9469-7d4d4952fa8b\" (UID: \"ec844500-a4c8-4f49-9469-7d4d4952fa8b\") " Jul 02 20:38:50.450812 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:50.450583 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec844500-a4c8-4f49-9469-7d4d4952fa8b-local-certs\") pod \"ec844500-a4c8-4f49-9469-7d4d4952fa8b\" (UID: \"ec844500-a4c8-4f49-9469-7d4d4952fa8b\") " Jul 02 20:38:50.450812 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:50.450611 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ec844500-a4c8-4f49-9469-7d4d4952fa8b-istio-kubeconfig\") pod \"ec844500-a4c8-4f49-9469-7d4d4952fa8b\" (UID: \"ec844500-a4c8-4f49-9469-7d4d4952fa8b\") " Jul 02 20:38:50.450812 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:50.450645 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec844500-a4c8-4f49-9469-7d4d4952fa8b-istio-token\") pod \"ec844500-a4c8-4f49-9469-7d4d4952fa8b\" (UID: \"ec844500-a4c8-4f49-9469-7d4d4952fa8b\") " Jul 02 20:38:50.450812 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:50.450676 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-db29c\" (UniqueName: \"kubernetes.io/projected/ec844500-a4c8-4f49-9469-7d4d4952fa8b-kube-api-access-db29c\") pod \"ec844500-a4c8-4f49-9469-7d4d4952fa8b\" (UID: \"ec844500-a4c8-4f49-9469-7d4d4952fa8b\") " Jul 02 20:38:50.450812 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:50.450724 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ec844500-a4c8-4f49-9469-7d4d4952fa8b-cacerts\") pod \"ec844500-a4c8-4f49-9469-7d4d4952fa8b\" (UID: \"ec844500-a4c8-4f49-9469-7d4d4952fa8b\") " Jul 02 20:38:50.452013 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:50.451570 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec844500-a4c8-4f49-9469-7d4d4952fa8b-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "ec844500-a4c8-4f49-9469-7d4d4952fa8b" (UID: "ec844500-a4c8-4f49-9469-7d4d4952fa8b"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:38:50.456634 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:50.456590 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec844500-a4c8-4f49-9469-7d4d4952fa8b-istio-token" (OuterVolumeSpecName: "istio-token") pod "ec844500-a4c8-4f49-9469-7d4d4952fa8b" (UID: "ec844500-a4c8-4f49-9469-7d4d4952fa8b"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:38:50.457000 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:50.456772 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec844500-a4c8-4f49-9469-7d4d4952fa8b-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "ec844500-a4c8-4f49-9469-7d4d4952fa8b" (UID: "ec844500-a4c8-4f49-9469-7d4d4952fa8b"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 20:38:50.457000 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:50.456911 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec844500-a4c8-4f49-9469-7d4d4952fa8b-local-certs" (OuterVolumeSpecName: "local-certs") pod "ec844500-a4c8-4f49-9469-7d4d4952fa8b" (UID: "ec844500-a4c8-4f49-9469-7d4d4952fa8b"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:38:50.457457 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:50.456798 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec844500-a4c8-4f49-9469-7d4d4952fa8b-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "ec844500-a4c8-4f49-9469-7d4d4952fa8b" (UID: "ec844500-a4c8-4f49-9469-7d4d4952fa8b"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 20:38:50.458376 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:50.458344 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec844500-a4c8-4f49-9469-7d4d4952fa8b-cacerts" (OuterVolumeSpecName: "cacerts") pod "ec844500-a4c8-4f49-9469-7d4d4952fa8b" (UID: "ec844500-a4c8-4f49-9469-7d4d4952fa8b"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 20:38:50.458555 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:50.458536 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec844500-a4c8-4f49-9469-7d4d4952fa8b-kube-api-access-db29c" (OuterVolumeSpecName: "kube-api-access-db29c") pod "ec844500-a4c8-4f49-9469-7d4d4952fa8b" (UID: "ec844500-a4c8-4f49-9469-7d4d4952fa8b"). InnerVolumeSpecName "kube-api-access-db29c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:38:50.508907 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:50.508882 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-svgb4"] Jul 02 20:38:50.510574 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:38:50.510549 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod667003da_7aff_4b8c_acf4_68288835814d.slice/crio-4928d8630fd47f620cb32a505b88793a5abf17bf04f69f435b19ff8439de8257 WatchSource:0}: Error finding container 4928d8630fd47f620cb32a505b88793a5abf17bf04f69f435b19ff8439de8257: Status 404 returned error can't find the container with id 4928d8630fd47f620cb32a505b88793a5abf17bf04f69f435b19ff8439de8257 Jul 02 20:38:50.552446 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:50.552425 2568 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/ec844500-a4c8-4f49-9469-7d4d4952fa8b-istio-csr-ca-configmap\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:38:50.552446 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:50.552446 2568 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/ec844500-a4c8-4f49-9469-7d4d4952fa8b-local-certs\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:38:50.552562 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:50.552457 2568 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/ec844500-a4c8-4f49-9469-7d4d4952fa8b-istio-kubeconfig\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:38:50.552562 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:50.552466 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ec844500-a4c8-4f49-9469-7d4d4952fa8b-istio-token\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:38:50.552562 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:50.552475 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-db29c\" (UniqueName: \"kubernetes.io/projected/ec844500-a4c8-4f49-9469-7d4d4952fa8b-kube-api-access-db29c\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:38:50.552562 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:50.552484 2568 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/ec844500-a4c8-4f49-9469-7d4d4952fa8b-cacerts\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:38:50.552562 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:50.552492 2568 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/ec844500-a4c8-4f49-9469-7d4d4952fa8b-istio-csr-dns-cert\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:38:51.076311 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:51.076223 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dngrh" event={"ID":"e059fe1a-b773-4a3c-be9b-e679d5f763e5","Type":"ContainerStarted","Data":"1fc54033366168bbc49e733ef06836724723ac812e650bb337bc7ad8c2d100ee"} Jul 02 20:38:51.079032 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:51.078952 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-svgb4" event={"ID":"667003da-7aff-4b8c-acf4-68288835814d","Type":"ContainerStarted","Data":"4928d8630fd47f620cb32a505b88793a5abf17bf04f69f435b19ff8439de8257"} Jul 02 20:38:51.083481 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:51.083425 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n6fvr" event={"ID":"37e0a6e2-fadc-4db4-818e-e62b0ccecbc6","Type":"ContainerStarted","Data":"06d974ea7d3930cf34de220c3a433bdea64a34a331b341e6985e7a9134d437b1"} Jul 02 20:38:51.086315 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:51.086270 2568 generic.go:356] "Generic (PLEG): container finished" podID="ec844500-a4c8-4f49-9469-7d4d4952fa8b" containerID="14ecb07ed76fef3f4011a67444e335476d9f6097e63c82af223064c7354d8ff6" exitCode=0 Jul 02 20:38:51.086434 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:51.086316 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh" event={"ID":"ec844500-a4c8-4f49-9469-7d4d4952fa8b","Type":"ContainerDied","Data":"14ecb07ed76fef3f4011a67444e335476d9f6097e63c82af223064c7354d8ff6"} Jul 02 20:38:51.086434 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:51.086354 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh" event={"ID":"ec844500-a4c8-4f49-9469-7d4d4952fa8b","Type":"ContainerDied","Data":"92cd9e32aefeaca34ac545c08270d1675b4248c1f9ad41db52bd6c9002dae83d"} Jul 02 20:38:51.086434 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:51.086383 2568 scope.go:117] "RemoveContainer" containerID="14ecb07ed76fef3f4011a67444e335476d9f6097e63c82af223064c7354d8ff6" Jul 02 20:38:51.086601 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:51.086532 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh" Jul 02 20:38:51.119029 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:51.117958 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n6fvr" podStartSLOduration=1.48591308 podStartE2EDuration="4.117938306s" totalImagesPullingTime="2.632025226s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:38:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:38:51.114140926 +0000 UTC m=+369.567062022" watchObservedRunningTime="2026-07-02 20:38:51.117938306 +0000 UTC m=+369.570859405" Jul 02 20:38:51.133827 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:51.133782 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh"] Jul 02 20:38:51.138054 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:51.138033 2568 scope.go:117] "RemoveContainer" containerID="14ecb07ed76fef3f4011a67444e335476d9f6097e63c82af223064c7354d8ff6" Jul 02 20:38:51.138469 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:38:51.138440 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"14ecb07ed76fef3f4011a67444e335476d9f6097e63c82af223064c7354d8ff6\": container with ID starting with 14ecb07ed76fef3f4011a67444e335476d9f6097e63c82af223064c7354d8ff6 not found: ID does not exist" containerID="14ecb07ed76fef3f4011a67444e335476d9f6097e63c82af223064c7354d8ff6" Jul 02 20:38:51.138572 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:51.138528 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"14ecb07ed76fef3f4011a67444e335476d9f6097e63c82af223064c7354d8ff6"} err="failed to get container status \"14ecb07ed76fef3f4011a67444e335476d9f6097e63c82af223064c7354d8ff6\": rpc error: code = NotFound desc = could not find container \"14ecb07ed76fef3f4011a67444e335476d9f6097e63c82af223064c7354d8ff6\": container with ID starting with 14ecb07ed76fef3f4011a67444e335476d9f6097e63c82af223064c7354d8ff6 not found: ID does not exist" Jul 02 20:38:51.147720 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:51.147671 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-9fjqh"] Jul 02 20:38:51.370625 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:51.370542 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n6fvr" Jul 02 20:38:51.376367 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:51.376339 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n6fvr" Jul 02 20:38:52.092888 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:52.092833 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n6fvr" Jul 02 20:38:52.094020 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:52.094000 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4n6fvr" Jul 02 20:38:52.364282 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:52.364199 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec844500-a4c8-4f49-9469-7d4d4952fa8b" path="/var/lib/kubelet/pods/ec844500-a4c8-4f49-9469-7d4d4952fa8b/volumes" Jul 02 20:38:54.103803 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:54.103767 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dngrh" event={"ID":"e059fe1a-b773-4a3c-be9b-e679d5f763e5","Type":"ContainerStarted","Data":"05006845c653b04bb64c591913a6718c2b0cbd6bb4ba242b58fd4c889d845a8d"} Jul 02 20:38:54.104219 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:54.103902 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dngrh" Jul 02 20:38:54.105320 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:54.105297 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-svgb4" event={"ID":"667003da-7aff-4b8c-acf4-68288835814d","Type":"ContainerStarted","Data":"5d663623ca2290943f285f43d625855e9bb07fd734111f94c38da4fad28d478e"} Jul 02 20:38:54.105564 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:54.105554 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-svgb4" Jul 02 20:38:54.121101 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:54.121050 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dngrh" podStartSLOduration=1.847456125 podStartE2EDuration="5.121033602s" totalImagesPullingTime="3.273577477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:38:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:38:54.120441737 +0000 UTC m=+372.573362847" watchObservedRunningTime="2026-07-02 20:38:54.121033602 +0000 UTC m=+372.573954701" Jul 02 20:38:54.141577 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:54.141535 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-svgb4" podStartSLOduration=2.111673874 podStartE2EDuration="5.141524243s" totalImagesPullingTime="3.029850369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:38:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:38:54.139001224 +0000 UTC m=+372.591922325" watchObservedRunningTime="2026-07-02 20:38:54.141524243 +0000 UTC m=+372.594445340" Jul 02 20:38:57.039982 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:57.039954 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-nht7x" Jul 02 20:38:57.041801 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:38:57.041782 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-jqhb2" Jul 02 20:39:25.113208 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:25.113182 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-dngrh" Jul 02 20:39:25.116013 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:25.115998 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-svgb4" Jul 02 20:39:39.437659 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:39.437624 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7j9d4"] Jul 02 20:39:39.438025 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:39.437986 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec844500-a4c8-4f49-9469-7d4d4952fa8b" containerName="discovery" Jul 02 20:39:39.438025 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:39.437997 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec844500-a4c8-4f49-9469-7d4d4952fa8b" containerName="discovery" Jul 02 20:39:39.438093 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:39.438074 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec844500-a4c8-4f49-9469-7d4d4952fa8b" containerName="discovery" Jul 02 20:39:39.441101 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:39.441080 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7j9d4" Jul 02 20:39:39.443350 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:39.443330 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 20:39:39.443456 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:39.443354 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 20:39:39.444380 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:39.444357 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-t56nb\"" Jul 02 20:39:39.451943 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:39.451919 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7j9d4"] Jul 02 20:39:39.573489 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:39.573458 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27m4q\" (UniqueName: \"kubernetes.io/projected/49ca28ed-e6cf-4e73-96ac-8f05209308e4-kube-api-access-27m4q\") pod \"kuadrant-operator-catalog-7j9d4\" (UID: \"49ca28ed-e6cf-4e73-96ac-8f05209308e4\") " pod="kuadrant-system/kuadrant-operator-catalog-7j9d4" Jul 02 20:39:39.674720 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:39.674686 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27m4q\" (UniqueName: \"kubernetes.io/projected/49ca28ed-e6cf-4e73-96ac-8f05209308e4-kube-api-access-27m4q\") pod \"kuadrant-operator-catalog-7j9d4\" (UID: \"49ca28ed-e6cf-4e73-96ac-8f05209308e4\") " pod="kuadrant-system/kuadrant-operator-catalog-7j9d4" Jul 02 20:39:39.682679 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:39.682652 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27m4q\" (UniqueName: \"kubernetes.io/projected/49ca28ed-e6cf-4e73-96ac-8f05209308e4-kube-api-access-27m4q\") pod \"kuadrant-operator-catalog-7j9d4\" (UID: \"49ca28ed-e6cf-4e73-96ac-8f05209308e4\") " pod="kuadrant-system/kuadrant-operator-catalog-7j9d4" Jul 02 20:39:39.751911 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:39.751821 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7j9d4" Jul 02 20:39:39.812712 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:39.812665 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7j9d4"] Jul 02 20:39:39.887312 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:39.887286 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7j9d4"] Jul 02 20:39:39.889493 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:39:39.889467 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49ca28ed_e6cf_4e73_96ac_8f05209308e4.slice/crio-92808ef6ba71cbf844315da50253abed7424d3d80222905efad2f4429134a155 WatchSource:0}: Error finding container 92808ef6ba71cbf844315da50253abed7424d3d80222905efad2f4429134a155: Status 404 returned error can't find the container with id 92808ef6ba71cbf844315da50253abed7424d3d80222905efad2f4429134a155 Jul 02 20:39:40.025273 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:40.025206 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fgppc"] Jul 02 20:39:40.029707 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:40.029686 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fgppc" Jul 02 20:39:40.040545 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:40.040522 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fgppc"] Jul 02 20:39:40.078089 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:40.078059 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-995bp\" (UniqueName: \"kubernetes.io/projected/b51f11ee-1142-4ab2-bea4-5a82a6f2f29a-kube-api-access-995bp\") pod \"kuadrant-operator-catalog-fgppc\" (UID: \"b51f11ee-1142-4ab2-bea4-5a82a6f2f29a\") " pod="kuadrant-system/kuadrant-operator-catalog-fgppc" Jul 02 20:39:40.178915 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:40.178883 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-995bp\" (UniqueName: \"kubernetes.io/projected/b51f11ee-1142-4ab2-bea4-5a82a6f2f29a-kube-api-access-995bp\") pod \"kuadrant-operator-catalog-fgppc\" (UID: \"b51f11ee-1142-4ab2-bea4-5a82a6f2f29a\") " pod="kuadrant-system/kuadrant-operator-catalog-fgppc" Jul 02 20:39:40.188549 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:40.188526 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-995bp\" (UniqueName: \"kubernetes.io/projected/b51f11ee-1142-4ab2-bea4-5a82a6f2f29a-kube-api-access-995bp\") pod \"kuadrant-operator-catalog-fgppc\" (UID: \"b51f11ee-1142-4ab2-bea4-5a82a6f2f29a\") " pod="kuadrant-system/kuadrant-operator-catalog-fgppc" Jul 02 20:39:40.316981 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:40.316824 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7j9d4" event={"ID":"49ca28ed-e6cf-4e73-96ac-8f05209308e4","Type":"ContainerStarted","Data":"92808ef6ba71cbf844315da50253abed7424d3d80222905efad2f4429134a155"} Jul 02 20:39:40.339192 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:40.339166 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fgppc" Jul 02 20:39:40.483885 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:40.483836 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fgppc"] Jul 02 20:39:40.502980 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:39:40.502953 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb51f11ee_1142_4ab2_bea4_5a82a6f2f29a.slice/crio-6e9bf42c8d60b43232fcc0708a8a9a25d89865534aef2abaebed1baacef07f9b WatchSource:0}: Error finding container 6e9bf42c8d60b43232fcc0708a8a9a25d89865534aef2abaebed1baacef07f9b: Status 404 returned error can't find the container with id 6e9bf42c8d60b43232fcc0708a8a9a25d89865534aef2abaebed1baacef07f9b Jul 02 20:39:41.323447 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:41.323417 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fgppc" event={"ID":"b51f11ee-1142-4ab2-bea4-5a82a6f2f29a","Type":"ContainerStarted","Data":"6e9bf42c8d60b43232fcc0708a8a9a25d89865534aef2abaebed1baacef07f9b"} Jul 02 20:39:42.329771 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:42.329734 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7j9d4" event={"ID":"49ca28ed-e6cf-4e73-96ac-8f05209308e4","Type":"ContainerStarted","Data":"8dde3e647b70d4bb07a9c4e78d36a13bffb039d5d8e4ac86acee4608dfa68088"} Jul 02 20:39:42.330214 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:42.329783 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-7j9d4" podUID="49ca28ed-e6cf-4e73-96ac-8f05209308e4" containerName="registry-server" containerID="cri-o://8dde3e647b70d4bb07a9c4e78d36a13bffb039d5d8e4ac86acee4608dfa68088" gracePeriod=2 Jul 02 20:39:42.331336 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:42.331313 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fgppc" event={"ID":"b51f11ee-1142-4ab2-bea4-5a82a6f2f29a","Type":"ContainerStarted","Data":"aeb5b6b7be2a0bcf2cf14ee99d9299781a9dbbe9d8759beec3524ad4bd6143da"} Jul 02 20:39:42.345792 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:42.345758 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-7j9d4" podStartSLOduration=1.45338581 podStartE2EDuration="3.345745393s" totalImagesPullingTime="1.892359583s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:39:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:39:42.344190612 +0000 UTC m=+420.797111709" watchObservedRunningTime="2026-07-02 20:39:42.345745393 +0000 UTC m=+420.798666491" Jul 02 20:39:42.358683 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:42.358643 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-fgppc" podStartSLOduration=1.079297473 podStartE2EDuration="2.358629868s" totalImagesPullingTime="1.279332395s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:39:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:39:42.357649313 +0000 UTC m=+420.810570410" watchObservedRunningTime="2026-07-02 20:39:42.358629868 +0000 UTC m=+420.811550965" Jul 02 20:39:42.584644 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:42.584591 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7j9d4" Jul 02 20:39:42.702891 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:42.702835 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27m4q\" (UniqueName: \"kubernetes.io/projected/49ca28ed-e6cf-4e73-96ac-8f05209308e4-kube-api-access-27m4q\") pod \"49ca28ed-e6cf-4e73-96ac-8f05209308e4\" (UID: \"49ca28ed-e6cf-4e73-96ac-8f05209308e4\") " Jul 02 20:39:42.704807 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:42.704786 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49ca28ed-e6cf-4e73-96ac-8f05209308e4-kube-api-access-27m4q" (OuterVolumeSpecName: "kube-api-access-27m4q") pod "49ca28ed-e6cf-4e73-96ac-8f05209308e4" (UID: "49ca28ed-e6cf-4e73-96ac-8f05209308e4"). InnerVolumeSpecName "kube-api-access-27m4q". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:39:42.803865 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:42.803818 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27m4q\" (UniqueName: \"kubernetes.io/projected/49ca28ed-e6cf-4e73-96ac-8f05209308e4-kube-api-access-27m4q\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:39:43.336529 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:43.336501 2568 generic.go:356] "Generic (PLEG): container finished" podID="49ca28ed-e6cf-4e73-96ac-8f05209308e4" containerID="8dde3e647b70d4bb07a9c4e78d36a13bffb039d5d8e4ac86acee4608dfa68088" exitCode=0 Jul 02 20:39:43.336983 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:43.336542 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-7j9d4" Jul 02 20:39:43.336983 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:43.336594 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7j9d4" event={"ID":"49ca28ed-e6cf-4e73-96ac-8f05209308e4","Type":"ContainerDied","Data":"8dde3e647b70d4bb07a9c4e78d36a13bffb039d5d8e4ac86acee4608dfa68088"} Jul 02 20:39:43.336983 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:43.336648 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-7j9d4" event={"ID":"49ca28ed-e6cf-4e73-96ac-8f05209308e4","Type":"ContainerDied","Data":"92808ef6ba71cbf844315da50253abed7424d3d80222905efad2f4429134a155"} Jul 02 20:39:43.336983 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:43.336679 2568 scope.go:117] "RemoveContainer" containerID="8dde3e647b70d4bb07a9c4e78d36a13bffb039d5d8e4ac86acee4608dfa68088" Jul 02 20:39:43.345790 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:43.345774 2568 scope.go:117] "RemoveContainer" containerID="8dde3e647b70d4bb07a9c4e78d36a13bffb039d5d8e4ac86acee4608dfa68088" Jul 02 20:39:43.346061 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:39:43.346044 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8dde3e647b70d4bb07a9c4e78d36a13bffb039d5d8e4ac86acee4608dfa68088\": container with ID starting with 8dde3e647b70d4bb07a9c4e78d36a13bffb039d5d8e4ac86acee4608dfa68088 not found: ID does not exist" containerID="8dde3e647b70d4bb07a9c4e78d36a13bffb039d5d8e4ac86acee4608dfa68088" Jul 02 20:39:43.346133 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:43.346068 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8dde3e647b70d4bb07a9c4e78d36a13bffb039d5d8e4ac86acee4608dfa68088"} err="failed to get container status \"8dde3e647b70d4bb07a9c4e78d36a13bffb039d5d8e4ac86acee4608dfa68088\": rpc error: code = NotFound desc = could not find container \"8dde3e647b70d4bb07a9c4e78d36a13bffb039d5d8e4ac86acee4608dfa68088\": container with ID starting with 8dde3e647b70d4bb07a9c4e78d36a13bffb039d5d8e4ac86acee4608dfa68088 not found: ID does not exist" Jul 02 20:39:43.357480 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:43.357459 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7j9d4"] Jul 02 20:39:43.361630 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:43.361609 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-7j9d4"] Jul 02 20:39:44.362988 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:44.362956 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49ca28ed-e6cf-4e73-96ac-8f05209308e4" path="/var/lib/kubelet/pods/49ca28ed-e6cf-4e73-96ac-8f05209308e4/volumes" Jul 02 20:39:50.340191 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:50.340158 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-fgppc" Jul 02 20:39:50.340543 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:50.340215 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-fgppc" Jul 02 20:39:50.364670 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:50.364643 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-fgppc" Jul 02 20:39:50.388605 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:39:50.388580 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-fgppc" Jul 02 20:40:05.174539 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:05.174462 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mlh4l"] Jul 02 20:40:05.175003 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:05.174823 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49ca28ed-e6cf-4e73-96ac-8f05209308e4" containerName="registry-server" Jul 02 20:40:05.175003 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:05.174834 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="49ca28ed-e6cf-4e73-96ac-8f05209308e4" containerName="registry-server" Jul 02 20:40:05.175003 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:05.174921 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="49ca28ed-e6cf-4e73-96ac-8f05209308e4" containerName="registry-server" Jul 02 20:40:05.177815 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:05.177799 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mlh4l" Jul 02 20:40:05.180000 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:05.179979 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-f69vl\"" Jul 02 20:40:05.190022 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:05.189995 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mlh4l"] Jul 02 20:40:05.198438 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:05.198413 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5cfp\" (UniqueName: \"kubernetes.io/projected/db95ceef-44af-43b7-9afa-210bfa83912c-kube-api-access-b5cfp\") pod \"limitador-operator-controller-manager-859d7b78bd-mlh4l\" (UID: \"db95ceef-44af-43b7-9afa-210bfa83912c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mlh4l" Jul 02 20:40:05.300976 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:05.300938 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5cfp\" (UniqueName: \"kubernetes.io/projected/db95ceef-44af-43b7-9afa-210bfa83912c-kube-api-access-b5cfp\") pod \"limitador-operator-controller-manager-859d7b78bd-mlh4l\" (UID: \"db95ceef-44af-43b7-9afa-210bfa83912c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mlh4l" Jul 02 20:40:05.321991 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:05.321964 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5cfp\" (UniqueName: \"kubernetes.io/projected/db95ceef-44af-43b7-9afa-210bfa83912c-kube-api-access-b5cfp\") pod \"limitador-operator-controller-manager-859d7b78bd-mlh4l\" (UID: \"db95ceef-44af-43b7-9afa-210bfa83912c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mlh4l" Jul 02 20:40:05.488066 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:05.487995 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mlh4l" Jul 02 20:40:05.623196 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:05.623098 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mlh4l"] Jul 02 20:40:05.625471 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:40:05.625427 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb95ceef_44af_43b7_9afa_210bfa83912c.slice/crio-c9630ad1efe6eb51a5ba7c199a6e7d40e065ed9d2020950b53f2ca31d7017783 WatchSource:0}: Error finding container c9630ad1efe6eb51a5ba7c199a6e7d40e065ed9d2020950b53f2ca31d7017783: Status 404 returned error can't find the container with id c9630ad1efe6eb51a5ba7c199a6e7d40e065ed9d2020950b53f2ca31d7017783 Jul 02 20:40:06.438465 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:06.438431 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mlh4l" event={"ID":"db95ceef-44af-43b7-9afa-210bfa83912c","Type":"ContainerStarted","Data":"c9630ad1efe6eb51a5ba7c199a6e7d40e065ed9d2020950b53f2ca31d7017783"} Jul 02 20:40:07.443908 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:07.443876 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mlh4l" event={"ID":"db95ceef-44af-43b7-9afa-210bfa83912c","Type":"ContainerStarted","Data":"623f8be71c6a9e7829be6bb2393db48cdffe1f854505a840e50e3fd43bb7d66b"} Jul 02 20:40:07.444268 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:07.443935 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mlh4l" Jul 02 20:40:07.464452 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:07.464400 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mlh4l" podStartSLOduration=1.106711073 podStartE2EDuration="2.464383119s" totalImagesPullingTime="1.357672046s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:40:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:40:07.463513353 +0000 UTC m=+445.916434461" watchObservedRunningTime="2026-07-02 20:40:07.464383119 +0000 UTC m=+445.917304218" Jul 02 20:40:10.547380 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:10.547348 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf97r"] Jul 02 20:40:10.556735 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:10.556708 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf97r" Jul 02 20:40:10.559684 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:10.559667 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-97plq\"" Jul 02 20:40:10.586909 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:10.586881 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf97r"] Jul 02 20:40:10.654573 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:10.654539 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkh4j\" (UniqueName: \"kubernetes.io/projected/3fab7766-2175-4554-a949-15922307bd11-kube-api-access-mkh4j\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bf97r\" (UID: \"3fab7766-2175-4554-a949-15922307bd11\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf97r" Jul 02 20:40:10.654732 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:10.654658 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3fab7766-2175-4554-a949-15922307bd11-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bf97r\" (UID: \"3fab7766-2175-4554-a949-15922307bd11\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf97r" Jul 02 20:40:10.755299 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:10.755269 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3fab7766-2175-4554-a949-15922307bd11-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bf97r\" (UID: \"3fab7766-2175-4554-a949-15922307bd11\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf97r" Jul 02 20:40:10.755456 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:10.755322 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkh4j\" (UniqueName: \"kubernetes.io/projected/3fab7766-2175-4554-a949-15922307bd11-kube-api-access-mkh4j\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bf97r\" (UID: \"3fab7766-2175-4554-a949-15922307bd11\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf97r" Jul 02 20:40:10.755691 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:10.755667 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3fab7766-2175-4554-a949-15922307bd11-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bf97r\" (UID: \"3fab7766-2175-4554-a949-15922307bd11\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf97r" Jul 02 20:40:10.764163 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:10.764135 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkh4j\" (UniqueName: \"kubernetes.io/projected/3fab7766-2175-4554-a949-15922307bd11-kube-api-access-mkh4j\") pod \"kuadrant-operator-controller-manager-8684c9ff49-bf97r\" (UID: \"3fab7766-2175-4554-a949-15922307bd11\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf97r" Jul 02 20:40:10.866704 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:10.866632 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf97r" Jul 02 20:40:11.002702 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:11.002665 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf97r"] Jul 02 20:40:11.005888 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:40:11.005864 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fab7766_2175_4554_a949_15922307bd11.slice/crio-ecc17f819b062bb886ad4dfbe2ac434331a72ec33a0d3809e7ddb26850a0cb14 WatchSource:0}: Error finding container ecc17f819b062bb886ad4dfbe2ac434331a72ec33a0d3809e7ddb26850a0cb14: Status 404 returned error can't find the container with id ecc17f819b062bb886ad4dfbe2ac434331a72ec33a0d3809e7ddb26850a0cb14 Jul 02 20:40:11.462601 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:11.462572 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf97r" event={"ID":"3fab7766-2175-4554-a949-15922307bd11","Type":"ContainerStarted","Data":"ecc17f819b062bb886ad4dfbe2ac434331a72ec33a0d3809e7ddb26850a0cb14"} Jul 02 20:40:13.784195 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:13.784160 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qlv5j"] Jul 02 20:40:13.787701 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:13.787682 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qlv5j" Jul 02 20:40:13.789951 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:13.789932 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-6g9ns\"" Jul 02 20:40:13.790203 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:13.790189 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 02 20:40:13.799913 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:13.799889 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qlv5j"] Jul 02 20:40:13.886814 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:13.886775 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pft9n\" (UniqueName: \"kubernetes.io/projected/ee4e3e0a-627b-4033-968e-2cc8f8fb43ca-kube-api-access-pft9n\") pod \"dns-operator-controller-manager-864dd78c4c-qlv5j\" (UID: \"ee4e3e0a-627b-4033-968e-2cc8f8fb43ca\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qlv5j" Jul 02 20:40:13.987568 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:13.987535 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pft9n\" (UniqueName: \"kubernetes.io/projected/ee4e3e0a-627b-4033-968e-2cc8f8fb43ca-kube-api-access-pft9n\") pod \"dns-operator-controller-manager-864dd78c4c-qlv5j\" (UID: \"ee4e3e0a-627b-4033-968e-2cc8f8fb43ca\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qlv5j" Jul 02 20:40:13.996318 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:13.996291 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pft9n\" (UniqueName: \"kubernetes.io/projected/ee4e3e0a-627b-4033-968e-2cc8f8fb43ca-kube-api-access-pft9n\") pod \"dns-operator-controller-manager-864dd78c4c-qlv5j\" (UID: \"ee4e3e0a-627b-4033-968e-2cc8f8fb43ca\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qlv5j" Jul 02 20:40:14.099902 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:14.099803 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qlv5j" Jul 02 20:40:14.259611 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:14.259588 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-qlv5j"] Jul 02 20:40:14.262014 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:40:14.261976 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee4e3e0a_627b_4033_968e_2cc8f8fb43ca.slice/crio-caeef1e863da2647e2db285a3aef030058143cfd1eed2e105504cfb5c4f8e5e0 WatchSource:0}: Error finding container caeef1e863da2647e2db285a3aef030058143cfd1eed2e105504cfb5c4f8e5e0: Status 404 returned error can't find the container with id caeef1e863da2647e2db285a3aef030058143cfd1eed2e105504cfb5c4f8e5e0 Jul 02 20:40:14.478089 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:14.478053 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qlv5j" event={"ID":"ee4e3e0a-627b-4033-968e-2cc8f8fb43ca","Type":"ContainerStarted","Data":"caeef1e863da2647e2db285a3aef030058143cfd1eed2e105504cfb5c4f8e5e0"} Jul 02 20:40:17.234430 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:17.234349 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-r4bv9"] Jul 02 20:40:17.238102 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:17.238079 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-r4bv9" Jul 02 20:40:17.240460 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:17.240436 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-6b9m9\"" Jul 02 20:40:17.247500 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:17.247479 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-r4bv9"] Jul 02 20:40:17.323351 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:17.323318 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d76c7\" (UniqueName: \"kubernetes.io/projected/95cade37-7239-44fd-9abd-50668cbd5bc6-kube-api-access-d76c7\") pod \"authorino-operator-75cc8d5cb7-r4bv9\" (UID: \"95cade37-7239-44fd-9abd-50668cbd5bc6\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-r4bv9" Jul 02 20:40:17.424659 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:17.424619 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d76c7\" (UniqueName: \"kubernetes.io/projected/95cade37-7239-44fd-9abd-50668cbd5bc6-kube-api-access-d76c7\") pod \"authorino-operator-75cc8d5cb7-r4bv9\" (UID: \"95cade37-7239-44fd-9abd-50668cbd5bc6\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-r4bv9" Jul 02 20:40:17.444691 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:17.444656 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d76c7\" (UniqueName: \"kubernetes.io/projected/95cade37-7239-44fd-9abd-50668cbd5bc6-kube-api-access-d76c7\") pod \"authorino-operator-75cc8d5cb7-r4bv9\" (UID: \"95cade37-7239-44fd-9abd-50668cbd5bc6\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-r4bv9" Jul 02 20:40:17.495416 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:17.495341 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf97r" event={"ID":"3fab7766-2175-4554-a949-15922307bd11","Type":"ContainerStarted","Data":"e4028a6369d70699fba26cb1c71fb08bde04c773a371a293b5b7b7fcae6bb7ea"} Jul 02 20:40:17.495554 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:17.495419 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf97r" Jul 02 20:40:17.496945 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:17.496924 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qlv5j" event={"ID":"ee4e3e0a-627b-4033-968e-2cc8f8fb43ca","Type":"ContainerStarted","Data":"f82b03ebb47bc283e078b82bf845fe16fbe091ced555b20c2f2eb1a3b541e327"} Jul 02 20:40:17.497067 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:17.497008 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qlv5j" Jul 02 20:40:17.518587 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:17.518541 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf97r" podStartSLOduration=1.9540518740000001 podStartE2EDuration="7.518527676s" totalImagesPullingTime="5.564475802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:40:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:40:17.516499243 +0000 UTC m=+455.969420341" watchObservedRunningTime="2026-07-02 20:40:17.518527676 +0000 UTC m=+455.971448774" Jul 02 20:40:17.536538 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:17.536489 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qlv5j" podStartSLOduration=1.805224415 podStartE2EDuration="4.536477428s" totalImagesPullingTime="2.731253013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:40:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:40:17.534412462 +0000 UTC m=+455.987333586" watchObservedRunningTime="2026-07-02 20:40:17.536477428 +0000 UTC m=+455.989398525" Jul 02 20:40:17.550049 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:17.550022 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-r4bv9" Jul 02 20:40:17.690280 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:17.690251 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-r4bv9"] Jul 02 20:40:17.692733 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:40:17.692699 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95cade37_7239_44fd_9abd_50668cbd5bc6.slice/crio-5c90e26e73506ef5d1764cc964ba881990fe2190da8e6fba91b120ccfd6b4482 WatchSource:0}: Error finding container 5c90e26e73506ef5d1764cc964ba881990fe2190da8e6fba91b120ccfd6b4482: Status 404 returned error can't find the container with id 5c90e26e73506ef5d1764cc964ba881990fe2190da8e6fba91b120ccfd6b4482 Jul 02 20:40:18.450551 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:18.450514 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mlh4l" Jul 02 20:40:18.507282 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:18.507240 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-r4bv9" event={"ID":"95cade37-7239-44fd-9abd-50668cbd5bc6","Type":"ContainerStarted","Data":"5c90e26e73506ef5d1764cc964ba881990fe2190da8e6fba91b120ccfd6b4482"} Jul 02 20:40:20.519479 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:20.519438 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-r4bv9" event={"ID":"95cade37-7239-44fd-9abd-50668cbd5bc6","Type":"ContainerStarted","Data":"a7fe541ac52acf9b5fe089e6b70970e8e5f7f7de259a824868d25694881926c3"} Jul 02 20:40:20.519821 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:20.519536 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-r4bv9" Jul 02 20:40:20.538714 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:20.538675 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-r4bv9" podStartSLOduration=1.3639926390000001 podStartE2EDuration="3.538661982s" totalImagesPullingTime="2.174669343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:40:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:40:20.536975151 +0000 UTC m=+458.989896250" watchObservedRunningTime="2026-07-02 20:40:20.538661982 +0000 UTC m=+458.991583081" Jul 02 20:40:28.510085 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:28.510046 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf97r" Jul 02 20:40:28.510573 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:28.510113 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-qlv5j" Jul 02 20:40:30.382282 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.382251 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf97r"] Jul 02 20:40:30.382664 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.382460 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf97r" podUID="3fab7766-2175-4554-a949-15922307bd11" containerName="manager" containerID="cri-o://e4028a6369d70699fba26cb1c71fb08bde04c773a371a293b5b7b7fcae6bb7ea" gracePeriod=2 Jul 02 20:40:30.388063 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.388041 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf97r"] Jul 02 20:40:30.400755 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.400729 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mlh4l"] Jul 02 20:40:30.401009 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.400965 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mlh4l" podUID="db95ceef-44af-43b7-9afa-210bfa83912c" containerName="manager" containerID="cri-o://623f8be71c6a9e7829be6bb2393db48cdffe1f854505a840e50e3fd43bb7d66b" gracePeriod=2 Jul 02 20:40:30.402978 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:40:30.402947 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bf97r\" is forbidden: User \"system:node:ip-10-0-137-144.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-144.ec2.internal' and this object" podUID="3fab7766-2175-4554-a949-15922307bd11" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf97r" Jul 02 20:40:30.415274 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.415115 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mlh4l"] Jul 02 20:40:30.415632 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:40:30.415589 2568 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"db95ceef-44af-43b7-9afa-210bfa83912c\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-mlh4l\": pods \"limitador-operator-controller-manager-859d7b78bd-mlh4l\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mlh4l" Jul 02 20:40:30.417060 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.417016 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpc55"] Jul 02 20:40:30.422875 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.417696 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db95ceef-44af-43b7-9afa-210bfa83912c" containerName="manager" Jul 02 20:40:30.423005 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.422989 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="db95ceef-44af-43b7-9afa-210bfa83912c" containerName="manager" Jul 02 20:40:30.423090 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.423079 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3fab7766-2175-4554-a949-15922307bd11" containerName="manager" Jul 02 20:40:30.424468 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.423148 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="3fab7766-2175-4554-a949-15922307bd11" containerName="manager" Jul 02 20:40:30.424468 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.423276 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="3fab7766-2175-4554-a949-15922307bd11" containerName="manager" Jul 02 20:40:30.424468 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.423290 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="db95ceef-44af-43b7-9afa-210bfa83912c" containerName="manager" Jul 02 20:40:30.433722 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.433123 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpc55" Jul 02 20:40:30.439742 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:40:30.439712 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bf97r\" is forbidden: User \"system:node:ip-10-0-137-144.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-144.ec2.internal' and this object" podUID="3fab7766-2175-4554-a949-15922307bd11" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf97r" Jul 02 20:40:30.441892 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:40:30.441863 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mlh4l\" is forbidden: User \"system:node:ip-10-0-137-144.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-144.ec2.internal' and this object" podUID="db95ceef-44af-43b7-9afa-210bfa83912c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mlh4l" Jul 02 20:40:30.442206 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.442190 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mkwwv"] Jul 02 20:40:30.455647 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.455608 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpc55"] Jul 02 20:40:30.455825 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.455663 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mkwwv"] Jul 02 20:40:30.455825 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.455755 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mkwwv" Jul 02 20:40:30.480246 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:40:30.480215 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bf97r\" is forbidden: User \"system:node:ip-10-0-137-144.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-144.ec2.internal' and this object" podUID="3fab7766-2175-4554-a949-15922307bd11" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf97r" Jul 02 20:40:30.481906 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:40:30.481876 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mlh4l\" is forbidden: User \"system:node:ip-10-0-137-144.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-144.ec2.internal' and this object" podUID="db95ceef-44af-43b7-9afa-210bfa83912c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mlh4l" Jul 02 20:40:30.544353 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.544267 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p9jtx\" (UniqueName: \"kubernetes.io/projected/00b021c2-e961-4f95-b988-d1acfcd98e03-kube-api-access-p9jtx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jpc55\" (UID: \"00b021c2-e961-4f95-b988-d1acfcd98e03\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpc55" Jul 02 20:40:30.544353 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.544302 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcjpm\" (UniqueName: \"kubernetes.io/projected/c68c3411-b472-4b48-aaef-b036051d630a-kube-api-access-hcjpm\") pod \"limitador-operator-controller-manager-859d7b78bd-mkwwv\" (UID: \"c68c3411-b472-4b48-aaef-b036051d630a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mkwwv" Jul 02 20:40:30.544353 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.544325 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/00b021c2-e961-4f95-b988-d1acfcd98e03-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jpc55\" (UID: \"00b021c2-e961-4f95-b988-d1acfcd98e03\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpc55" Jul 02 20:40:30.579864 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.579822 2568 generic.go:356] "Generic (PLEG): container finished" podID="db95ceef-44af-43b7-9afa-210bfa83912c" containerID="623f8be71c6a9e7829be6bb2393db48cdffe1f854505a840e50e3fd43bb7d66b" exitCode=0 Jul 02 20:40:30.581898 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.581870 2568 generic.go:356] "Generic (PLEG): container finished" podID="3fab7766-2175-4554-a949-15922307bd11" containerID="e4028a6369d70699fba26cb1c71fb08bde04c773a371a293b5b7b7fcae6bb7ea" exitCode=0 Jul 02 20:40:30.644931 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.644902 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p9jtx\" (UniqueName: \"kubernetes.io/projected/00b021c2-e961-4f95-b988-d1acfcd98e03-kube-api-access-p9jtx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jpc55\" (UID: \"00b021c2-e961-4f95-b988-d1acfcd98e03\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpc55" Jul 02 20:40:30.645044 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.644944 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcjpm\" (UniqueName: \"kubernetes.io/projected/c68c3411-b472-4b48-aaef-b036051d630a-kube-api-access-hcjpm\") pod \"limitador-operator-controller-manager-859d7b78bd-mkwwv\" (UID: \"c68c3411-b472-4b48-aaef-b036051d630a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mkwwv" Jul 02 20:40:30.645044 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.644978 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/00b021c2-e961-4f95-b988-d1acfcd98e03-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jpc55\" (UID: \"00b021c2-e961-4f95-b988-d1acfcd98e03\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpc55" Jul 02 20:40:30.645510 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.645490 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/00b021c2-e961-4f95-b988-d1acfcd98e03-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jpc55\" (UID: \"00b021c2-e961-4f95-b988-d1acfcd98e03\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpc55" Jul 02 20:40:30.649196 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.649178 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf97r" Jul 02 20:40:30.651173 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:40:30.651146 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bf97r\" is forbidden: User \"system:node:ip-10-0-137-144.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-144.ec2.internal' and this object" podUID="3fab7766-2175-4554-a949-15922307bd11" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf97r" Jul 02 20:40:30.651265 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.651220 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mlh4l" Jul 02 20:40:30.652835 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:40:30.652811 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mlh4l\" is forbidden: User \"system:node:ip-10-0-137-144.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-144.ec2.internal' and this object" podUID="db95ceef-44af-43b7-9afa-210bfa83912c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mlh4l" Jul 02 20:40:30.654579 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:40:30.654560 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bf97r\" is forbidden: User \"system:node:ip-10-0-137-144.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-144.ec2.internal' and this object" podUID="3fab7766-2175-4554-a949-15922307bd11" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf97r" Jul 02 20:40:30.656340 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:40:30.656319 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mlh4l\" is forbidden: User \"system:node:ip-10-0-137-144.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-144.ec2.internal' and this object" podUID="db95ceef-44af-43b7-9afa-210bfa83912c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mlh4l" Jul 02 20:40:30.656806 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.656786 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p9jtx\" (UniqueName: \"kubernetes.io/projected/00b021c2-e961-4f95-b988-d1acfcd98e03-kube-api-access-p9jtx\") pod \"kuadrant-operator-controller-manager-8684c9ff49-jpc55\" (UID: \"00b021c2-e961-4f95-b988-d1acfcd98e03\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpc55" Jul 02 20:40:30.657476 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.657455 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcjpm\" (UniqueName: \"kubernetes.io/projected/c68c3411-b472-4b48-aaef-b036051d630a-kube-api-access-hcjpm\") pod \"limitador-operator-controller-manager-859d7b78bd-mkwwv\" (UID: \"c68c3411-b472-4b48-aaef-b036051d630a\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mkwwv" Jul 02 20:40:30.745984 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.745961 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mkh4j\" (UniqueName: \"kubernetes.io/projected/3fab7766-2175-4554-a949-15922307bd11-kube-api-access-mkh4j\") pod \"3fab7766-2175-4554-a949-15922307bd11\" (UID: \"3fab7766-2175-4554-a949-15922307bd11\") " Jul 02 20:40:30.746099 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.745992 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3fab7766-2175-4554-a949-15922307bd11-extensions-socket-volume\") pod \"3fab7766-2175-4554-a949-15922307bd11\" (UID: \"3fab7766-2175-4554-a949-15922307bd11\") " Jul 02 20:40:30.746099 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.746072 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b5cfp\" (UniqueName: \"kubernetes.io/projected/db95ceef-44af-43b7-9afa-210bfa83912c-kube-api-access-b5cfp\") pod \"db95ceef-44af-43b7-9afa-210bfa83912c\" (UID: \"db95ceef-44af-43b7-9afa-210bfa83912c\") " Jul 02 20:40:30.746433 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.746407 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3fab7766-2175-4554-a949-15922307bd11-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "3fab7766-2175-4554-a949-15922307bd11" (UID: "3fab7766-2175-4554-a949-15922307bd11"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:40:30.747922 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.747903 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db95ceef-44af-43b7-9afa-210bfa83912c-kube-api-access-b5cfp" (OuterVolumeSpecName: "kube-api-access-b5cfp") pod "db95ceef-44af-43b7-9afa-210bfa83912c" (UID: "db95ceef-44af-43b7-9afa-210bfa83912c"). InnerVolumeSpecName "kube-api-access-b5cfp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:40:30.748007 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.747990 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3fab7766-2175-4554-a949-15922307bd11-kube-api-access-mkh4j" (OuterVolumeSpecName: "kube-api-access-mkh4j") pod "3fab7766-2175-4554-a949-15922307bd11" (UID: "3fab7766-2175-4554-a949-15922307bd11"). InnerVolumeSpecName "kube-api-access-mkh4j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:40:30.829867 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.829823 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpc55" Jul 02 20:40:30.836959 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.836940 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mkwwv" Jul 02 20:40:30.846942 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.846916 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mkh4j\" (UniqueName: \"kubernetes.io/projected/3fab7766-2175-4554-a949-15922307bd11-kube-api-access-mkh4j\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:40:30.847035 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.846945 2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/3fab7766-2175-4554-a949-15922307bd11-extensions-socket-volume\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:40:30.847035 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.846960 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b5cfp\" (UniqueName: \"kubernetes.io/projected/db95ceef-44af-43b7-9afa-210bfa83912c-kube-api-access-b5cfp\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:40:30.975327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.975300 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpc55"] Jul 02 20:40:30.977439 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:40:30.977411 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00b021c2_e961_4f95_b988_d1acfcd98e03.slice/crio-6d818efbc623e903007e69c9ba65e9c96a5253a71b3ea4ddb0a0baf26fcff688 WatchSource:0}: Error finding container 6d818efbc623e903007e69c9ba65e9c96a5253a71b3ea4ddb0a0baf26fcff688: Status 404 returned error can't find the container with id 6d818efbc623e903007e69c9ba65e9c96a5253a71b3ea4ddb0a0baf26fcff688 Jul 02 20:40:30.995438 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:30.995420 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mkwwv"] Jul 02 20:40:30.997867 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:40:30.997827 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc68c3411_b472_4b48_aaef_b036051d630a.slice/crio-8d4a1b1fd32854650c8cbc590ea384da4af65ed0f25e81c952b8365b89fe9b4f WatchSource:0}: Error finding container 8d4a1b1fd32854650c8cbc590ea384da4af65ed0f25e81c952b8365b89fe9b4f: Status 404 returned error can't find the container with id 8d4a1b1fd32854650c8cbc590ea384da4af65ed0f25e81c952b8365b89fe9b4f Jul 02 20:40:31.526560 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:31.526537 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-r4bv9" Jul 02 20:40:31.546992 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:40:31.546957 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mlh4l\" is forbidden: User \"system:node:ip-10-0-137-144.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-144.ec2.internal' and this object" podUID="db95ceef-44af-43b7-9afa-210bfa83912c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mlh4l" Jul 02 20:40:31.549192 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:40:31.549168 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bf97r\" is forbidden: User \"system:node:ip-10-0-137-144.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-144.ec2.internal' and this object" podUID="3fab7766-2175-4554-a949-15922307bd11" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf97r" Jul 02 20:40:31.589674 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:31.589641 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mkwwv" event={"ID":"c68c3411-b472-4b48-aaef-b036051d630a","Type":"ContainerStarted","Data":"89317b0e842ccfd42ff69149722bc2b5b6c79904c294e9471ed07007629f646d"} Jul 02 20:40:31.589808 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:31.589703 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mkwwv" Jul 02 20:40:31.589808 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:31.589722 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mkwwv" event={"ID":"c68c3411-b472-4b48-aaef-b036051d630a","Type":"ContainerStarted","Data":"8d4a1b1fd32854650c8cbc590ea384da4af65ed0f25e81c952b8365b89fe9b4f"} Jul 02 20:40:31.591173 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:31.591152 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf97r" Jul 02 20:40:31.591302 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:31.591179 2568 scope.go:117] "RemoveContainer" containerID="e4028a6369d70699fba26cb1c71fb08bde04c773a371a293b5b7b7fcae6bb7ea" Jul 02 20:40:31.592631 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:31.592609 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mlh4l" Jul 02 20:40:31.594983 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:31.594963 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpc55" event={"ID":"00b021c2-e961-4f95-b988-d1acfcd98e03","Type":"ContainerStarted","Data":"780e2fed86544a847643a35870d6db3d04a454e08c7632919049a73169585b86"} Jul 02 20:40:31.595092 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:31.595006 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpc55" event={"ID":"00b021c2-e961-4f95-b988-d1acfcd98e03","Type":"ContainerStarted","Data":"6d818efbc623e903007e69c9ba65e9c96a5253a71b3ea4ddb0a0baf26fcff688"} Jul 02 20:40:31.595092 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:31.595047 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpc55" Jul 02 20:40:31.601710 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:31.601189 2568 scope.go:117] "RemoveContainer" containerID="623f8be71c6a9e7829be6bb2393db48cdffe1f854505a840e50e3fd43bb7d66b" Jul 02 20:40:31.611308 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:40:31.611278 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bf97r\" is forbidden: User \"system:node:ip-10-0-137-144.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-144.ec2.internal' and this object" podUID="3fab7766-2175-4554-a949-15922307bd11" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf97r" Jul 02 20:40:31.612046 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:31.612009 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mkwwv" podStartSLOduration=1.6119965939999998 podStartE2EDuration="1.611996594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:40:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:40:31.609438103 +0000 UTC m=+470.062359202" watchObservedRunningTime="2026-07-02 20:40:31.611996594 +0000 UTC m=+470.064917684" Jul 02 20:40:31.612971 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:40:31.612940 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mlh4l\" is forbidden: User \"system:node:ip-10-0-137-144.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-144.ec2.internal' and this object" podUID="db95ceef-44af-43b7-9afa-210bfa83912c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mlh4l" Jul 02 20:40:31.614735 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:40:31.614713 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bf97r\" is forbidden: User \"system:node:ip-10-0-137-144.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-144.ec2.internal' and this object" podUID="3fab7766-2175-4554-a949-15922307bd11" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf97r" Jul 02 20:40:31.616475 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:40:31.616457 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mlh4l\" is forbidden: User \"system:node:ip-10-0-137-144.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-144.ec2.internal' and this object" podUID="db95ceef-44af-43b7-9afa-210bfa83912c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mlh4l" Jul 02 20:40:31.638167 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:31.638130 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpc55" podStartSLOduration=1.6381165960000001 podStartE2EDuration="1.638116596s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:40:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:40:31.636412963 +0000 UTC m=+470.089334090" watchObservedRunningTime="2026-07-02 20:40:31.638116596 +0000 UTC m=+470.091037693" Jul 02 20:40:32.362011 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:40:32.361970 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-bf97r\" is forbidden: User \"system:node:ip-10-0-137-144.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-144.ec2.internal' and this object" podUID="3fab7766-2175-4554-a949-15922307bd11" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-bf97r" Jul 02 20:40:32.363860 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:40:32.363830 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-mlh4l\" is forbidden: User \"system:node:ip-10-0-137-144.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-137-144.ec2.internal' and this object" podUID="db95ceef-44af-43b7-9afa-210bfa83912c" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mlh4l" Jul 02 20:40:32.363965 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:32.363898 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3fab7766-2175-4554-a949-15922307bd11" path="/var/lib/kubelet/pods/3fab7766-2175-4554-a949-15922307bd11/volumes" Jul 02 20:40:32.364229 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:32.364215 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db95ceef-44af-43b7-9afa-210bfa83912c" path="/var/lib/kubelet/pods/db95ceef-44af-43b7-9afa-210bfa83912c/volumes" Jul 02 20:40:42.603959 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:42.603923 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpc55" Jul 02 20:40:42.604397 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:42.603986 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-mkwwv" Jul 02 20:40:59.654294 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:59.654261 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpc55"] Jul 02 20:40:59.654742 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:59.654498 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpc55" podUID="00b021c2-e961-4f95-b988-d1acfcd98e03" containerName="manager" containerID="cri-o://780e2fed86544a847643a35870d6db3d04a454e08c7632919049a73169585b86" gracePeriod=10 Jul 02 20:40:59.910703 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:59.910641 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpc55" Jul 02 20:40:59.991542 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:59.991510 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p9jtx\" (UniqueName: \"kubernetes.io/projected/00b021c2-e961-4f95-b988-d1acfcd98e03-kube-api-access-p9jtx\") pod \"00b021c2-e961-4f95-b988-d1acfcd98e03\" (UID: \"00b021c2-e961-4f95-b988-d1acfcd98e03\") " Jul 02 20:40:59.991687 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:59.991643 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/00b021c2-e961-4f95-b988-d1acfcd98e03-extensions-socket-volume\") pod \"00b021c2-e961-4f95-b988-d1acfcd98e03\" (UID: \"00b021c2-e961-4f95-b988-d1acfcd98e03\") " Jul 02 20:40:59.991977 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:59.991954 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/00b021c2-e961-4f95-b988-d1acfcd98e03-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "00b021c2-e961-4f95-b988-d1acfcd98e03" (UID: "00b021c2-e961-4f95-b988-d1acfcd98e03"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:40:59.993537 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:40:59.993514 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/00b021c2-e961-4f95-b988-d1acfcd98e03-kube-api-access-p9jtx" (OuterVolumeSpecName: "kube-api-access-p9jtx") pod "00b021c2-e961-4f95-b988-d1acfcd98e03" (UID: "00b021c2-e961-4f95-b988-d1acfcd98e03"). InnerVolumeSpecName "kube-api-access-p9jtx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:41:00.093252 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:00.093214 2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/00b021c2-e961-4f95-b988-d1acfcd98e03-extensions-socket-volume\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:41:00.093252 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:00.093245 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p9jtx\" (UniqueName: \"kubernetes.io/projected/00b021c2-e961-4f95-b988-d1acfcd98e03-kube-api-access-p9jtx\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:41:00.743179 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:00.743150 2568 generic.go:356] "Generic (PLEG): container finished" podID="00b021c2-e961-4f95-b988-d1acfcd98e03" containerID="780e2fed86544a847643a35870d6db3d04a454e08c7632919049a73169585b86" exitCode=0 Jul 02 20:41:00.743586 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:00.743196 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpc55" Jul 02 20:41:00.743586 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:00.743242 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpc55" event={"ID":"00b021c2-e961-4f95-b988-d1acfcd98e03","Type":"ContainerDied","Data":"780e2fed86544a847643a35870d6db3d04a454e08c7632919049a73169585b86"} Jul 02 20:41:00.743586 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:00.743299 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpc55" event={"ID":"00b021c2-e961-4f95-b988-d1acfcd98e03","Type":"ContainerDied","Data":"6d818efbc623e903007e69c9ba65e9c96a5253a71b3ea4ddb0a0baf26fcff688"} Jul 02 20:41:00.743586 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:00.743325 2568 scope.go:117] "RemoveContainer" containerID="780e2fed86544a847643a35870d6db3d04a454e08c7632919049a73169585b86" Jul 02 20:41:00.752388 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:00.752364 2568 scope.go:117] "RemoveContainer" containerID="780e2fed86544a847643a35870d6db3d04a454e08c7632919049a73169585b86" Jul 02 20:41:00.752639 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:41:00.752620 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"780e2fed86544a847643a35870d6db3d04a454e08c7632919049a73169585b86\": container with ID starting with 780e2fed86544a847643a35870d6db3d04a454e08c7632919049a73169585b86 not found: ID does not exist" containerID="780e2fed86544a847643a35870d6db3d04a454e08c7632919049a73169585b86" Jul 02 20:41:00.752702 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:00.752649 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"780e2fed86544a847643a35870d6db3d04a454e08c7632919049a73169585b86"} err="failed to get container status \"780e2fed86544a847643a35870d6db3d04a454e08c7632919049a73169585b86\": rpc error: code = NotFound desc = could not find container \"780e2fed86544a847643a35870d6db3d04a454e08c7632919049a73169585b86\": container with ID starting with 780e2fed86544a847643a35870d6db3d04a454e08c7632919049a73169585b86 not found: ID does not exist" Jul 02 20:41:00.765378 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:00.765347 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpc55"] Jul 02 20:41:00.774548 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:00.774529 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-jpc55"] Jul 02 20:41:02.363498 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:02.363457 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="00b021c2-e961-4f95-b988-d1acfcd98e03" path="/var/lib/kubelet/pods/00b021c2-e961-4f95-b988-d1acfcd98e03/volumes" Jul 02 20:41:16.082841 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.082804 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp"] Jul 02 20:41:16.083323 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.083254 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00b021c2-e961-4f95-b988-d1acfcd98e03" containerName="manager" Jul 02 20:41:16.083323 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.083266 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="00b021c2-e961-4f95-b988-d1acfcd98e03" containerName="manager" Jul 02 20:41:16.083432 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.083345 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="00b021c2-e961-4f95-b988-d1acfcd98e03" containerName="manager" Jul 02 20:41:16.086416 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.086391 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" Jul 02 20:41:16.089909 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.089875 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-cb64q\"" Jul 02 20:41:16.111397 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.111372 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp"] Jul 02 20:41:16.232789 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.232757 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81c70b4a-1052-4408-b325-39b47def09bb-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-phcmp\" (UID: \"81c70b4a-1052-4408-b325-39b47def09bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" Jul 02 20:41:16.232789 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.232795 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81c70b4a-1052-4408-b325-39b47def09bb-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-phcmp\" (UID: \"81c70b4a-1052-4408-b325-39b47def09bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" Jul 02 20:41:16.233018 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.232898 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81c70b4a-1052-4408-b325-39b47def09bb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-phcmp\" (UID: \"81c70b4a-1052-4408-b325-39b47def09bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" Jul 02 20:41:16.233018 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.232917 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81c70b4a-1052-4408-b325-39b47def09bb-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-phcmp\" (UID: \"81c70b4a-1052-4408-b325-39b47def09bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" Jul 02 20:41:16.233018 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.232934 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4jd8\" (UniqueName: \"kubernetes.io/projected/81c70b4a-1052-4408-b325-39b47def09bb-kube-api-access-h4jd8\") pod \"maas-default-gateway-openshift-default-56654dcf7-phcmp\" (UID: \"81c70b4a-1052-4408-b325-39b47def09bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" Jul 02 20:41:16.233018 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.232952 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81c70b4a-1052-4408-b325-39b47def09bb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-phcmp\" (UID: \"81c70b4a-1052-4408-b325-39b47def09bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" Jul 02 20:41:16.233018 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.232969 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81c70b4a-1052-4408-b325-39b47def09bb-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-phcmp\" (UID: \"81c70b4a-1052-4408-b325-39b47def09bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" Jul 02 20:41:16.233173 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.233036 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81c70b4a-1052-4408-b325-39b47def09bb-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-phcmp\" (UID: \"81c70b4a-1052-4408-b325-39b47def09bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" Jul 02 20:41:16.233173 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.233094 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81c70b4a-1052-4408-b325-39b47def09bb-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-phcmp\" (UID: \"81c70b4a-1052-4408-b325-39b47def09bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" Jul 02 20:41:16.333923 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.333819 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81c70b4a-1052-4408-b325-39b47def09bb-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-phcmp\" (UID: \"81c70b4a-1052-4408-b325-39b47def09bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" Jul 02 20:41:16.333923 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.333864 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4jd8\" (UniqueName: \"kubernetes.io/projected/81c70b4a-1052-4408-b325-39b47def09bb-kube-api-access-h4jd8\") pod \"maas-default-gateway-openshift-default-56654dcf7-phcmp\" (UID: \"81c70b4a-1052-4408-b325-39b47def09bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" Jul 02 20:41:16.333923 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.333892 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81c70b4a-1052-4408-b325-39b47def09bb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-phcmp\" (UID: \"81c70b4a-1052-4408-b325-39b47def09bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" Jul 02 20:41:16.333923 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.333911 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81c70b4a-1052-4408-b325-39b47def09bb-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-phcmp\" (UID: \"81c70b4a-1052-4408-b325-39b47def09bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" Jul 02 20:41:16.334241 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.333940 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81c70b4a-1052-4408-b325-39b47def09bb-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-phcmp\" (UID: \"81c70b4a-1052-4408-b325-39b47def09bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" Jul 02 20:41:16.334241 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.333973 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81c70b4a-1052-4408-b325-39b47def09bb-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-phcmp\" (UID: \"81c70b4a-1052-4408-b325-39b47def09bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" Jul 02 20:41:16.334241 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.334004 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81c70b4a-1052-4408-b325-39b47def09bb-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-phcmp\" (UID: \"81c70b4a-1052-4408-b325-39b47def09bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" Jul 02 20:41:16.334241 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.334040 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81c70b4a-1052-4408-b325-39b47def09bb-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-phcmp\" (UID: \"81c70b4a-1052-4408-b325-39b47def09bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" Jul 02 20:41:16.334241 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.334136 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81c70b4a-1052-4408-b325-39b47def09bb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-phcmp\" (UID: \"81c70b4a-1052-4408-b325-39b47def09bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" Jul 02 20:41:16.334523 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.334304 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/81c70b4a-1052-4408-b325-39b47def09bb-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-phcmp\" (UID: \"81c70b4a-1052-4408-b325-39b47def09bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" Jul 02 20:41:16.334590 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.334566 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/81c70b4a-1052-4408-b325-39b47def09bb-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-phcmp\" (UID: \"81c70b4a-1052-4408-b325-39b47def09bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" Jul 02 20:41:16.334646 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.334596 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/81c70b4a-1052-4408-b325-39b47def09bb-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-phcmp\" (UID: \"81c70b4a-1052-4408-b325-39b47def09bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" Jul 02 20:41:16.334695 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.334673 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/81c70b4a-1052-4408-b325-39b47def09bb-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-phcmp\" (UID: \"81c70b4a-1052-4408-b325-39b47def09bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" Jul 02 20:41:16.334738 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.334725 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/81c70b4a-1052-4408-b325-39b47def09bb-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-phcmp\" (UID: \"81c70b4a-1052-4408-b325-39b47def09bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" Jul 02 20:41:16.336347 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.336319 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/81c70b4a-1052-4408-b325-39b47def09bb-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-phcmp\" (UID: \"81c70b4a-1052-4408-b325-39b47def09bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" Jul 02 20:41:16.336451 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.336439 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/81c70b4a-1052-4408-b325-39b47def09bb-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-phcmp\" (UID: \"81c70b4a-1052-4408-b325-39b47def09bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" Jul 02 20:41:16.346380 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.346355 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/81c70b4a-1052-4408-b325-39b47def09bb-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-phcmp\" (UID: \"81c70b4a-1052-4408-b325-39b47def09bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" Jul 02 20:41:16.346705 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.346684 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4jd8\" (UniqueName: \"kubernetes.io/projected/81c70b4a-1052-4408-b325-39b47def09bb-kube-api-access-h4jd8\") pod \"maas-default-gateway-openshift-default-56654dcf7-phcmp\" (UID: \"81c70b4a-1052-4408-b325-39b47def09bb\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" Jul 02 20:41:16.396089 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.396065 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" Jul 02 20:41:16.534280 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.534242 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp"] Jul 02 20:41:16.536489 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:41:16.536459 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81c70b4a_1052_4408_b325_39b47def09bb.slice/crio-36197994804d115ddbd5599b490aa8837b250b842e1dd795cbe67989457ebf70 WatchSource:0}: Error finding container 36197994804d115ddbd5599b490aa8837b250b842e1dd795cbe67989457ebf70: Status 404 returned error can't find the container with id 36197994804d115ddbd5599b490aa8837b250b842e1dd795cbe67989457ebf70 Jul 02 20:41:16.538478 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.538450 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:41:16.538534 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.538509 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:41:16.538571 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.538536 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:41:16.823401 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.823358 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" event={"ID":"81c70b4a-1052-4408-b325-39b47def09bb","Type":"ContainerStarted","Data":"b8216e4a163a01ae46facd4fe2d96c4429254781c0c487d4837dc1c2ba352b8f"} Jul 02 20:41:16.823401 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.823409 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" event={"ID":"81c70b4a-1052-4408-b325-39b47def09bb","Type":"ContainerStarted","Data":"36197994804d115ddbd5599b490aa8837b250b842e1dd795cbe67989457ebf70"} Jul 02 20:41:16.845654 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:16.845566 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" podStartSLOduration=0.845549648 podStartE2EDuration="845.549648ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:41:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:41:16.844239382 +0000 UTC m=+515.297160479" watchObservedRunningTime="2026-07-02 20:41:16.845549648 +0000 UTC m=+515.298470746" Jul 02 20:41:17.396457 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:17.396425 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" Jul 02 20:41:17.400932 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:17.400909 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" Jul 02 20:41:17.828287 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:17.828212 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" Jul 02 20:41:17.829204 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:17.829186 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" Jul 02 20:41:18.076039 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:18.076007 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-t9hnk"] Jul 02 20:41:18.079980 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:18.079930 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-t9hnk" Jul 02 20:41:18.082450 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:18.082428 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-fzlr4\"" Jul 02 20:41:18.082561 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:18.082439 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 02 20:41:18.085365 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:18.085340 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-t9hnk"] Jul 02 20:41:18.149657 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:18.149617 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4f9c5cd0-eaf4-4926-91a0-0ce376e1098f-config-file\") pod \"limitador-limitador-64c94fd64f-t9hnk\" (UID: \"4f9c5cd0-eaf4-4926-91a0-0ce376e1098f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-t9hnk" Jul 02 20:41:18.149875 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:18.149832 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8swgt\" (UniqueName: \"kubernetes.io/projected/4f9c5cd0-eaf4-4926-91a0-0ce376e1098f-kube-api-access-8swgt\") pod \"limitador-limitador-64c94fd64f-t9hnk\" (UID: \"4f9c5cd0-eaf4-4926-91a0-0ce376e1098f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-t9hnk" Jul 02 20:41:18.174140 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:18.174112 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-t9hnk"] Jul 02 20:41:18.251188 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:18.251158 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8swgt\" (UniqueName: \"kubernetes.io/projected/4f9c5cd0-eaf4-4926-91a0-0ce376e1098f-kube-api-access-8swgt\") pod \"limitador-limitador-64c94fd64f-t9hnk\" (UID: \"4f9c5cd0-eaf4-4926-91a0-0ce376e1098f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-t9hnk" Jul 02 20:41:18.251188 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:18.251192 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4f9c5cd0-eaf4-4926-91a0-0ce376e1098f-config-file\") pod \"limitador-limitador-64c94fd64f-t9hnk\" (UID: \"4f9c5cd0-eaf4-4926-91a0-0ce376e1098f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-t9hnk" Jul 02 20:41:18.251841 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:18.251820 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4f9c5cd0-eaf4-4926-91a0-0ce376e1098f-config-file\") pod \"limitador-limitador-64c94fd64f-t9hnk\" (UID: \"4f9c5cd0-eaf4-4926-91a0-0ce376e1098f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-t9hnk" Jul 02 20:41:18.258974 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:18.258948 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8swgt\" (UniqueName: \"kubernetes.io/projected/4f9c5cd0-eaf4-4926-91a0-0ce376e1098f-kube-api-access-8swgt\") pod \"limitador-limitador-64c94fd64f-t9hnk\" (UID: \"4f9c5cd0-eaf4-4926-91a0-0ce376e1098f\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-t9hnk" Jul 02 20:41:18.390903 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:18.390839 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-t9hnk" Jul 02 20:41:18.525652 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:18.525629 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-t9hnk"] Jul 02 20:41:18.527687 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:41:18.527658 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f9c5cd0_eaf4_4926_91a0_0ce376e1098f.slice/crio-b32db331ce0a7e6935583f1bb84dfe9c0d25dd38bf88f548fe2fae23f7f6da4f WatchSource:0}: Error finding container b32db331ce0a7e6935583f1bb84dfe9c0d25dd38bf88f548fe2fae23f7f6da4f: Status 404 returned error can't find the container with id b32db331ce0a7e6935583f1bb84dfe9c0d25dd38bf88f548fe2fae23f7f6da4f Jul 02 20:41:18.833953 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:18.833872 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-t9hnk" event={"ID":"4f9c5cd0-eaf4-4926-91a0-0ce376e1098f","Type":"ContainerStarted","Data":"b32db331ce0a7e6935583f1bb84dfe9c0d25dd38bf88f548fe2fae23f7f6da4f"} Jul 02 20:41:19.048248 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:19.048211 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-x984l"] Jul 02 20:41:19.051639 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:19.051613 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-x984l" Jul 02 20:41:19.054068 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:19.054044 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-pjx2f\"" Jul 02 20:41:19.057155 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:19.057133 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-x984l"] Jul 02 20:41:19.160392 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:19.160227 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x4zz2\" (UniqueName: \"kubernetes.io/projected/fd8d6075-44ba-40ca-b422-7765c9b8c4c9-kube-api-access-x4zz2\") pod \"authorino-75d556bd77-x984l\" (UID: \"fd8d6075-44ba-40ca-b422-7765c9b8c4c9\") " pod="kuadrant-system/authorino-75d556bd77-x984l" Jul 02 20:41:19.261049 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:19.261010 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x4zz2\" (UniqueName: \"kubernetes.io/projected/fd8d6075-44ba-40ca-b422-7765c9b8c4c9-kube-api-access-x4zz2\") pod \"authorino-75d556bd77-x984l\" (UID: \"fd8d6075-44ba-40ca-b422-7765c9b8c4c9\") " pod="kuadrant-system/authorino-75d556bd77-x984l" Jul 02 20:41:19.279207 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:19.279148 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x4zz2\" (UniqueName: \"kubernetes.io/projected/fd8d6075-44ba-40ca-b422-7765c9b8c4c9-kube-api-access-x4zz2\") pod \"authorino-75d556bd77-x984l\" (UID: \"fd8d6075-44ba-40ca-b422-7765c9b8c4c9\") " pod="kuadrant-system/authorino-75d556bd77-x984l" Jul 02 20:41:19.380065 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:19.380035 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-x984l" Jul 02 20:41:19.531283 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:19.531163 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-x984l"] Jul 02 20:41:19.534086 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:41:19.534055 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfd8d6075_44ba_40ca_b422_7765c9b8c4c9.slice/crio-528d1ece7c7fc3e1990a8e1a5d12dfc6fd316ddbb0f9a960826f66a39ce6f94f WatchSource:0}: Error finding container 528d1ece7c7fc3e1990a8e1a5d12dfc6fd316ddbb0f9a960826f66a39ce6f94f: Status 404 returned error can't find the container with id 528d1ece7c7fc3e1990a8e1a5d12dfc6fd316ddbb0f9a960826f66a39ce6f94f Jul 02 20:41:19.840974 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:19.840890 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-x984l" event={"ID":"fd8d6075-44ba-40ca-b422-7765c9b8c4c9","Type":"ContainerStarted","Data":"528d1ece7c7fc3e1990a8e1a5d12dfc6fd316ddbb0f9a960826f66a39ce6f94f"} Jul 02 20:41:21.857460 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:21.857418 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-t9hnk" event={"ID":"4f9c5cd0-eaf4-4926-91a0-0ce376e1098f","Type":"ContainerStarted","Data":"1857e63898ced5f7f00551bc1d4c7e49682ac4e222a2f844140c73836a38447a"} Jul 02 20:41:21.857914 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:21.857571 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-t9hnk" Jul 02 20:41:21.874132 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:21.874086 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-t9hnk" podStartSLOduration=1.089273041 podStartE2EDuration="3.874071739s" totalImagesPullingTime="2.784798698s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:41:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:41:21.872547287 +0000 UTC m=+520.325468385" watchObservedRunningTime="2026-07-02 20:41:21.874071739 +0000 UTC m=+520.326992872" Jul 02 20:41:23.869216 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:23.869184 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-x984l" event={"ID":"fd8d6075-44ba-40ca-b422-7765c9b8c4c9","Type":"ContainerStarted","Data":"928c6641a7758687fc357ac9c0babb0155c8c0e10e7fc3474295f3d060132e2d"} Jul 02 20:41:23.884021 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:23.883976 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-x984l" podStartSLOduration=1.244613973 podStartE2EDuration="4.883962497s" totalImagesPullingTime="3.639348524s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:41:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:41:23.883730192 +0000 UTC m=+522.336651290" watchObservedRunningTime="2026-07-02 20:41:23.883962497 +0000 UTC m=+522.336883594" Jul 02 20:41:32.735378 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:32.735349 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-t9hnk"] Jul 02 20:41:32.735946 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:32.735550 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-t9hnk" podUID="4f9c5cd0-eaf4-4926-91a0-0ce376e1098f" containerName="limitador" containerID="cri-o://1857e63898ced5f7f00551bc1d4c7e49682ac4e222a2f844140c73836a38447a" gracePeriod=30 Jul 02 20:41:32.736379 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:32.736257 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-t9hnk" Jul 02 20:41:33.287506 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:33.287479 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-t9hnk" Jul 02 20:41:33.290591 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:33.290570 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4f9c5cd0-eaf4-4926-91a0-0ce376e1098f-config-file\") pod \"4f9c5cd0-eaf4-4926-91a0-0ce376e1098f\" (UID: \"4f9c5cd0-eaf4-4926-91a0-0ce376e1098f\") " Jul 02 20:41:33.290713 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:33.290698 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8swgt\" (UniqueName: \"kubernetes.io/projected/4f9c5cd0-eaf4-4926-91a0-0ce376e1098f-kube-api-access-8swgt\") pod \"4f9c5cd0-eaf4-4926-91a0-0ce376e1098f\" (UID: \"4f9c5cd0-eaf4-4926-91a0-0ce376e1098f\") " Jul 02 20:41:33.290874 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:33.290842 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f9c5cd0-eaf4-4926-91a0-0ce376e1098f-config-file" (OuterVolumeSpecName: "config-file") pod "4f9c5cd0-eaf4-4926-91a0-0ce376e1098f" (UID: "4f9c5cd0-eaf4-4926-91a0-0ce376e1098f"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:41:33.290920 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:33.290912 2568 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/4f9c5cd0-eaf4-4926-91a0-0ce376e1098f-config-file\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:41:33.292606 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:33.292583 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4f9c5cd0-eaf4-4926-91a0-0ce376e1098f-kube-api-access-8swgt" (OuterVolumeSpecName: "kube-api-access-8swgt") pod "4f9c5cd0-eaf4-4926-91a0-0ce376e1098f" (UID: "4f9c5cd0-eaf4-4926-91a0-0ce376e1098f"). InnerVolumeSpecName "kube-api-access-8swgt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:41:33.392246 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:33.392216 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8swgt\" (UniqueName: \"kubernetes.io/projected/4f9c5cd0-eaf4-4926-91a0-0ce376e1098f-kube-api-access-8swgt\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:41:33.916239 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:33.916201 2568 generic.go:356] "Generic (PLEG): container finished" podID="4f9c5cd0-eaf4-4926-91a0-0ce376e1098f" containerID="1857e63898ced5f7f00551bc1d4c7e49682ac4e222a2f844140c73836a38447a" exitCode=0 Jul 02 20:41:33.916610 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:33.916248 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-t9hnk" Jul 02 20:41:33.916610 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:33.916288 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-t9hnk" event={"ID":"4f9c5cd0-eaf4-4926-91a0-0ce376e1098f","Type":"ContainerDied","Data":"1857e63898ced5f7f00551bc1d4c7e49682ac4e222a2f844140c73836a38447a"} Jul 02 20:41:33.916610 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:33.916342 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-t9hnk" event={"ID":"4f9c5cd0-eaf4-4926-91a0-0ce376e1098f","Type":"ContainerDied","Data":"b32db331ce0a7e6935583f1bb84dfe9c0d25dd38bf88f548fe2fae23f7f6da4f"} Jul 02 20:41:33.916610 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:33.916364 2568 scope.go:117] "RemoveContainer" containerID="1857e63898ced5f7f00551bc1d4c7e49682ac4e222a2f844140c73836a38447a" Jul 02 20:41:33.925354 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:33.925337 2568 scope.go:117] "RemoveContainer" containerID="1857e63898ced5f7f00551bc1d4c7e49682ac4e222a2f844140c73836a38447a" Jul 02 20:41:33.925603 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:41:33.925585 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1857e63898ced5f7f00551bc1d4c7e49682ac4e222a2f844140c73836a38447a\": container with ID starting with 1857e63898ced5f7f00551bc1d4c7e49682ac4e222a2f844140c73836a38447a not found: ID does not exist" containerID="1857e63898ced5f7f00551bc1d4c7e49682ac4e222a2f844140c73836a38447a" Jul 02 20:41:33.925665 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:33.925611 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1857e63898ced5f7f00551bc1d4c7e49682ac4e222a2f844140c73836a38447a"} err="failed to get container status \"1857e63898ced5f7f00551bc1d4c7e49682ac4e222a2f844140c73836a38447a\": rpc error: code = NotFound desc = could not find container \"1857e63898ced5f7f00551bc1d4c7e49682ac4e222a2f844140c73836a38447a\": container with ID starting with 1857e63898ced5f7f00551bc1d4c7e49682ac4e222a2f844140c73836a38447a not found: ID does not exist" Jul 02 20:41:33.936620 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:33.936595 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-t9hnk"] Jul 02 20:41:33.940327 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:33.940307 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-t9hnk"] Jul 02 20:41:34.363762 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:34.363673 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4f9c5cd0-eaf4-4926-91a0-0ce376e1098f" path="/var/lib/kubelet/pods/4f9c5cd0-eaf4-4926-91a0-0ce376e1098f/volumes" Jul 02 20:41:34.420749 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:34.420718 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-lkjcm"] Jul 02 20:41:34.421321 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:34.421304 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f9c5cd0-eaf4-4926-91a0-0ce376e1098f" containerName="limitador" Jul 02 20:41:34.421367 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:34.421325 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f9c5cd0-eaf4-4926-91a0-0ce376e1098f" containerName="limitador" Jul 02 20:41:34.421446 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:34.421435 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f9c5cd0-eaf4-4926-91a0-0ce376e1098f" containerName="limitador" Jul 02 20:41:34.424922 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:34.424901 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-lkjcm" Jul 02 20:41:34.431358 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:34.430227 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 02 20:41:34.431358 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:34.430341 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-lzwml\"" Jul 02 20:41:34.432492 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:34.432464 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-lkjcm"] Jul 02 20:41:34.501611 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:34.501584 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2klvv\" (UniqueName: \"kubernetes.io/projected/16476007-8920-4b0d-9809-ac9bb3093900-kube-api-access-2klvv\") pod \"postgres-69fb4594cf-lkjcm\" (UID: \"16476007-8920-4b0d-9809-ac9bb3093900\") " pod="opendatahub/postgres-69fb4594cf-lkjcm" Jul 02 20:41:34.501787 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:34.501764 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/16476007-8920-4b0d-9809-ac9bb3093900-data\") pod \"postgres-69fb4594cf-lkjcm\" (UID: \"16476007-8920-4b0d-9809-ac9bb3093900\") " pod="opendatahub/postgres-69fb4594cf-lkjcm" Jul 02 20:41:34.602928 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:34.602891 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2klvv\" (UniqueName: \"kubernetes.io/projected/16476007-8920-4b0d-9809-ac9bb3093900-kube-api-access-2klvv\") pod \"postgres-69fb4594cf-lkjcm\" (UID: \"16476007-8920-4b0d-9809-ac9bb3093900\") " pod="opendatahub/postgres-69fb4594cf-lkjcm" Jul 02 20:41:34.603098 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:34.602988 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/16476007-8920-4b0d-9809-ac9bb3093900-data\") pod \"postgres-69fb4594cf-lkjcm\" (UID: \"16476007-8920-4b0d-9809-ac9bb3093900\") " pod="opendatahub/postgres-69fb4594cf-lkjcm" Jul 02 20:41:34.603292 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:34.603277 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/16476007-8920-4b0d-9809-ac9bb3093900-data\") pod \"postgres-69fb4594cf-lkjcm\" (UID: \"16476007-8920-4b0d-9809-ac9bb3093900\") " pod="opendatahub/postgres-69fb4594cf-lkjcm" Jul 02 20:41:34.611362 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:34.611330 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2klvv\" (UniqueName: \"kubernetes.io/projected/16476007-8920-4b0d-9809-ac9bb3093900-kube-api-access-2klvv\") pod \"postgres-69fb4594cf-lkjcm\" (UID: \"16476007-8920-4b0d-9809-ac9bb3093900\") " pod="opendatahub/postgres-69fb4594cf-lkjcm" Jul 02 20:41:34.740268 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:34.740240 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-lkjcm" Jul 02 20:41:34.865316 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:34.865291 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-lkjcm"] Jul 02 20:41:34.867499 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:41:34.867472 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16476007_8920_4b0d_9809_ac9bb3093900.slice/crio-1bb4c50403b72f8c83b2da827fc13dc72b0fa09c57b95f7583125a6c6fa0b8e4 WatchSource:0}: Error finding container 1bb4c50403b72f8c83b2da827fc13dc72b0fa09c57b95f7583125a6c6fa0b8e4: Status 404 returned error can't find the container with id 1bb4c50403b72f8c83b2da827fc13dc72b0fa09c57b95f7583125a6c6fa0b8e4 Jul 02 20:41:34.923001 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:34.922973 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-lkjcm" event={"ID":"16476007-8920-4b0d-9809-ac9bb3093900","Type":"ContainerStarted","Data":"1bb4c50403b72f8c83b2da827fc13dc72b0fa09c57b95f7583125a6c6fa0b8e4"} Jul 02 20:41:39.954333 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:39.954293 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-lkjcm" event={"ID":"16476007-8920-4b0d-9809-ac9bb3093900","Type":"ContainerStarted","Data":"799bbd46413be8c29c324983b4495b9f964561d9089a7902b897b298777a4ccc"} Jul 02 20:41:39.954723 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:39.954423 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-lkjcm" Jul 02 20:41:39.968895 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:39.968790 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-lkjcm" podStartSLOduration=1.130068493 podStartE2EDuration="5.968776567s" totalImagesPullingTime="4.838708074s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:41:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:41:39.968399486 +0000 UTC m=+538.421320580" watchObservedRunningTime="2026-07-02 20:41:39.968776567 +0000 UTC m=+538.421697665" Jul 02 20:41:45.989165 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:45.989139 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-lkjcm" Jul 02 20:41:46.835329 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:46.835299 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7d4564bb7f-rz28n"] Jul 02 20:41:46.842139 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:46.842119 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d4564bb7f-rz28n" Jul 02 20:41:46.844663 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:46.844639 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 02 20:41:46.845982 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:46.845962 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d4564bb7f-rz28n"] Jul 02 20:41:46.915703 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:46.915676 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/618311de-9be2-493a-8115-f2cef2be60e2-tls-cert\") pod \"authorino-7d4564bb7f-rz28n\" (UID: \"618311de-9be2-493a-8115-f2cef2be60e2\") " pod="kuadrant-system/authorino-7d4564bb7f-rz28n" Jul 02 20:41:46.915832 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:46.915706 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2kvd\" (UniqueName: \"kubernetes.io/projected/618311de-9be2-493a-8115-f2cef2be60e2-kube-api-access-h2kvd\") pod \"authorino-7d4564bb7f-rz28n\" (UID: \"618311de-9be2-493a-8115-f2cef2be60e2\") " pod="kuadrant-system/authorino-7d4564bb7f-rz28n" Jul 02 20:41:47.016811 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:47.016782 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/618311de-9be2-493a-8115-f2cef2be60e2-tls-cert\") pod \"authorino-7d4564bb7f-rz28n\" (UID: \"618311de-9be2-493a-8115-f2cef2be60e2\") " pod="kuadrant-system/authorino-7d4564bb7f-rz28n" Jul 02 20:41:47.016811 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:47.016812 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2kvd\" (UniqueName: \"kubernetes.io/projected/618311de-9be2-493a-8115-f2cef2be60e2-kube-api-access-h2kvd\") pod \"authorino-7d4564bb7f-rz28n\" (UID: \"618311de-9be2-493a-8115-f2cef2be60e2\") " pod="kuadrant-system/authorino-7d4564bb7f-rz28n" Jul 02 20:41:47.019333 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:47.019308 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/618311de-9be2-493a-8115-f2cef2be60e2-tls-cert\") pod \"authorino-7d4564bb7f-rz28n\" (UID: \"618311de-9be2-493a-8115-f2cef2be60e2\") " pod="kuadrant-system/authorino-7d4564bb7f-rz28n" Jul 02 20:41:47.024536 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:47.024514 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2kvd\" (UniqueName: \"kubernetes.io/projected/618311de-9be2-493a-8115-f2cef2be60e2-kube-api-access-h2kvd\") pod \"authorino-7d4564bb7f-rz28n\" (UID: \"618311de-9be2-493a-8115-f2cef2be60e2\") " pod="kuadrant-system/authorino-7d4564bb7f-rz28n" Jul 02 20:41:47.152029 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:47.152003 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d4564bb7f-rz28n" Jul 02 20:41:47.285895 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:47.285869 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7d4564bb7f-rz28n"] Jul 02 20:41:47.288065 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:41:47.288033 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod618311de_9be2_493a_8115_f2cef2be60e2.slice/crio-6b4cba175af59b892ed75f37e4900bedefba0c1ec896614f042cbfe917b35b4d WatchSource:0}: Error finding container 6b4cba175af59b892ed75f37e4900bedefba0c1ec896614f042cbfe917b35b4d: Status 404 returned error can't find the container with id 6b4cba175af59b892ed75f37e4900bedefba0c1ec896614f042cbfe917b35b4d Jul 02 20:41:47.993857 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:47.993813 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d4564bb7f-rz28n" event={"ID":"618311de-9be2-493a-8115-f2cef2be60e2","Type":"ContainerStarted","Data":"6b4cba175af59b892ed75f37e4900bedefba0c1ec896614f042cbfe917b35b4d"} Jul 02 20:41:48.999808 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:48.999769 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d4564bb7f-rz28n" event={"ID":"618311de-9be2-493a-8115-f2cef2be60e2","Type":"ContainerStarted","Data":"3eca29f125e74232eb45094d048f178be4ad6401e7cedeff34403608883d711e"} Jul 02 20:41:49.016154 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:49.016108 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7d4564bb7f-rz28n" podStartSLOduration=1.895359896 podStartE2EDuration="3.016094864s" totalImagesPullingTime="1.120734968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:41:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:41:49.01389188 +0000 UTC m=+547.466812976" watchObservedRunningTime="2026-07-02 20:41:49.016094864 +0000 UTC m=+547.469016007" Jul 02 20:41:49.039066 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:49.039037 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-x984l"] Jul 02 20:41:49.039238 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:49.039217 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-x984l" podUID="fd8d6075-44ba-40ca-b422-7765c9b8c4c9" containerName="authorino" containerID="cri-o://928c6641a7758687fc357ac9c0babb0155c8c0e10e7fc3474295f3d060132e2d" gracePeriod=30 Jul 02 20:41:49.351699 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:49.351676 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-x984l" Jul 02 20:41:49.439741 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:49.439711 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x4zz2\" (UniqueName: \"kubernetes.io/projected/fd8d6075-44ba-40ca-b422-7765c9b8c4c9-kube-api-access-x4zz2\") pod \"fd8d6075-44ba-40ca-b422-7765c9b8c4c9\" (UID: \"fd8d6075-44ba-40ca-b422-7765c9b8c4c9\") " Jul 02 20:41:49.441704 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:49.441678 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd8d6075-44ba-40ca-b422-7765c9b8c4c9-kube-api-access-x4zz2" (OuterVolumeSpecName: "kube-api-access-x4zz2") pod "fd8d6075-44ba-40ca-b422-7765c9b8c4c9" (UID: "fd8d6075-44ba-40ca-b422-7765c9b8c4c9"). InnerVolumeSpecName "kube-api-access-x4zz2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:41:49.541159 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:49.541130 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x4zz2\" (UniqueName: \"kubernetes.io/projected/fd8d6075-44ba-40ca-b422-7765c9b8c4c9-kube-api-access-x4zz2\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:41:50.006080 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:50.006050 2568 generic.go:356] "Generic (PLEG): container finished" podID="fd8d6075-44ba-40ca-b422-7765c9b8c4c9" containerID="928c6641a7758687fc357ac9c0babb0155c8c0e10e7fc3474295f3d060132e2d" exitCode=0 Jul 02 20:41:50.006449 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:50.006092 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-x984l" Jul 02 20:41:50.006449 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:50.006143 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-x984l" event={"ID":"fd8d6075-44ba-40ca-b422-7765c9b8c4c9","Type":"ContainerDied","Data":"928c6641a7758687fc357ac9c0babb0155c8c0e10e7fc3474295f3d060132e2d"} Jul 02 20:41:50.006449 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:50.006180 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-x984l" event={"ID":"fd8d6075-44ba-40ca-b422-7765c9b8c4c9","Type":"ContainerDied","Data":"528d1ece7c7fc3e1990a8e1a5d12dfc6fd316ddbb0f9a960826f66a39ce6f94f"} Jul 02 20:41:50.006449 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:50.006199 2568 scope.go:117] "RemoveContainer" containerID="928c6641a7758687fc357ac9c0babb0155c8c0e10e7fc3474295f3d060132e2d" Jul 02 20:41:50.015720 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:50.015705 2568 scope.go:117] "RemoveContainer" containerID="928c6641a7758687fc357ac9c0babb0155c8c0e10e7fc3474295f3d060132e2d" Jul 02 20:41:50.015995 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:41:50.015974 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"928c6641a7758687fc357ac9c0babb0155c8c0e10e7fc3474295f3d060132e2d\": container with ID starting with 928c6641a7758687fc357ac9c0babb0155c8c0e10e7fc3474295f3d060132e2d not found: ID does not exist" containerID="928c6641a7758687fc357ac9c0babb0155c8c0e10e7fc3474295f3d060132e2d" Jul 02 20:41:50.016073 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:50.016002 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"928c6641a7758687fc357ac9c0babb0155c8c0e10e7fc3474295f3d060132e2d"} err="failed to get container status \"928c6641a7758687fc357ac9c0babb0155c8c0e10e7fc3474295f3d060132e2d\": rpc error: code = NotFound desc = could not find container \"928c6641a7758687fc357ac9c0babb0155c8c0e10e7fc3474295f3d060132e2d\": container with ID starting with 928c6641a7758687fc357ac9c0babb0155c8c0e10e7fc3474295f3d060132e2d not found: ID does not exist" Jul 02 20:41:50.028087 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:50.028068 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-x984l"] Jul 02 20:41:50.031805 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:50.031779 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-x984l"] Jul 02 20:41:50.367933 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:50.367830 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd8d6075-44ba-40ca-b422-7765c9b8c4c9" path="/var/lib/kubelet/pods/fd8d6075-44ba-40ca-b422-7765c9b8c4c9/volumes" Jul 02 20:41:53.385937 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:53.385903 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-8c9b67766-8q4v6"] Jul 02 20:41:53.386335 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:53.386306 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd8d6075-44ba-40ca-b422-7765c9b8c4c9" containerName="authorino" Jul 02 20:41:53.386387 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:53.386337 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd8d6075-44ba-40ca-b422-7765c9b8c4c9" containerName="authorino" Jul 02 20:41:53.386426 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:53.386392 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd8d6075-44ba-40ca-b422-7765c9b8c4c9" containerName="authorino" Jul 02 20:41:53.402179 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:53.402155 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8c9b67766-8q4v6" Jul 02 20:41:53.403559 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:53.403537 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8c9b67766-8q4v6"] Jul 02 20:41:53.410165 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:53.410142 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fbckt\"" Jul 02 20:41:53.410290 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:53.410261 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 02 20:41:53.410734 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:53.410720 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 02 20:41:53.472625 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:53.472600 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1866e98-af06-4da5-8699-99adc393cadd-webhook-cert\") pod \"maas-controller-8c9b67766-8q4v6\" (UID: \"e1866e98-af06-4da5-8699-99adc393cadd\") " pod="opendatahub/maas-controller-8c9b67766-8q4v6" Jul 02 20:41:53.472728 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:53.472638 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hsl5\" (UniqueName: \"kubernetes.io/projected/e1866e98-af06-4da5-8699-99adc393cadd-kube-api-access-6hsl5\") pod \"maas-controller-8c9b67766-8q4v6\" (UID: \"e1866e98-af06-4da5-8699-99adc393cadd\") " pod="opendatahub/maas-controller-8c9b67766-8q4v6" Jul 02 20:41:53.573632 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:53.573592 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1866e98-af06-4da5-8699-99adc393cadd-webhook-cert\") pod \"maas-controller-8c9b67766-8q4v6\" (UID: \"e1866e98-af06-4da5-8699-99adc393cadd\") " pod="opendatahub/maas-controller-8c9b67766-8q4v6" Jul 02 20:41:53.573632 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:53.573641 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hsl5\" (UniqueName: \"kubernetes.io/projected/e1866e98-af06-4da5-8699-99adc393cadd-kube-api-access-6hsl5\") pod \"maas-controller-8c9b67766-8q4v6\" (UID: \"e1866e98-af06-4da5-8699-99adc393cadd\") " pod="opendatahub/maas-controller-8c9b67766-8q4v6" Jul 02 20:41:53.575936 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:53.575912 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1866e98-af06-4da5-8699-99adc393cadd-webhook-cert\") pod \"maas-controller-8c9b67766-8q4v6\" (UID: \"e1866e98-af06-4da5-8699-99adc393cadd\") " pod="opendatahub/maas-controller-8c9b67766-8q4v6" Jul 02 20:41:53.579355 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:53.579331 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75b95d8b57-mffsw"] Jul 02 20:41:53.583059 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:53.583037 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75b95d8b57-mffsw" Jul 02 20:41:53.584552 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:53.584531 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hsl5\" (UniqueName: \"kubernetes.io/projected/e1866e98-af06-4da5-8699-99adc393cadd-kube-api-access-6hsl5\") pod \"maas-controller-8c9b67766-8q4v6\" (UID: \"e1866e98-af06-4da5-8699-99adc393cadd\") " pod="opendatahub/maas-controller-8c9b67766-8q4v6" Jul 02 20:41:53.590432 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:53.590185 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75b95d8b57-mffsw"] Jul 02 20:41:53.674105 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:53.674043 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txsc7\" (UniqueName: \"kubernetes.io/projected/46b42e27-de01-4686-8acd-26fcd54b8385-kube-api-access-txsc7\") pod \"maas-controller-75b95d8b57-mffsw\" (UID: \"46b42e27-de01-4686-8acd-26fcd54b8385\") " pod="opendatahub/maas-controller-75b95d8b57-mffsw" Jul 02 20:41:53.674105 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:53.674104 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46b42e27-de01-4686-8acd-26fcd54b8385-webhook-cert\") pod \"maas-controller-75b95d8b57-mffsw\" (UID: \"46b42e27-de01-4686-8acd-26fcd54b8385\") " pod="opendatahub/maas-controller-75b95d8b57-mffsw" Jul 02 20:41:53.714474 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:53.714450 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8c9b67766-8q4v6" Jul 02 20:41:53.775010 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:53.774984 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46b42e27-de01-4686-8acd-26fcd54b8385-webhook-cert\") pod \"maas-controller-75b95d8b57-mffsw\" (UID: \"46b42e27-de01-4686-8acd-26fcd54b8385\") " pod="opendatahub/maas-controller-75b95d8b57-mffsw" Jul 02 20:41:53.775135 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:53.775076 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txsc7\" (UniqueName: \"kubernetes.io/projected/46b42e27-de01-4686-8acd-26fcd54b8385-kube-api-access-txsc7\") pod \"maas-controller-75b95d8b57-mffsw\" (UID: \"46b42e27-de01-4686-8acd-26fcd54b8385\") " pod="opendatahub/maas-controller-75b95d8b57-mffsw" Jul 02 20:41:53.778190 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:53.778165 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46b42e27-de01-4686-8acd-26fcd54b8385-webhook-cert\") pod \"maas-controller-75b95d8b57-mffsw\" (UID: \"46b42e27-de01-4686-8acd-26fcd54b8385\") " pod="opendatahub/maas-controller-75b95d8b57-mffsw" Jul 02 20:41:53.783391 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:53.783369 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-txsc7\" (UniqueName: \"kubernetes.io/projected/46b42e27-de01-4686-8acd-26fcd54b8385-kube-api-access-txsc7\") pod \"maas-controller-75b95d8b57-mffsw\" (UID: \"46b42e27-de01-4686-8acd-26fcd54b8385\") " pod="opendatahub/maas-controller-75b95d8b57-mffsw" Jul 02 20:41:53.846883 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:53.846839 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-8c9b67766-8q4v6"] Jul 02 20:41:53.848491 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:41:53.848467 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1866e98_af06_4da5_8699_99adc393cadd.slice/crio-75600a8cae158d8ed458ebb06ecb12f410218fe36b5860be57b58eaf685071fc WatchSource:0}: Error finding container 75600a8cae158d8ed458ebb06ecb12f410218fe36b5860be57b58eaf685071fc: Status 404 returned error can't find the container with id 75600a8cae158d8ed458ebb06ecb12f410218fe36b5860be57b58eaf685071fc Jul 02 20:41:53.904916 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:53.904899 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75b95d8b57-mffsw" Jul 02 20:41:54.030086 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:54.030055 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8c9b67766-8q4v6" event={"ID":"e1866e98-af06-4da5-8699-99adc393cadd","Type":"ContainerStarted","Data":"75600a8cae158d8ed458ebb06ecb12f410218fe36b5860be57b58eaf685071fc"} Jul 02 20:41:54.036054 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:54.036027 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75b95d8b57-mffsw"] Jul 02 20:41:54.039405 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:41:54.039380 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46b42e27_de01_4686_8acd_26fcd54b8385.slice/crio-d0203f950e9605c8d4e9c855dbc5f62975e6be0ab9577254f7fa10060085da3e WatchSource:0}: Error finding container d0203f950e9605c8d4e9c855dbc5f62975e6be0ab9577254f7fa10060085da3e: Status 404 returned error can't find the container with id d0203f950e9605c8d4e9c855dbc5f62975e6be0ab9577254f7fa10060085da3e Jul 02 20:41:55.041308 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:55.041078 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75b95d8b57-mffsw" event={"ID":"46b42e27-de01-4686-8acd-26fcd54b8385","Type":"ContainerStarted","Data":"d0203f950e9605c8d4e9c855dbc5f62975e6be0ab9577254f7fa10060085da3e"} Jul 02 20:41:57.054097 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:57.054059 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8c9b67766-8q4v6" event={"ID":"e1866e98-af06-4da5-8699-99adc393cadd","Type":"ContainerStarted","Data":"1200766d3d6091a3369768a8036552c3518b6fa0b2c663f3836c13691b70111c"} Jul 02 20:41:57.054546 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:57.054151 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-8c9b67766-8q4v6" Jul 02 20:41:57.055722 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:57.055692 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75b95d8b57-mffsw" event={"ID":"46b42e27-de01-4686-8acd-26fcd54b8385","Type":"ContainerStarted","Data":"a250f128fe15f17edf4811fb8906838d6b118b26d891cc34fd0658e7ae253f40"} Jul 02 20:41:57.055841 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:57.055761 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75b95d8b57-mffsw" Jul 02 20:41:57.092617 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:57.092572 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-8c9b67766-8q4v6" podStartSLOduration=1.432798362 podStartE2EDuration="4.092557837s" totalImagesPullingTime="2.659759475s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:41:57.075143907 +0000 UTC m=+555.528065008" watchObservedRunningTime="2026-07-02 20:41:57.092557837 +0000 UTC m=+555.545478935" Jul 02 20:41:57.093474 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:41:57.093438 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75b95d8b57-mffsw" podStartSLOduration=1.613864347 podStartE2EDuration="4.093427729s" totalImagesPullingTime="2.479563382s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:41:57.091442581 +0000 UTC m=+555.544363682" watchObservedRunningTime="2026-07-02 20:41:57.093427729 +0000 UTC m=+555.546348826" Jul 02 20:42:08.067178 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:08.067148 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75b95d8b57-mffsw" Jul 02 20:42:08.067617 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:08.067216 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-8c9b67766-8q4v6" Jul 02 20:42:08.134791 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:08.134755 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8c9b67766-8q4v6"] Jul 02 20:42:08.135101 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:08.135072 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-8c9b67766-8q4v6" podUID="e1866e98-af06-4da5-8699-99adc393cadd" containerName="manager" containerID="cri-o://1200766d3d6091a3369768a8036552c3518b6fa0b2c663f3836c13691b70111c" gracePeriod=30 Jul 02 20:42:08.387589 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:08.387559 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8c9b67766-8q4v6" Jul 02 20:42:08.507352 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:08.507314 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hsl5\" (UniqueName: \"kubernetes.io/projected/e1866e98-af06-4da5-8699-99adc393cadd-kube-api-access-6hsl5\") pod \"e1866e98-af06-4da5-8699-99adc393cadd\" (UID: \"e1866e98-af06-4da5-8699-99adc393cadd\") " Jul 02 20:42:08.507522 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:08.507459 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1866e98-af06-4da5-8699-99adc393cadd-webhook-cert\") pod \"e1866e98-af06-4da5-8699-99adc393cadd\" (UID: \"e1866e98-af06-4da5-8699-99adc393cadd\") " Jul 02 20:42:08.509507 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:08.509480 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1866e98-af06-4da5-8699-99adc393cadd-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "e1866e98-af06-4da5-8699-99adc393cadd" (UID: "e1866e98-af06-4da5-8699-99adc393cadd"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 20:42:08.509507 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:08.509492 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1866e98-af06-4da5-8699-99adc393cadd-kube-api-access-6hsl5" (OuterVolumeSpecName: "kube-api-access-6hsl5") pod "e1866e98-af06-4da5-8699-99adc393cadd" (UID: "e1866e98-af06-4da5-8699-99adc393cadd"). InnerVolumeSpecName "kube-api-access-6hsl5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:42:08.608934 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:08.608897 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hsl5\" (UniqueName: \"kubernetes.io/projected/e1866e98-af06-4da5-8699-99adc393cadd-kube-api-access-6hsl5\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:42:08.608934 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:08.608929 2568 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/e1866e98-af06-4da5-8699-99adc393cadd-webhook-cert\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:42:09.127251 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:09.127221 2568 generic.go:356] "Generic (PLEG): container finished" podID="e1866e98-af06-4da5-8699-99adc393cadd" containerID="1200766d3d6091a3369768a8036552c3518b6fa0b2c663f3836c13691b70111c" exitCode=0 Jul 02 20:42:09.127658 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:09.127255 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8c9b67766-8q4v6" event={"ID":"e1866e98-af06-4da5-8699-99adc393cadd","Type":"ContainerDied","Data":"1200766d3d6091a3369768a8036552c3518b6fa0b2c663f3836c13691b70111c"} Jul 02 20:42:09.127658 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:09.127303 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-8c9b67766-8q4v6" event={"ID":"e1866e98-af06-4da5-8699-99adc393cadd","Type":"ContainerDied","Data":"75600a8cae158d8ed458ebb06ecb12f410218fe36b5860be57b58eaf685071fc"} Jul 02 20:42:09.127658 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:09.127324 2568 scope.go:117] "RemoveContainer" containerID="1200766d3d6091a3369768a8036552c3518b6fa0b2c663f3836c13691b70111c" Jul 02 20:42:09.127658 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:09.127265 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-8c9b67766-8q4v6" Jul 02 20:42:09.139243 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:09.139033 2568 scope.go:117] "RemoveContainer" containerID="1200766d3d6091a3369768a8036552c3518b6fa0b2c663f3836c13691b70111c" Jul 02 20:42:09.139519 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:42:09.139495 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1200766d3d6091a3369768a8036552c3518b6fa0b2c663f3836c13691b70111c\": container with ID starting with 1200766d3d6091a3369768a8036552c3518b6fa0b2c663f3836c13691b70111c not found: ID does not exist" containerID="1200766d3d6091a3369768a8036552c3518b6fa0b2c663f3836c13691b70111c" Jul 02 20:42:09.139578 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:09.139529 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1200766d3d6091a3369768a8036552c3518b6fa0b2c663f3836c13691b70111c"} err="failed to get container status \"1200766d3d6091a3369768a8036552c3518b6fa0b2c663f3836c13691b70111c\": rpc error: code = NotFound desc = could not find container \"1200766d3d6091a3369768a8036552c3518b6fa0b2c663f3836c13691b70111c\": container with ID starting with 1200766d3d6091a3369768a8036552c3518b6fa0b2c663f3836c13691b70111c not found: ID does not exist" Jul 02 20:42:09.149704 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:09.149672 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-8c9b67766-8q4v6"] Jul 02 20:42:09.152616 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:09.152595 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-8c9b67766-8q4v6"] Jul 02 20:42:10.363592 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:10.363566 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1866e98-af06-4da5-8699-99adc393cadd" path="/var/lib/kubelet/pods/e1866e98-af06-4da5-8699-99adc393cadd/volumes" Jul 02 20:42:28.673501 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:28.673467 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-67c4fd747d-m8m58"] Jul 02 20:42:28.673998 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:28.673890 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1866e98-af06-4da5-8699-99adc393cadd" containerName="manager" Jul 02 20:42:28.673998 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:28.673903 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1866e98-af06-4da5-8699-99adc393cadd" containerName="manager" Jul 02 20:42:28.673998 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:28.673961 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1866e98-af06-4da5-8699-99adc393cadd" containerName="manager" Jul 02 20:42:28.679597 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:28.679577 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-67c4fd747d-m8m58" Jul 02 20:42:28.682082 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:28.682057 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-k4crx\"" Jul 02 20:42:28.682189 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:28.682096 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jul 02 20:42:28.686792 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:28.686758 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-67c4fd747d-m8m58"] Jul 02 20:42:28.783782 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:28.783753 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plfq4\" (UniqueName: \"kubernetes.io/projected/1934c3ed-11e9-4155-aee8-3332b580a8a6-kube-api-access-plfq4\") pod \"maas-api-67c4fd747d-m8m58\" (UID: \"1934c3ed-11e9-4155-aee8-3332b580a8a6\") " pod="opendatahub/maas-api-67c4fd747d-m8m58" Jul 02 20:42:28.783947 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:28.783796 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1934c3ed-11e9-4155-aee8-3332b580a8a6-openshift-service-ca\") pod \"maas-api-67c4fd747d-m8m58\" (UID: \"1934c3ed-11e9-4155-aee8-3332b580a8a6\") " pod="opendatahub/maas-api-67c4fd747d-m8m58" Jul 02 20:42:28.783947 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:28.783830 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1934c3ed-11e9-4155-aee8-3332b580a8a6-maas-api-tls\") pod \"maas-api-67c4fd747d-m8m58\" (UID: \"1934c3ed-11e9-4155-aee8-3332b580a8a6\") " pod="opendatahub/maas-api-67c4fd747d-m8m58" Jul 02 20:42:28.885135 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:28.885102 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plfq4\" (UniqueName: \"kubernetes.io/projected/1934c3ed-11e9-4155-aee8-3332b580a8a6-kube-api-access-plfq4\") pod \"maas-api-67c4fd747d-m8m58\" (UID: \"1934c3ed-11e9-4155-aee8-3332b580a8a6\") " pod="opendatahub/maas-api-67c4fd747d-m8m58" Jul 02 20:42:28.885135 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:28.885141 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1934c3ed-11e9-4155-aee8-3332b580a8a6-openshift-service-ca\") pod \"maas-api-67c4fd747d-m8m58\" (UID: \"1934c3ed-11e9-4155-aee8-3332b580a8a6\") " pod="opendatahub/maas-api-67c4fd747d-m8m58" Jul 02 20:42:28.885321 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:28.885168 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1934c3ed-11e9-4155-aee8-3332b580a8a6-maas-api-tls\") pod \"maas-api-67c4fd747d-m8m58\" (UID: \"1934c3ed-11e9-4155-aee8-3332b580a8a6\") " pod="opendatahub/maas-api-67c4fd747d-m8m58" Jul 02 20:42:28.885793 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:28.885765 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/1934c3ed-11e9-4155-aee8-3332b580a8a6-openshift-service-ca\") pod \"maas-api-67c4fd747d-m8m58\" (UID: \"1934c3ed-11e9-4155-aee8-3332b580a8a6\") " pod="opendatahub/maas-api-67c4fd747d-m8m58" Jul 02 20:42:28.887609 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:28.887590 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/1934c3ed-11e9-4155-aee8-3332b580a8a6-maas-api-tls\") pod \"maas-api-67c4fd747d-m8m58\" (UID: \"1934c3ed-11e9-4155-aee8-3332b580a8a6\") " pod="opendatahub/maas-api-67c4fd747d-m8m58" Jul 02 20:42:28.895302 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:28.895284 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plfq4\" (UniqueName: \"kubernetes.io/projected/1934c3ed-11e9-4155-aee8-3332b580a8a6-kube-api-access-plfq4\") pod \"maas-api-67c4fd747d-m8m58\" (UID: \"1934c3ed-11e9-4155-aee8-3332b580a8a6\") " pod="opendatahub/maas-api-67c4fd747d-m8m58" Jul 02 20:42:28.991782 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:28.991723 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-67c4fd747d-m8m58" Jul 02 20:42:29.141697 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:29.141668 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-67c4fd747d-m8m58"] Jul 02 20:42:29.143021 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:42:29.142994 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1934c3ed_11e9_4155_aee8_3332b580a8a6.slice/crio-5bbdd599ba925cee8c79ddfe4623d7561bf1c0bcb397adf1c9b27be52ba2af8f WatchSource:0}: Error finding container 5bbdd599ba925cee8c79ddfe4623d7561bf1c0bcb397adf1c9b27be52ba2af8f: Status 404 returned error can't find the container with id 5bbdd599ba925cee8c79ddfe4623d7561bf1c0bcb397adf1c9b27be52ba2af8f Jul 02 20:42:29.227145 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:29.227115 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-67c4fd747d-m8m58" event={"ID":"1934c3ed-11e9-4155-aee8-3332b580a8a6","Type":"ContainerStarted","Data":"5bbdd599ba925cee8c79ddfe4623d7561bf1c0bcb397adf1c9b27be52ba2af8f"} Jul 02 20:42:29.234542 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:29.234521 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-lhqtj"] Jul 02 20:42:29.238750 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:29.238734 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-lhqtj" Jul 02 20:42:29.241356 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:29.241340 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-zfrgn\"" Jul 02 20:42:29.241534 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:29.241518 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 02 20:42:29.248129 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:29.248109 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-lhqtj"] Jul 02 20:42:29.281611 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:29.281579 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-9jwzw"] Jul 02 20:42:29.284748 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:29.284728 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-9jwzw" Jul 02 20:42:29.288197 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:29.288176 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72121762-0f5d-46d9-b80d-be803711aa92-plugins-config-volume\") pod \"payload-processing-58f86c7798-lhqtj\" (UID: \"72121762-0f5d-46d9-b80d-be803711aa92\") " pod="openshift-ingress/payload-processing-58f86c7798-lhqtj" Jul 02 20:42:29.288278 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:29.288228 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9q6hl\" (UniqueName: \"kubernetes.io/projected/72121762-0f5d-46d9-b80d-be803711aa92-kube-api-access-9q6hl\") pod \"payload-processing-58f86c7798-lhqtj\" (UID: \"72121762-0f5d-46d9-b80d-be803711aa92\") " pod="openshift-ingress/payload-processing-58f86c7798-lhqtj" Jul 02 20:42:29.295598 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:29.295580 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-9jwzw"] Jul 02 20:42:29.389533 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:29.389503 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28d96b3e-c62f-492e-adb5-9a82ca2fbd84-plugins-config-volume\") pod \"payload-pre-processing-7964457696-9jwzw\" (UID: \"28d96b3e-c62f-492e-adb5-9a82ca2fbd84\") " pod="openshift-ingress/payload-pre-processing-7964457696-9jwzw" Jul 02 20:42:29.389978 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:29.389794 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9q6hl\" (UniqueName: \"kubernetes.io/projected/72121762-0f5d-46d9-b80d-be803711aa92-kube-api-access-9q6hl\") pod \"payload-processing-58f86c7798-lhqtj\" (UID: \"72121762-0f5d-46d9-b80d-be803711aa92\") " pod="openshift-ingress/payload-processing-58f86c7798-lhqtj" Jul 02 20:42:29.390689 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:29.390197 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zr5ct\" (UniqueName: \"kubernetes.io/projected/28d96b3e-c62f-492e-adb5-9a82ca2fbd84-kube-api-access-zr5ct\") pod \"payload-pre-processing-7964457696-9jwzw\" (UID: \"28d96b3e-c62f-492e-adb5-9a82ca2fbd84\") " pod="openshift-ingress/payload-pre-processing-7964457696-9jwzw" Jul 02 20:42:29.390689 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:29.390345 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72121762-0f5d-46d9-b80d-be803711aa92-plugins-config-volume\") pod \"payload-processing-58f86c7798-lhqtj\" (UID: \"72121762-0f5d-46d9-b80d-be803711aa92\") " pod="openshift-ingress/payload-processing-58f86c7798-lhqtj" Jul 02 20:42:29.391233 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:29.391209 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/72121762-0f5d-46d9-b80d-be803711aa92-plugins-config-volume\") pod \"payload-processing-58f86c7798-lhqtj\" (UID: \"72121762-0f5d-46d9-b80d-be803711aa92\") " pod="openshift-ingress/payload-processing-58f86c7798-lhqtj" Jul 02 20:42:29.398122 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:29.398097 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9q6hl\" (UniqueName: \"kubernetes.io/projected/72121762-0f5d-46d9-b80d-be803711aa92-kube-api-access-9q6hl\") pod \"payload-processing-58f86c7798-lhqtj\" (UID: \"72121762-0f5d-46d9-b80d-be803711aa92\") " pod="openshift-ingress/payload-processing-58f86c7798-lhqtj" Jul 02 20:42:29.491841 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:29.491813 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28d96b3e-c62f-492e-adb5-9a82ca2fbd84-plugins-config-volume\") pod \"payload-pre-processing-7964457696-9jwzw\" (UID: \"28d96b3e-c62f-492e-adb5-9a82ca2fbd84\") " pod="openshift-ingress/payload-pre-processing-7964457696-9jwzw" Jul 02 20:42:29.491979 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:29.491917 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zr5ct\" (UniqueName: \"kubernetes.io/projected/28d96b3e-c62f-492e-adb5-9a82ca2fbd84-kube-api-access-zr5ct\") pod \"payload-pre-processing-7964457696-9jwzw\" (UID: \"28d96b3e-c62f-492e-adb5-9a82ca2fbd84\") " pod="openshift-ingress/payload-pre-processing-7964457696-9jwzw" Jul 02 20:42:29.492456 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:29.492436 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/28d96b3e-c62f-492e-adb5-9a82ca2fbd84-plugins-config-volume\") pod \"payload-pre-processing-7964457696-9jwzw\" (UID: \"28d96b3e-c62f-492e-adb5-9a82ca2fbd84\") " pod="openshift-ingress/payload-pre-processing-7964457696-9jwzw" Jul 02 20:42:29.499373 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:29.499319 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zr5ct\" (UniqueName: \"kubernetes.io/projected/28d96b3e-c62f-492e-adb5-9a82ca2fbd84-kube-api-access-zr5ct\") pod \"payload-pre-processing-7964457696-9jwzw\" (UID: \"28d96b3e-c62f-492e-adb5-9a82ca2fbd84\") " pod="openshift-ingress/payload-pre-processing-7964457696-9jwzw" Jul 02 20:42:29.549692 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:29.549670 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-lhqtj" Jul 02 20:42:29.594341 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:29.594310 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-9jwzw" Jul 02 20:42:29.691259 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:29.691226 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-lhqtj"] Jul 02 20:42:29.693074 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:42:29.693044 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72121762_0f5d_46d9_b80d_be803711aa92.slice/crio-ede4370610139e2f91a44b6e24a2081f1f5024ce2d9cdc5b218ae387572ae7af WatchSource:0}: Error finding container ede4370610139e2f91a44b6e24a2081f1f5024ce2d9cdc5b218ae387572ae7af: Status 404 returned error can't find the container with id ede4370610139e2f91a44b6e24a2081f1f5024ce2d9cdc5b218ae387572ae7af Jul 02 20:42:29.752022 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:29.751926 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-9jwzw"] Jul 02 20:42:29.760133 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:42:29.760094 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28d96b3e_c62f_492e_adb5_9a82ca2fbd84.slice/crio-ebfedf4625ae11e584b0b4bb288212091ef97983ca6450ff67ba52fdf89d783d WatchSource:0}: Error finding container ebfedf4625ae11e584b0b4bb288212091ef97983ca6450ff67ba52fdf89d783d: Status 404 returned error can't find the container with id ebfedf4625ae11e584b0b4bb288212091ef97983ca6450ff67ba52fdf89d783d Jul 02 20:42:30.257892 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:30.257743 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-lhqtj" event={"ID":"72121762-0f5d-46d9-b80d-be803711aa92","Type":"ContainerStarted","Data":"ede4370610139e2f91a44b6e24a2081f1f5024ce2d9cdc5b218ae387572ae7af"} Jul 02 20:42:30.259615 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:30.259581 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-9jwzw" event={"ID":"28d96b3e-c62f-492e-adb5-9a82ca2fbd84","Type":"ContainerStarted","Data":"ebfedf4625ae11e584b0b4bb288212091ef97983ca6450ff67ba52fdf89d783d"} Jul 02 20:42:32.274007 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:32.273969 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-lhqtj" event={"ID":"72121762-0f5d-46d9-b80d-be803711aa92","Type":"ContainerStarted","Data":"80320b64c2bd96152e176680e79e6d7b75c27cd2a5c2fe1bdb4680be19a201dc"} Jul 02 20:42:32.274455 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:32.274038 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-lhqtj" Jul 02 20:42:32.275555 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:32.275527 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-9jwzw" event={"ID":"28d96b3e-c62f-492e-adb5-9a82ca2fbd84","Type":"ContainerStarted","Data":"445bb4144348e95b79cb0ef5a7aad6b62605afc92efad2cef617bd07a39dc8ac"} Jul 02 20:42:32.275722 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:32.275582 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-9jwzw" Jul 02 20:42:32.277028 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:32.277002 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-67c4fd747d-m8m58" event={"ID":"1934c3ed-11e9-4155-aee8-3332b580a8a6","Type":"ContainerStarted","Data":"aa0bee297991ff15d1b8e5075ad02b31c7d0be6244ad2e53645ea672a5a48c9e"} Jul 02 20:42:32.277165 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:32.277143 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-67c4fd747d-m8m58" Jul 02 20:42:32.290965 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:32.290927 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-lhqtj" podStartSLOduration=1.305482476 podStartE2EDuration="3.290914447s" totalImagesPullingTime="1.985431971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:42:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:42:32.289539412 +0000 UTC m=+590.742460510" watchObservedRunningTime="2026-07-02 20:42:32.290914447 +0000 UTC m=+590.743835545" Jul 02 20:42:32.305283 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:32.305223 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-67c4fd747d-m8m58" podStartSLOduration=1.767923315 podStartE2EDuration="4.30521132s" totalImagesPullingTime="2.537288005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:42:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:42:32.304811099 +0000 UTC m=+590.757732198" watchObservedRunningTime="2026-07-02 20:42:32.30521132 +0000 UTC m=+590.758132418" Jul 02 20:42:32.322018 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:32.321974 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-9jwzw" podStartSLOduration=1.412217746 podStartE2EDuration="3.321958134s" totalImagesPullingTime="1.909740388s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:42:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:42:32.31958847 +0000 UTC m=+590.772509591" watchObservedRunningTime="2026-07-02 20:42:32.321958134 +0000 UTC m=+590.774879232" Jul 02 20:42:37.305003 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:37.304969 2568 generic.go:356] "Generic (PLEG): container finished" podID="81c70b4a-1052-4408-b325-39b47def09bb" containerID="b8216e4a163a01ae46facd4fe2d96c4429254781c0c487d4837dc1c2ba352b8f" exitCode=0 Jul 02 20:42:37.305409 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:37.305040 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" event={"ID":"81c70b4a-1052-4408-b325-39b47def09bb","Type":"ContainerDied","Data":"b8216e4a163a01ae46facd4fe2d96c4429254781c0c487d4837dc1c2ba352b8f"} Jul 02 20:42:37.305409 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:37.305379 2568 scope.go:117] "RemoveContainer" containerID="b8216e4a163a01ae46facd4fe2d96c4429254781c0c487d4837dc1c2ba352b8f" Jul 02 20:42:37.306340 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:37.306315 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:42:37.306392 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:37.306380 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:42:37.306433 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:37.306411 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:42:38.288691 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:38.288658 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-67c4fd747d-m8m58" Jul 02 20:42:38.313121 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:38.313084 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" event={"ID":"81c70b4a-1052-4408-b325-39b47def09bb","Type":"ContainerStarted","Data":"25574065e2c58901d0a37b048c264d7b166836a16d4ee8d406872c948154927d"} Jul 02 20:42:38.396896 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:38.396862 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" Jul 02 20:42:38.397116 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:38.397096 2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-phcmp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Jul 02 20:42:38.397164 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:38.397142 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" podUID="81c70b4a-1052-4408-b325-39b47def09bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Jul 02 20:42:39.396888 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:39.396838 2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-phcmp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Jul 02 20:42:39.397321 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:39.396906 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" podUID="81c70b4a-1052-4408-b325-39b47def09bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Jul 02 20:42:40.396622 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:40.396589 2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-phcmp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Jul 02 20:42:40.396803 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:40.396640 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" podUID="81c70b4a-1052-4408-b325-39b47def09bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Jul 02 20:42:41.397359 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:41.397319 2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-phcmp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" start-of-body= Jul 02 20:42:41.397742 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:41.397389 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" podUID="81c70b4a-1052-4408-b325-39b47def09bb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.38:15021/healthz/ready\": dial tcp 10.133.0.38:15021: connect: connection refused" Jul 02 20:42:42.433695 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:42.433663 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" Jul 02 20:42:42.434154 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:42.434085 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" Jul 02 20:42:42.434920 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:42.434896 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-phcmp" Jul 02 20:42:43.284820 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:43.284786 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-9jwzw" Jul 02 20:42:43.285001 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:43.284894 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-lhqtj" Jul 02 20:42:51.598513 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:51.598483 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx"] Jul 02 20:42:51.603433 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:51.603411 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx" Jul 02 20:42:51.605917 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:51.605894 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 02 20:42:51.606051 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:51.605894 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-gtvps\"" Jul 02 20:42:51.606615 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:51.606594 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 02 20:42:51.606615 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:51.606596 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 02 20:42:51.618215 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:51.616269 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx"] Jul 02 20:42:51.704526 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:51.704496 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3e94b87-2236-4e6e-b5f3-6aa033d2e3f4-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx\" (UID: \"d3e94b87-2236-4e6e-b5f3-6aa033d2e3f4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx" Jul 02 20:42:51.704663 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:51.704540 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3e94b87-2236-4e6e-b5f3-6aa033d2e3f4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx\" (UID: \"d3e94b87-2236-4e6e-b5f3-6aa033d2e3f4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx" Jul 02 20:42:51.704663 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:51.704583 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3e94b87-2236-4e6e-b5f3-6aa033d2e3f4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx\" (UID: \"d3e94b87-2236-4e6e-b5f3-6aa033d2e3f4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx" Jul 02 20:42:51.704663 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:51.704611 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3e94b87-2236-4e6e-b5f3-6aa033d2e3f4-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx\" (UID: \"d3e94b87-2236-4e6e-b5f3-6aa033d2e3f4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx" Jul 02 20:42:51.704663 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:51.704634 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3e94b87-2236-4e6e-b5f3-6aa033d2e3f4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx\" (UID: \"d3e94b87-2236-4e6e-b5f3-6aa033d2e3f4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx" Jul 02 20:42:51.704795 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:51.704701 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vf99\" (UniqueName: \"kubernetes.io/projected/d3e94b87-2236-4e6e-b5f3-6aa033d2e3f4-kube-api-access-2vf99\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx\" (UID: \"d3e94b87-2236-4e6e-b5f3-6aa033d2e3f4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx" Jul 02 20:42:51.806001 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:51.805968 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vf99\" (UniqueName: \"kubernetes.io/projected/d3e94b87-2236-4e6e-b5f3-6aa033d2e3f4-kube-api-access-2vf99\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx\" (UID: \"d3e94b87-2236-4e6e-b5f3-6aa033d2e3f4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx" Jul 02 20:42:51.806161 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:51.806024 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3e94b87-2236-4e6e-b5f3-6aa033d2e3f4-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx\" (UID: \"d3e94b87-2236-4e6e-b5f3-6aa033d2e3f4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx" Jul 02 20:42:51.806161 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:51.806075 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3e94b87-2236-4e6e-b5f3-6aa033d2e3f4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx\" (UID: \"d3e94b87-2236-4e6e-b5f3-6aa033d2e3f4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx" Jul 02 20:42:51.806161 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:51.806113 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3e94b87-2236-4e6e-b5f3-6aa033d2e3f4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx\" (UID: \"d3e94b87-2236-4e6e-b5f3-6aa033d2e3f4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx" Jul 02 20:42:51.806161 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:51.806147 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3e94b87-2236-4e6e-b5f3-6aa033d2e3f4-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx\" (UID: \"d3e94b87-2236-4e6e-b5f3-6aa033d2e3f4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx" Jul 02 20:42:51.806391 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:51.806185 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3e94b87-2236-4e6e-b5f3-6aa033d2e3f4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx\" (UID: \"d3e94b87-2236-4e6e-b5f3-6aa033d2e3f4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx" Jul 02 20:42:51.806550 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:51.806529 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d3e94b87-2236-4e6e-b5f3-6aa033d2e3f4-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx\" (UID: \"d3e94b87-2236-4e6e-b5f3-6aa033d2e3f4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx" Jul 02 20:42:51.806622 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:51.806587 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d3e94b87-2236-4e6e-b5f3-6aa033d2e3f4-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx\" (UID: \"d3e94b87-2236-4e6e-b5f3-6aa033d2e3f4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx" Jul 02 20:42:51.806698 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:51.806678 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d3e94b87-2236-4e6e-b5f3-6aa033d2e3f4-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx\" (UID: \"d3e94b87-2236-4e6e-b5f3-6aa033d2e3f4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx" Jul 02 20:42:51.808389 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:51.808372 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d3e94b87-2236-4e6e-b5f3-6aa033d2e3f4-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx\" (UID: \"d3e94b87-2236-4e6e-b5f3-6aa033d2e3f4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx" Jul 02 20:42:51.808639 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:51.808621 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d3e94b87-2236-4e6e-b5f3-6aa033d2e3f4-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx\" (UID: \"d3e94b87-2236-4e6e-b5f3-6aa033d2e3f4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx" Jul 02 20:42:51.813380 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:51.813360 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vf99\" (UniqueName: \"kubernetes.io/projected/d3e94b87-2236-4e6e-b5f3-6aa033d2e3f4-kube-api-access-2vf99\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx\" (UID: \"d3e94b87-2236-4e6e-b5f3-6aa033d2e3f4\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx" Jul 02 20:42:51.917702 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:51.917673 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx" Jul 02 20:42:52.059550 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:52.059519 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx"] Jul 02 20:42:52.060622 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:42:52.060593 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3e94b87_2236_4e6e_b5f3_6aa033d2e3f4.slice/crio-df869de493676b5243d6bd3d806869acbe446d9edb262b75a2803a6bc208f6a8 WatchSource:0}: Error finding container df869de493676b5243d6bd3d806869acbe446d9edb262b75a2803a6bc208f6a8: Status 404 returned error can't find the container with id df869de493676b5243d6bd3d806869acbe446d9edb262b75a2803a6bc208f6a8 Jul 02 20:42:52.393278 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:52.393236 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx" event={"ID":"d3e94b87-2236-4e6e-b5f3-6aa033d2e3f4","Type":"ContainerStarted","Data":"df869de493676b5243d6bd3d806869acbe446d9edb262b75a2803a6bc208f6a8"} Jul 02 20:42:53.399807 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:53.399775 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx" event={"ID":"d3e94b87-2236-4e6e-b5f3-6aa033d2e3f4","Type":"ContainerStarted","Data":"7cdbbb81983885fc4829aa6bbd8655359909d96beabca3bcb48415ecd3ca9554"} Jul 02 20:42:53.417550 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:42:53.417505 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx" podStartSLOduration=1.358149125 podStartE2EDuration="2.417489681s" totalImagesPullingTime="1.059340556s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:42:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:42:53.415278879 +0000 UTC m=+611.868199980" watchObservedRunningTime="2026-07-02 20:42:53.417489681 +0000 UTC m=+611.870410779" Jul 02 20:43:01.918580 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:43:01.918537 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx" Jul 02 20:43:01.918580 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:43:01.918594 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx" Jul 02 20:43:01.930819 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:43:01.930801 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx" Jul 02 20:43:02.459170 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:43:02.459140 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx" Jul 02 20:44:57.366523 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:44:57.366488 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-744b689b78-6k66x"] Jul 02 20:44:57.370215 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:44:57.370191 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-744b689b78-6k66x" Jul 02 20:44:57.378621 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:44:57.378597 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-744b689b78-6k66x"] Jul 02 20:44:57.541418 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:44:57.541387 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6fwp\" (UniqueName: \"kubernetes.io/projected/94018d83-1ac0-4aef-9dce-0de84d774942-kube-api-access-t6fwp\") pod \"authorino-744b689b78-6k66x\" (UID: \"94018d83-1ac0-4aef-9dce-0de84d774942\") " pod="kuadrant-system/authorino-744b689b78-6k66x" Jul 02 20:44:57.541618 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:44:57.541542 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/94018d83-1ac0-4aef-9dce-0de84d774942-tls-cert\") pod \"authorino-744b689b78-6k66x\" (UID: \"94018d83-1ac0-4aef-9dce-0de84d774942\") " pod="kuadrant-system/authorino-744b689b78-6k66x" Jul 02 20:44:57.642656 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:44:57.642624 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/94018d83-1ac0-4aef-9dce-0de84d774942-tls-cert\") pod \"authorino-744b689b78-6k66x\" (UID: \"94018d83-1ac0-4aef-9dce-0de84d774942\") " pod="kuadrant-system/authorino-744b689b78-6k66x" Jul 02 20:44:57.642877 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:44:57.642671 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6fwp\" (UniqueName: \"kubernetes.io/projected/94018d83-1ac0-4aef-9dce-0de84d774942-kube-api-access-t6fwp\") pod \"authorino-744b689b78-6k66x\" (UID: \"94018d83-1ac0-4aef-9dce-0de84d774942\") " pod="kuadrant-system/authorino-744b689b78-6k66x" Jul 02 20:44:57.645194 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:44:57.645169 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/94018d83-1ac0-4aef-9dce-0de84d774942-tls-cert\") pod \"authorino-744b689b78-6k66x\" (UID: \"94018d83-1ac0-4aef-9dce-0de84d774942\") " pod="kuadrant-system/authorino-744b689b78-6k66x" Jul 02 20:44:57.650234 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:44:57.650211 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6fwp\" (UniqueName: \"kubernetes.io/projected/94018d83-1ac0-4aef-9dce-0de84d774942-kube-api-access-t6fwp\") pod \"authorino-744b689b78-6k66x\" (UID: \"94018d83-1ac0-4aef-9dce-0de84d774942\") " pod="kuadrant-system/authorino-744b689b78-6k66x" Jul 02 20:44:57.680835 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:44:57.680810 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-744b689b78-6k66x" Jul 02 20:44:57.815269 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:44:57.815235 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-744b689b78-6k66x"] Jul 02 20:44:57.817642 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:44:57.817615 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94018d83_1ac0_4aef_9dce_0de84d774942.slice/crio-d9e9f5ed317b500874f134f08fbdee22b85ec3bd72360fdddf18646f1b0e8ecd WatchSource:0}: Error finding container d9e9f5ed317b500874f134f08fbdee22b85ec3bd72360fdddf18646f1b0e8ecd: Status 404 returned error can't find the container with id d9e9f5ed317b500874f134f08fbdee22b85ec3bd72360fdddf18646f1b0e8ecd Jul 02 20:44:57.819094 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:44:57.819077 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 20:44:58.044999 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:44:58.044914 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-744b689b78-6k66x" event={"ID":"94018d83-1ac0-4aef-9dce-0de84d774942","Type":"ContainerStarted","Data":"d9e9f5ed317b500874f134f08fbdee22b85ec3bd72360fdddf18646f1b0e8ecd"} Jul 02 20:44:59.059151 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:44:59.059113 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-744b689b78-6k66x" event={"ID":"94018d83-1ac0-4aef-9dce-0de84d774942","Type":"ContainerStarted","Data":"205b1606133428a355177cab9f42744e8fe3232fe6c5cb4c675769ead348f3a4"} Jul 02 20:44:59.077691 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:44:59.077629 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-744b689b78-6k66x" podStartSLOduration=1.6171156610000001 podStartE2EDuration="2.077610215s" totalImagesPullingTime="460.494554ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:44:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:44:59.075386359 +0000 UTC m=+737.528307528" watchObservedRunningTime="2026-07-02 20:44:59.077610215 +0000 UTC m=+737.530531313" Jul 02 20:44:59.106064 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:44:59.106028 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d4564bb7f-rz28n"] Jul 02 20:44:59.106289 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:44:59.106259 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-7d4564bb7f-rz28n" podUID="618311de-9be2-493a-8115-f2cef2be60e2" containerName="authorino" containerID="cri-o://3eca29f125e74232eb45094d048f178be4ad6401e7cedeff34403608883d711e" gracePeriod=30 Jul 02 20:44:59.386674 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:44:59.386644 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d4564bb7f-rz28n" Jul 02 20:44:59.564957 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:44:59.564925 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/618311de-9be2-493a-8115-f2cef2be60e2-tls-cert\") pod \"618311de-9be2-493a-8115-f2cef2be60e2\" (UID: \"618311de-9be2-493a-8115-f2cef2be60e2\") " Jul 02 20:44:59.565142 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:44:59.564984 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2kvd\" (UniqueName: \"kubernetes.io/projected/618311de-9be2-493a-8115-f2cef2be60e2-kube-api-access-h2kvd\") pod \"618311de-9be2-493a-8115-f2cef2be60e2\" (UID: \"618311de-9be2-493a-8115-f2cef2be60e2\") " Jul 02 20:44:59.567341 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:44:59.567309 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/618311de-9be2-493a-8115-f2cef2be60e2-kube-api-access-h2kvd" (OuterVolumeSpecName: "kube-api-access-h2kvd") pod "618311de-9be2-493a-8115-f2cef2be60e2" (UID: "618311de-9be2-493a-8115-f2cef2be60e2"). InnerVolumeSpecName "kube-api-access-h2kvd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:44:59.578791 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:44:59.578767 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/618311de-9be2-493a-8115-f2cef2be60e2-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "618311de-9be2-493a-8115-f2cef2be60e2" (UID: "618311de-9be2-493a-8115-f2cef2be60e2"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 20:44:59.666135 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:44:59.666102 2568 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/618311de-9be2-493a-8115-f2cef2be60e2-tls-cert\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:44:59.666135 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:44:59.666135 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2kvd\" (UniqueName: \"kubernetes.io/projected/618311de-9be2-493a-8115-f2cef2be60e2-kube-api-access-h2kvd\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:45:00.066792 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:45:00.066707 2568 generic.go:356] "Generic (PLEG): container finished" podID="618311de-9be2-493a-8115-f2cef2be60e2" containerID="3eca29f125e74232eb45094d048f178be4ad6401e7cedeff34403608883d711e" exitCode=0 Jul 02 20:45:00.066792 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:45:00.066742 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7d4564bb7f-rz28n" Jul 02 20:45:00.067301 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:45:00.066789 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d4564bb7f-rz28n" event={"ID":"618311de-9be2-493a-8115-f2cef2be60e2","Type":"ContainerDied","Data":"3eca29f125e74232eb45094d048f178be4ad6401e7cedeff34403608883d711e"} Jul 02 20:45:00.067301 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:45:00.066834 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7d4564bb7f-rz28n" event={"ID":"618311de-9be2-493a-8115-f2cef2be60e2","Type":"ContainerDied","Data":"6b4cba175af59b892ed75f37e4900bedefba0c1ec896614f042cbfe917b35b4d"} Jul 02 20:45:00.067301 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:45:00.066876 2568 scope.go:117] "RemoveContainer" containerID="3eca29f125e74232eb45094d048f178be4ad6401e7cedeff34403608883d711e" Jul 02 20:45:00.077077 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:45:00.077060 2568 scope.go:117] "RemoveContainer" containerID="3eca29f125e74232eb45094d048f178be4ad6401e7cedeff34403608883d711e" Jul 02 20:45:00.077392 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:45:00.077373 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3eca29f125e74232eb45094d048f178be4ad6401e7cedeff34403608883d711e\": container with ID starting with 3eca29f125e74232eb45094d048f178be4ad6401e7cedeff34403608883d711e not found: ID does not exist" containerID="3eca29f125e74232eb45094d048f178be4ad6401e7cedeff34403608883d711e" Jul 02 20:45:00.077455 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:45:00.077403 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3eca29f125e74232eb45094d048f178be4ad6401e7cedeff34403608883d711e"} err="failed to get container status \"3eca29f125e74232eb45094d048f178be4ad6401e7cedeff34403608883d711e\": rpc error: code = NotFound desc = could not find container \"3eca29f125e74232eb45094d048f178be4ad6401e7cedeff34403608883d711e\": container with ID starting with 3eca29f125e74232eb45094d048f178be4ad6401e7cedeff34403608883d711e not found: ID does not exist" Jul 02 20:45:00.088063 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:45:00.088036 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-7d4564bb7f-rz28n"] Jul 02 20:45:00.092240 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:45:00.092220 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-7d4564bb7f-rz28n"] Jul 02 20:45:00.164401 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:45:00.164342 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29717085-6ltxx"] Jul 02 20:45:00.165626 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:45:00.165592 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="618311de-9be2-493a-8115-f2cef2be60e2" containerName="authorino" Jul 02 20:45:00.165747 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:45:00.165631 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="618311de-9be2-493a-8115-f2cef2be60e2" containerName="authorino" Jul 02 20:45:00.165929 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:45:00.165915 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="618311de-9be2-493a-8115-f2cef2be60e2" containerName="authorino" Jul 02 20:45:00.171324 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:45:00.171287 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717085-6ltxx"] Jul 02 20:45:00.171479 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:45:00.171448 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717085-6ltxx" Jul 02 20:45:00.272127 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:45:00.272088 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hcx5\" (UniqueName: \"kubernetes.io/projected/34b4f5f7-9572-41e5-89ab-b3e97046c3e8-kube-api-access-2hcx5\") pod \"maas-api-key-cleanup-29717085-6ltxx\" (UID: \"34b4f5f7-9572-41e5-89ab-b3e97046c3e8\") " pod="opendatahub/maas-api-key-cleanup-29717085-6ltxx" Jul 02 20:45:00.364606 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:45:00.364535 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="618311de-9be2-493a-8115-f2cef2be60e2" path="/var/lib/kubelet/pods/618311de-9be2-493a-8115-f2cef2be60e2/volumes" Jul 02 20:45:00.373332 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:45:00.373302 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hcx5\" (UniqueName: \"kubernetes.io/projected/34b4f5f7-9572-41e5-89ab-b3e97046c3e8-kube-api-access-2hcx5\") pod \"maas-api-key-cleanup-29717085-6ltxx\" (UID: \"34b4f5f7-9572-41e5-89ab-b3e97046c3e8\") " pod="opendatahub/maas-api-key-cleanup-29717085-6ltxx" Jul 02 20:45:00.381702 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:45:00.381676 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hcx5\" (UniqueName: \"kubernetes.io/projected/34b4f5f7-9572-41e5-89ab-b3e97046c3e8-kube-api-access-2hcx5\") pod \"maas-api-key-cleanup-29717085-6ltxx\" (UID: \"34b4f5f7-9572-41e5-89ab-b3e97046c3e8\") " pod="opendatahub/maas-api-key-cleanup-29717085-6ltxx" Jul 02 20:45:00.483383 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:45:00.483093 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717085-6ltxx" Jul 02 20:45:00.626673 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:45:00.626645 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29717085-6ltxx"] Jul 02 20:45:00.629563 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:45:00.629533 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34b4f5f7_9572_41e5_89ab_b3e97046c3e8.slice/crio-b3868b25fc011da14a5c6c25645e2ee686cfc8a13a2685c13927096ef0af01ef WatchSource:0}: Error finding container b3868b25fc011da14a5c6c25645e2ee686cfc8a13a2685c13927096ef0af01ef: Status 404 returned error can't find the container with id b3868b25fc011da14a5c6c25645e2ee686cfc8a13a2685c13927096ef0af01ef Jul 02 20:45:01.072983 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:45:01.072937 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717085-6ltxx" event={"ID":"34b4f5f7-9572-41e5-89ab-b3e97046c3e8","Type":"ContainerStarted","Data":"b3868b25fc011da14a5c6c25645e2ee686cfc8a13a2685c13927096ef0af01ef"} Jul 02 20:45:04.094378 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:45:04.094292 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717085-6ltxx" event={"ID":"34b4f5f7-9572-41e5-89ab-b3e97046c3e8","Type":"ContainerStarted","Data":"fca1dbad5daa079a19430ab7a1fc33da51f4f075640b9707401e62f46fd80503"} Jul 02 20:45:04.110271 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:45:04.110230 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29717085-6ltxx" podStartSLOduration=1.415458312 podStartE2EDuration="4.110215788s" totalImagesPullingTime="2.694757476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:45:04.108370175 +0000 UTC m=+742.561291275" watchObservedRunningTime="2026-07-02 20:45:04.110215788 +0000 UTC m=+742.563136885" Jul 02 20:45:05.101620 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:45:05.101585 2568 generic.go:356] "Generic (PLEG): container finished" podID="34b4f5f7-9572-41e5-89ab-b3e97046c3e8" containerID="fca1dbad5daa079a19430ab7a1fc33da51f4f075640b9707401e62f46fd80503" exitCode=0 Jul 02 20:45:05.102017 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:45:05.101681 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717085-6ltxx" event={"ID":"34b4f5f7-9572-41e5-89ab-b3e97046c3e8","Type":"ContainerDied","Data":"fca1dbad5daa079a19430ab7a1fc33da51f4f075640b9707401e62f46fd80503"} Jul 02 20:45:06.276070 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:45:06.276042 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717085-6ltxx" Jul 02 20:45:06.341996 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:45:06.341961 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2hcx5\" (UniqueName: \"kubernetes.io/projected/34b4f5f7-9572-41e5-89ab-b3e97046c3e8-kube-api-access-2hcx5\") pod \"34b4f5f7-9572-41e5-89ab-b3e97046c3e8\" (UID: \"34b4f5f7-9572-41e5-89ab-b3e97046c3e8\") " Jul 02 20:45:06.344130 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:45:06.344100 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34b4f5f7-9572-41e5-89ab-b3e97046c3e8-kube-api-access-2hcx5" (OuterVolumeSpecName: "kube-api-access-2hcx5") pod "34b4f5f7-9572-41e5-89ab-b3e97046c3e8" (UID: "34b4f5f7-9572-41e5-89ab-b3e97046c3e8"). InnerVolumeSpecName "kube-api-access-2hcx5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:45:06.443183 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:45:06.443152 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2hcx5\" (UniqueName: \"kubernetes.io/projected/34b4f5f7-9572-41e5-89ab-b3e97046c3e8-kube-api-access-2hcx5\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:45:07.114374 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:45:07.114341 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29717085-6ltxx" Jul 02 20:45:07.114513 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:45:07.114377 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29717085-6ltxx" event={"ID":"34b4f5f7-9572-41e5-89ab-b3e97046c3e8","Type":"ContainerDied","Data":"b3868b25fc011da14a5c6c25645e2ee686cfc8a13a2685c13927096ef0af01ef"} Jul 02 20:45:07.114513 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:45:07.114417 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b3868b25fc011da14a5c6c25645e2ee686cfc8a13a2685c13927096ef0af01ef" Jul 02 20:46:13.001893 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:13.001787 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75b95d8b57-mffsw"] Jul 02 20:46:13.002446 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:13.002070 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-75b95d8b57-mffsw" podUID="46b42e27-de01-4686-8acd-26fcd54b8385" containerName="manager" containerID="cri-o://a250f128fe15f17edf4811fb8906838d6b118b26d891cc34fd0658e7ae253f40" gracePeriod=30 Jul 02 20:46:13.252463 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:13.252409 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75b95d8b57-mffsw" Jul 02 20:46:13.373115 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:13.373087 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-txsc7\" (UniqueName: \"kubernetes.io/projected/46b42e27-de01-4686-8acd-26fcd54b8385-kube-api-access-txsc7\") pod \"46b42e27-de01-4686-8acd-26fcd54b8385\" (UID: \"46b42e27-de01-4686-8acd-26fcd54b8385\") " Jul 02 20:46:13.373299 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:13.373191 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46b42e27-de01-4686-8acd-26fcd54b8385-webhook-cert\") pod \"46b42e27-de01-4686-8acd-26fcd54b8385\" (UID: \"46b42e27-de01-4686-8acd-26fcd54b8385\") " Jul 02 20:46:13.375256 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:13.375204 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/46b42e27-de01-4686-8acd-26fcd54b8385-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "46b42e27-de01-4686-8acd-26fcd54b8385" (UID: "46b42e27-de01-4686-8acd-26fcd54b8385"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 20:46:13.375393 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:13.375338 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/46b42e27-de01-4686-8acd-26fcd54b8385-kube-api-access-txsc7" (OuterVolumeSpecName: "kube-api-access-txsc7") pod "46b42e27-de01-4686-8acd-26fcd54b8385" (UID: "46b42e27-de01-4686-8acd-26fcd54b8385"). InnerVolumeSpecName "kube-api-access-txsc7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:46:13.457641 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:13.457611 2568 generic.go:356] "Generic (PLEG): container finished" podID="46b42e27-de01-4686-8acd-26fcd54b8385" containerID="a250f128fe15f17edf4811fb8906838d6b118b26d891cc34fd0658e7ae253f40" exitCode=0 Jul 02 20:46:13.457808 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:13.457653 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75b95d8b57-mffsw" Jul 02 20:46:13.457808 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:13.457653 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75b95d8b57-mffsw" event={"ID":"46b42e27-de01-4686-8acd-26fcd54b8385","Type":"ContainerDied","Data":"a250f128fe15f17edf4811fb8906838d6b118b26d891cc34fd0658e7ae253f40"} Jul 02 20:46:13.457808 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:13.457789 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75b95d8b57-mffsw" event={"ID":"46b42e27-de01-4686-8acd-26fcd54b8385","Type":"ContainerDied","Data":"d0203f950e9605c8d4e9c855dbc5f62975e6be0ab9577254f7fa10060085da3e"} Jul 02 20:46:13.457945 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:13.457821 2568 scope.go:117] "RemoveContainer" containerID="a250f128fe15f17edf4811fb8906838d6b118b26d891cc34fd0658e7ae253f40" Jul 02 20:46:13.467569 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:13.467555 2568 scope.go:117] "RemoveContainer" containerID="a250f128fe15f17edf4811fb8906838d6b118b26d891cc34fd0658e7ae253f40" Jul 02 20:46:13.467807 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:46:13.467788 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a250f128fe15f17edf4811fb8906838d6b118b26d891cc34fd0658e7ae253f40\": container with ID starting with a250f128fe15f17edf4811fb8906838d6b118b26d891cc34fd0658e7ae253f40 not found: ID does not exist" containerID="a250f128fe15f17edf4811fb8906838d6b118b26d891cc34fd0658e7ae253f40" Jul 02 20:46:13.467876 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:13.467817 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a250f128fe15f17edf4811fb8906838d6b118b26d891cc34fd0658e7ae253f40"} err="failed to get container status \"a250f128fe15f17edf4811fb8906838d6b118b26d891cc34fd0658e7ae253f40\": rpc error: code = NotFound desc = could not find container \"a250f128fe15f17edf4811fb8906838d6b118b26d891cc34fd0658e7ae253f40\": container with ID starting with a250f128fe15f17edf4811fb8906838d6b118b26d891cc34fd0658e7ae253f40 not found: ID does not exist" Jul 02 20:46:13.474818 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:13.474799 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-txsc7\" (UniqueName: \"kubernetes.io/projected/46b42e27-de01-4686-8acd-26fcd54b8385-kube-api-access-txsc7\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:46:13.474926 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:13.474821 2568 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/46b42e27-de01-4686-8acd-26fcd54b8385-webhook-cert\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:46:13.479870 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:13.479839 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-75b95d8b57-mffsw"] Jul 02 20:46:13.484935 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:13.484906 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-75b95d8b57-mffsw"] Jul 02 20:46:14.284223 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:14.284192 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-75b95d8b57-hc8jt"] Jul 02 20:46:14.284627 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:14.284615 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34b4f5f7-9572-41e5-89ab-b3e97046c3e8" containerName="cleanup" Jul 02 20:46:14.284668 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:14.284628 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="34b4f5f7-9572-41e5-89ab-b3e97046c3e8" containerName="cleanup" Jul 02 20:46:14.284668 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:14.284645 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="46b42e27-de01-4686-8acd-26fcd54b8385" containerName="manager" Jul 02 20:46:14.284668 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:14.284650 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="46b42e27-de01-4686-8acd-26fcd54b8385" containerName="manager" Jul 02 20:46:14.284758 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:14.284707 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="46b42e27-de01-4686-8acd-26fcd54b8385" containerName="manager" Jul 02 20:46:14.284758 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:14.284716 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="34b4f5f7-9572-41e5-89ab-b3e97046c3e8" containerName="cleanup" Jul 02 20:46:14.289089 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:14.289072 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75b95d8b57-hc8jt" Jul 02 20:46:14.292007 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:14.291986 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 02 20:46:14.292691 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:14.292672 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-fbckt\"" Jul 02 20:46:14.292753 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:14.292690 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 02 20:46:14.296609 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:14.296318 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75b95d8b57-hc8jt"] Jul 02 20:46:14.364154 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:14.364122 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="46b42e27-de01-4686-8acd-26fcd54b8385" path="/var/lib/kubelet/pods/46b42e27-de01-4686-8acd-26fcd54b8385/volumes" Jul 02 20:46:14.383544 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:14.383525 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrrsh\" (UniqueName: \"kubernetes.io/projected/a3dee8fb-c814-44cf-bade-ab45cfd43d08-kube-api-access-qrrsh\") pod \"maas-controller-75b95d8b57-hc8jt\" (UID: \"a3dee8fb-c814-44cf-bade-ab45cfd43d08\") " pod="opendatahub/maas-controller-75b95d8b57-hc8jt" Jul 02 20:46:14.383667 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:14.383554 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a3dee8fb-c814-44cf-bade-ab45cfd43d08-webhook-cert\") pod \"maas-controller-75b95d8b57-hc8jt\" (UID: \"a3dee8fb-c814-44cf-bade-ab45cfd43d08\") " pod="opendatahub/maas-controller-75b95d8b57-hc8jt" Jul 02 20:46:14.484828 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:14.484802 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrrsh\" (UniqueName: \"kubernetes.io/projected/a3dee8fb-c814-44cf-bade-ab45cfd43d08-kube-api-access-qrrsh\") pod \"maas-controller-75b95d8b57-hc8jt\" (UID: \"a3dee8fb-c814-44cf-bade-ab45cfd43d08\") " pod="opendatahub/maas-controller-75b95d8b57-hc8jt" Jul 02 20:46:14.484945 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:14.484835 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a3dee8fb-c814-44cf-bade-ab45cfd43d08-webhook-cert\") pod \"maas-controller-75b95d8b57-hc8jt\" (UID: \"a3dee8fb-c814-44cf-bade-ab45cfd43d08\") " pod="opendatahub/maas-controller-75b95d8b57-hc8jt" Jul 02 20:46:14.487157 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:14.487133 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a3dee8fb-c814-44cf-bade-ab45cfd43d08-webhook-cert\") pod \"maas-controller-75b95d8b57-hc8jt\" (UID: \"a3dee8fb-c814-44cf-bade-ab45cfd43d08\") " pod="opendatahub/maas-controller-75b95d8b57-hc8jt" Jul 02 20:46:14.492767 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:14.492745 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrrsh\" (UniqueName: \"kubernetes.io/projected/a3dee8fb-c814-44cf-bade-ab45cfd43d08-kube-api-access-qrrsh\") pod \"maas-controller-75b95d8b57-hc8jt\" (UID: \"a3dee8fb-c814-44cf-bade-ab45cfd43d08\") " pod="opendatahub/maas-controller-75b95d8b57-hc8jt" Jul 02 20:46:14.601235 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:14.601179 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-75b95d8b57-hc8jt" Jul 02 20:46:14.734942 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:14.734877 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-75b95d8b57-hc8jt"] Jul 02 20:46:14.737416 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:46:14.737391 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3dee8fb_c814_44cf_bade_ab45cfd43d08.slice/crio-61c9803c4683e1f40fe4f313f50ed67e5a789112bcdff468c844141bf94057b8 WatchSource:0}: Error finding container 61c9803c4683e1f40fe4f313f50ed67e5a789112bcdff468c844141bf94057b8: Status 404 returned error can't find the container with id 61c9803c4683e1f40fe4f313f50ed67e5a789112bcdff468c844141bf94057b8 Jul 02 20:46:15.470836 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:15.470751 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75b95d8b57-hc8jt" event={"ID":"a3dee8fb-c814-44cf-bade-ab45cfd43d08","Type":"ContainerStarted","Data":"d18b046dea8dd06942dae5ed2c9a09e31153006c3737aec4a608d3212deee790"} Jul 02 20:46:15.470836 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:15.470811 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-75b95d8b57-hc8jt" Jul 02 20:46:15.470836 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:15.470827 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-75b95d8b57-hc8jt" event={"ID":"a3dee8fb-c814-44cf-bade-ab45cfd43d08","Type":"ContainerStarted","Data":"61c9803c4683e1f40fe4f313f50ed67e5a789112bcdff468c844141bf94057b8"} Jul 02 20:46:15.490712 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:15.490668 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-75b95d8b57-hc8jt" podStartSLOduration=1.086355365 podStartE2EDuration="1.490654379s" totalImagesPullingTime="404.299014ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:46:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:46:15.488416082 +0000 UTC m=+813.941337180" watchObservedRunningTime="2026-07-02 20:46:15.490654379 +0000 UTC m=+813.943575502" Jul 02 20:46:26.481401 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:46:26.481370 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-75b95d8b57-hc8jt" Jul 02 20:51:56.917242 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:51:56.917204 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8rq2"] Jul 02 20:51:56.921005 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:51:56.920989 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8rq2" Jul 02 20:51:56.923405 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:51:56.923389 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-97plq\"" Jul 02 20:51:56.933290 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:51:56.933273 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8rq2"] Jul 02 20:51:56.996641 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:51:56.996616 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f5670433-3af6-4c67-92d8-832d90b43c7c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-l8rq2\" (UID: \"f5670433-3af6-4c67-92d8-832d90b43c7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8rq2" Jul 02 20:51:56.996733 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:51:56.996674 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sgkd\" (UniqueName: \"kubernetes.io/projected/f5670433-3af6-4c67-92d8-832d90b43c7c-kube-api-access-2sgkd\") pod \"kuadrant-operator-controller-manager-86878c769f-l8rq2\" (UID: \"f5670433-3af6-4c67-92d8-832d90b43c7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8rq2" Jul 02 20:51:57.097264 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:51:57.097237 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f5670433-3af6-4c67-92d8-832d90b43c7c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-l8rq2\" (UID: \"f5670433-3af6-4c67-92d8-832d90b43c7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8rq2" Jul 02 20:51:57.097394 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:51:57.097303 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sgkd\" (UniqueName: \"kubernetes.io/projected/f5670433-3af6-4c67-92d8-832d90b43c7c-kube-api-access-2sgkd\") pod \"kuadrant-operator-controller-manager-86878c769f-l8rq2\" (UID: \"f5670433-3af6-4c67-92d8-832d90b43c7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8rq2" Jul 02 20:51:57.097596 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:51:57.097577 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f5670433-3af6-4c67-92d8-832d90b43c7c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-l8rq2\" (UID: \"f5670433-3af6-4c67-92d8-832d90b43c7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8rq2" Jul 02 20:51:57.105328 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:51:57.105308 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sgkd\" (UniqueName: \"kubernetes.io/projected/f5670433-3af6-4c67-92d8-832d90b43c7c-kube-api-access-2sgkd\") pod \"kuadrant-operator-controller-manager-86878c769f-l8rq2\" (UID: \"f5670433-3af6-4c67-92d8-832d90b43c7c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8rq2" Jul 02 20:51:57.230824 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:51:57.230765 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8rq2" Jul 02 20:51:57.380361 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:51:57.380333 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8rq2"] Jul 02 20:51:57.381775 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:51:57.381738 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5670433_3af6_4c67_92d8_832d90b43c7c.slice/crio-0a553a1b7c4b5675416f6ba43ac4b036e9bdc7595afd029fb508d791a762b77d WatchSource:0}: Error finding container 0a553a1b7c4b5675416f6ba43ac4b036e9bdc7595afd029fb508d791a762b77d: Status 404 returned error can't find the container with id 0a553a1b7c4b5675416f6ba43ac4b036e9bdc7595afd029fb508d791a762b77d Jul 02 20:51:58.263044 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:51:58.263006 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8rq2" event={"ID":"f5670433-3af6-4c67-92d8-832d90b43c7c","Type":"ContainerStarted","Data":"c6a241e9a4e309660ac9ac135e448aa0142faae0f3d1ab4279386695e0d2941d"} Jul 02 20:51:58.263468 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:51:58.263067 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8rq2" event={"ID":"f5670433-3af6-4c67-92d8-832d90b43c7c","Type":"ContainerStarted","Data":"0a553a1b7c4b5675416f6ba43ac4b036e9bdc7595afd029fb508d791a762b77d"} Jul 02 20:51:58.263468 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:51:58.263096 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8rq2" Jul 02 20:51:58.284059 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:51:58.284018 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8rq2" podStartSLOduration=2.284004203 podStartE2EDuration="2.284004203s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:51:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:51:58.280838577 +0000 UTC m=+1156.733759678" watchObservedRunningTime="2026-07-02 20:51:58.284004203 +0000 UTC m=+1156.736925300" Jul 02 20:52:09.270503 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:52:09.270468 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-l8rq2" Jul 02 20:58:12.199568 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:12.199483 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2"] Jul 02 20:58:12.203794 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:12.203771 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" Jul 02 20:58:12.206168 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:12.206144 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-d75a2d72-openshift-default-dockercfg-tvr7h\"" Jul 02 20:58:12.226475 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:12.226448 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2"] Jul 02 20:58:12.231237 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:12.231211 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-istio-token\") pod \"e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2\" (UID: \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\") " pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" Jul 02 20:58:12.231326 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:12.231268 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-workload-socket\") pod \"e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2\" (UID: \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\") " pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" Jul 02 20:58:12.231326 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:12.231309 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-istio-data\") pod \"e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2\" (UID: \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\") " pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" Jul 02 20:58:12.231419 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:12.231366 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-istio-envoy\") pod \"e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2\" (UID: \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\") " pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" Jul 02 20:58:12.231461 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:12.231421 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-workload-certs\") pod \"e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2\" (UID: \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\") " pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" Jul 02 20:58:12.231461 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:12.231450 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-istio-podinfo\") pod \"e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2\" (UID: \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\") " pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" Jul 02 20:58:12.231602 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:12.231474 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-credential-socket\") pod \"e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2\" (UID: \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\") " pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" Jul 02 20:58:12.231602 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:12.231490 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-istiod-ca-cert\") pod \"e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2\" (UID: \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\") " pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" Jul 02 20:58:12.231602 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:12.231547 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn8vw\" (UniqueName: \"kubernetes.io/projected/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-kube-api-access-kn8vw\") pod \"e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2\" (UID: \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\") " pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" Jul 02 20:58:12.332455 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:12.332420 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-istio-podinfo\") pod \"e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2\" (UID: \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\") " pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" Jul 02 20:58:12.332709 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:12.332536 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-credential-socket\") pod \"e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2\" (UID: \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\") " pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" Jul 02 20:58:12.332709 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:12.332555 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-istiod-ca-cert\") pod \"e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2\" (UID: \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\") " pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" Jul 02 20:58:12.332709 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:12.332576 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn8vw\" (UniqueName: \"kubernetes.io/projected/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-kube-api-access-kn8vw\") pod \"e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2\" (UID: \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\") " pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" Jul 02 20:58:12.332709 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:12.332631 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-istio-token\") pod \"e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2\" (UID: \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\") " pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" Jul 02 20:58:12.332709 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:12.332657 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-workload-socket\") pod \"e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2\" (UID: \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\") " pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" Jul 02 20:58:12.332709 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:12.332681 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-istio-data\") pod \"e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2\" (UID: \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\") " pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" Jul 02 20:58:12.333393 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:12.332948 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-istio-envoy\") pod \"e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2\" (UID: \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\") " pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" Jul 02 20:58:12.333393 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:12.333040 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-workload-certs\") pod \"e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2\" (UID: \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\") " pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" Jul 02 20:58:12.333393 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:12.333360 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-istiod-ca-cert\") pod \"e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2\" (UID: \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\") " pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" Jul 02 20:58:12.333587 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:12.333560 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-credential-socket\") pod \"e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2\" (UID: \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\") " pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" Jul 02 20:58:12.333763 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:12.333610 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-workload-socket\") pod \"e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2\" (UID: \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\") " pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" Jul 02 20:58:12.333921 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:12.333900 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-istio-data\") pod \"e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2\" (UID: \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\") " pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" Jul 02 20:58:12.334028 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:12.333809 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-workload-certs\") pod \"e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2\" (UID: \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\") " pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" Jul 02 20:58:12.335344 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:12.335319 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-istio-podinfo\") pod \"e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2\" (UID: \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\") " pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" Jul 02 20:58:12.336015 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:12.335996 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-istio-envoy\") pod \"e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2\" (UID: \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\") " pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" Jul 02 20:58:12.342656 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:12.342628 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn8vw\" (UniqueName: \"kubernetes.io/projected/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-kube-api-access-kn8vw\") pod \"e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2\" (UID: \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\") " pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" Jul 02 20:58:12.342656 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:12.342647 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-istio-token\") pod \"e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2\" (UID: \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\") " pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" Jul 02 20:58:12.515826 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:12.515747 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" Jul 02 20:58:12.660058 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:12.660031 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2"] Jul 02 20:58:12.662154 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:58:12.662129 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod35c27ddf_09b0_4ea2_aa23_acfb4889bf02.slice/crio-0178608a1d17b8d777893b893abf82e951de9725fea58d4b37f450b5612aeb35 WatchSource:0}: Error finding container 0178608a1d17b8d777893b893abf82e951de9725fea58d4b37f450b5612aeb35: Status 404 returned error can't find the container with id 0178608a1d17b8d777893b893abf82e951de9725fea58d4b37f450b5612aeb35 Jul 02 20:58:12.664680 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:12.664648 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:58:12.664777 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:12.664714 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:58:12.664777 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:12.664745 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:58:13.254826 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:13.254785 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" event={"ID":"35c27ddf-09b0-4ea2-aa23-acfb4889bf02","Type":"ContainerStarted","Data":"0e3d8d523b5afc05e62fae9a9bd42db689ad201607aca0e557ea5fc6f685b95a"} Jul 02 20:58:13.255204 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:13.254893 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" event={"ID":"35c27ddf-09b0-4ea2-aa23-acfb4889bf02","Type":"ContainerStarted","Data":"0178608a1d17b8d777893b893abf82e951de9725fea58d4b37f450b5612aeb35"} Jul 02 20:58:13.277105 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:13.277062 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" podStartSLOduration=1.277047739 podStartE2EDuration="1.277047739s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:58:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:58:13.274796776 +0000 UTC m=+1531.727717896" watchObservedRunningTime="2026-07-02 20:58:13.277047739 +0000 UTC m=+1531.729968837" Jul 02 20:58:13.516422 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:13.516327 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" Jul 02 20:58:13.521326 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:13.521300 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" Jul 02 20:58:14.261941 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:14.261903 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" Jul 02 20:58:14.263030 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:14.263010 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" Jul 02 20:58:18.829223 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:18.829192 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2"] Jul 02 20:58:18.829678 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:18.829357 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" podUID="35c27ddf-09b0-4ea2-aa23-acfb4889bf02" containerName="istio-proxy" containerID="cri-o://0e3d8d523b5afc05e62fae9a9bd42db689ad201607aca0e557ea5fc6f685b95a" gracePeriod=30 Jul 02 20:58:24.801041 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:24.801016 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" Jul 02 20:58:24.954273 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:24.954238 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-workload-socket\") pod \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\" (UID: \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\") " Jul 02 20:58:24.954273 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:24.954274 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-istio-token\") pod \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\" (UID: \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\") " Jul 02 20:58:24.954485 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:24.954307 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-workload-certs\") pod \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\" (UID: \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\") " Jul 02 20:58:24.954485 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:24.954347 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-credential-socket\") pod \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\" (UID: \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\") " Jul 02 20:58:24.954485 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:24.954365 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-istio-podinfo\") pod \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\" (UID: \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\") " Jul 02 20:58:24.954485 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:24.954399 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-istiod-ca-cert\") pod \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\" (UID: \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\") " Jul 02 20:58:24.954485 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:24.954433 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-istio-envoy\") pod \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\" (UID: \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\") " Jul 02 20:58:24.954750 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:24.954524 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "35c27ddf-09b0-4ea2-aa23-acfb4889bf02" (UID: "35c27ddf-09b0-4ea2-aa23-acfb4889bf02"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:58:24.954750 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:24.954588 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-istio-data\") pod \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\" (UID: \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\") " Jul 02 20:58:24.954750 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:24.954626 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kn8vw\" (UniqueName: \"kubernetes.io/projected/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-kube-api-access-kn8vw\") pod \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\" (UID: \"35c27ddf-09b0-4ea2-aa23-acfb4889bf02\") " Jul 02 20:58:24.954750 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:24.954693 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "35c27ddf-09b0-4ea2-aa23-acfb4889bf02" (UID: "35c27ddf-09b0-4ea2-aa23-acfb4889bf02"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:58:24.955063 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:24.954868 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "35c27ddf-09b0-4ea2-aa23-acfb4889bf02" (UID: "35c27ddf-09b0-4ea2-aa23-acfb4889bf02"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:58:24.955127 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:24.955091 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-workload-socket\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:58:24.955127 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:24.955115 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-credential-socket\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:58:24.955242 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:24.955129 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-istiod-ca-cert\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:58:24.955301 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:24.955265 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-istio-data" (OuterVolumeSpecName: "istio-data") pod "35c27ddf-09b0-4ea2-aa23-acfb4889bf02" (UID: "35c27ddf-09b0-4ea2-aa23-acfb4889bf02"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:58:24.955573 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:24.955547 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "35c27ddf-09b0-4ea2-aa23-acfb4889bf02" (UID: "35c27ddf-09b0-4ea2-aa23-acfb4889bf02"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:58:24.956831 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:24.956810 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "35c27ddf-09b0-4ea2-aa23-acfb4889bf02" (UID: "35c27ddf-09b0-4ea2-aa23-acfb4889bf02"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:58:24.957033 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:24.957011 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-kube-api-access-kn8vw" (OuterVolumeSpecName: "kube-api-access-kn8vw") pod "35c27ddf-09b0-4ea2-aa23-acfb4889bf02" (UID: "35c27ddf-09b0-4ea2-aa23-acfb4889bf02"). InnerVolumeSpecName "kube-api-access-kn8vw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:58:24.957092 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:24.957011 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "35c27ddf-09b0-4ea2-aa23-acfb4889bf02" (UID: "35c27ddf-09b0-4ea2-aa23-acfb4889bf02"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 20:58:24.957092 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:24.957072 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-istio-token" (OuterVolumeSpecName: "istio-token") pod "35c27ddf-09b0-4ea2-aa23-acfb4889bf02" (UID: "35c27ddf-09b0-4ea2-aa23-acfb4889bf02"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:58:25.056300 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:25.056258 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-istio-podinfo\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:58:25.056300 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:25.056293 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-istio-envoy\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:58:25.056300 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:25.056305 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-istio-data\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:58:25.056531 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:25.056317 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kn8vw\" (UniqueName: \"kubernetes.io/projected/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-kube-api-access-kn8vw\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:58:25.056531 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:25.056329 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-istio-token\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:58:25.056531 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:25.056340 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/35c27ddf-09b0-4ea2-aa23-acfb4889bf02-workload-certs\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:58:25.324788 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:25.324706 2568 generic.go:356] "Generic (PLEG): container finished" podID="35c27ddf-09b0-4ea2-aa23-acfb4889bf02" containerID="0e3d8d523b5afc05e62fae9a9bd42db689ad201607aca0e557ea5fc6f685b95a" exitCode=0 Jul 02 20:58:25.324788 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:25.324745 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" event={"ID":"35c27ddf-09b0-4ea2-aa23-acfb4889bf02","Type":"ContainerDied","Data":"0e3d8d523b5afc05e62fae9a9bd42db689ad201607aca0e557ea5fc6f685b95a"} Jul 02 20:58:25.324788 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:25.324774 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" Jul 02 20:58:25.325039 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:25.324814 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2" event={"ID":"35c27ddf-09b0-4ea2-aa23-acfb4889bf02","Type":"ContainerDied","Data":"0178608a1d17b8d777893b893abf82e951de9725fea58d4b37f450b5612aeb35"} Jul 02 20:58:25.325039 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:25.324837 2568 scope.go:117] "RemoveContainer" containerID="0e3d8d523b5afc05e62fae9a9bd42db689ad201607aca0e557ea5fc6f685b95a" Jul 02 20:58:25.334470 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:25.334447 2568 scope.go:117] "RemoveContainer" containerID="0e3d8d523b5afc05e62fae9a9bd42db689ad201607aca0e557ea5fc6f685b95a" Jul 02 20:58:25.334745 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:58:25.334726 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0e3d8d523b5afc05e62fae9a9bd42db689ad201607aca0e557ea5fc6f685b95a\": container with ID starting with 0e3d8d523b5afc05e62fae9a9bd42db689ad201607aca0e557ea5fc6f685b95a not found: ID does not exist" containerID="0e3d8d523b5afc05e62fae9a9bd42db689ad201607aca0e557ea5fc6f685b95a" Jul 02 20:58:25.334838 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:25.334755 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0e3d8d523b5afc05e62fae9a9bd42db689ad201607aca0e557ea5fc6f685b95a"} err="failed to get container status \"0e3d8d523b5afc05e62fae9a9bd42db689ad201607aca0e557ea5fc6f685b95a\": rpc error: code = NotFound desc = could not find container \"0e3d8d523b5afc05e62fae9a9bd42db689ad201607aca0e557ea5fc6f685b95a\": container with ID starting with 0e3d8d523b5afc05e62fae9a9bd42db689ad201607aca0e557ea5fc6f685b95a not found: ID does not exist" Jul 02 20:58:25.346620 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:25.346601 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2"] Jul 02 20:58:25.350337 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:25.350318 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-d75a2d72-openshift-default-65df796447-zf8s2"] Jul 02 20:58:26.363562 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:26.363530 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="35c27ddf-09b0-4ea2-aa23-acfb4889bf02" path="/var/lib/kubelet/pods/35c27ddf-09b0-4ea2-aa23-acfb4889bf02/volumes" Jul 02 20:58:43.426371 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:43.426337 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r"] Jul 02 20:58:43.427314 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:43.427287 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="35c27ddf-09b0-4ea2-aa23-acfb4889bf02" containerName="istio-proxy" Jul 02 20:58:43.427314 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:43.427314 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="35c27ddf-09b0-4ea2-aa23-acfb4889bf02" containerName="istio-proxy" Jul 02 20:58:43.427519 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:43.427462 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="35c27ddf-09b0-4ea2-aa23-acfb4889bf02" containerName="istio-proxy" Jul 02 20:58:43.430900 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:43.430880 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" Jul 02 20:58:43.440231 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:43.433111 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-a3fd23bb-openshift-default-dockercfg-4xjt7\"" Jul 02 20:58:43.444642 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:43.444609 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r"] Jul 02 20:58:43.544269 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:43.544006 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6gtl4\" (UniqueName: \"kubernetes.io/projected/b0ac181c-c78c-46d2-8667-da61b325b034-kube-api-access-6gtl4\") pod \"e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r\" (UID: \"b0ac181c-c78c-46d2-8667-da61b325b034\") " pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" Jul 02 20:58:43.544269 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:43.544082 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0ac181c-c78c-46d2-8667-da61b325b034-istio-data\") pod \"e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r\" (UID: \"b0ac181c-c78c-46d2-8667-da61b325b034\") " pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" Jul 02 20:58:43.544269 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:43.544122 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0ac181c-c78c-46d2-8667-da61b325b034-istiod-ca-cert\") pod \"e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r\" (UID: \"b0ac181c-c78c-46d2-8667-da61b325b034\") " pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" Jul 02 20:58:43.544269 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:43.544149 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0ac181c-c78c-46d2-8667-da61b325b034-istio-podinfo\") pod \"e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r\" (UID: \"b0ac181c-c78c-46d2-8667-da61b325b034\") " pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" Jul 02 20:58:43.544269 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:43.544175 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0ac181c-c78c-46d2-8667-da61b325b034-istio-token\") pod \"e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r\" (UID: \"b0ac181c-c78c-46d2-8667-da61b325b034\") " pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" Jul 02 20:58:43.544269 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:43.544254 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ac181c-c78c-46d2-8667-da61b325b034-credential-socket\") pod \"e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r\" (UID: \"b0ac181c-c78c-46d2-8667-da61b325b034\") " pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" Jul 02 20:58:43.544676 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:43.544291 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ac181c-c78c-46d2-8667-da61b325b034-workload-socket\") pod \"e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r\" (UID: \"b0ac181c-c78c-46d2-8667-da61b325b034\") " pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" Jul 02 20:58:43.544676 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:43.544339 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0ac181c-c78c-46d2-8667-da61b325b034-istio-envoy\") pod \"e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r\" (UID: \"b0ac181c-c78c-46d2-8667-da61b325b034\") " pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" Jul 02 20:58:43.544676 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:43.544400 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0ac181c-c78c-46d2-8667-da61b325b034-workload-certs\") pod \"e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r\" (UID: \"b0ac181c-c78c-46d2-8667-da61b325b034\") " pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" Jul 02 20:58:43.645461 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:43.645429 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ac181c-c78c-46d2-8667-da61b325b034-credential-socket\") pod \"e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r\" (UID: \"b0ac181c-c78c-46d2-8667-da61b325b034\") " pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" Jul 02 20:58:43.645607 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:43.645469 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ac181c-c78c-46d2-8667-da61b325b034-workload-socket\") pod \"e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r\" (UID: \"b0ac181c-c78c-46d2-8667-da61b325b034\") " pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" Jul 02 20:58:43.645607 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:43.645511 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0ac181c-c78c-46d2-8667-da61b325b034-istio-envoy\") pod \"e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r\" (UID: \"b0ac181c-c78c-46d2-8667-da61b325b034\") " pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" Jul 02 20:58:43.645607 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:43.645565 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0ac181c-c78c-46d2-8667-da61b325b034-workload-certs\") pod \"e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r\" (UID: \"b0ac181c-c78c-46d2-8667-da61b325b034\") " pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" Jul 02 20:58:43.645607 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:43.645595 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6gtl4\" (UniqueName: \"kubernetes.io/projected/b0ac181c-c78c-46d2-8667-da61b325b034-kube-api-access-6gtl4\") pod \"e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r\" (UID: \"b0ac181c-c78c-46d2-8667-da61b325b034\") " pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" Jul 02 20:58:43.645836 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:43.645643 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0ac181c-c78c-46d2-8667-da61b325b034-istio-data\") pod \"e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r\" (UID: \"b0ac181c-c78c-46d2-8667-da61b325b034\") " pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" Jul 02 20:58:43.645836 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:43.645677 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0ac181c-c78c-46d2-8667-da61b325b034-istiod-ca-cert\") pod \"e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r\" (UID: \"b0ac181c-c78c-46d2-8667-da61b325b034\") " pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" Jul 02 20:58:43.645836 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:43.645703 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0ac181c-c78c-46d2-8667-da61b325b034-istio-podinfo\") pod \"e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r\" (UID: \"b0ac181c-c78c-46d2-8667-da61b325b034\") " pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" Jul 02 20:58:43.645836 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:43.645823 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ac181c-c78c-46d2-8667-da61b325b034-credential-socket\") pod \"e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r\" (UID: \"b0ac181c-c78c-46d2-8667-da61b325b034\") " pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" Jul 02 20:58:43.646060 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:43.645905 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ac181c-c78c-46d2-8667-da61b325b034-workload-socket\") pod \"e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r\" (UID: \"b0ac181c-c78c-46d2-8667-da61b325b034\") " pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" Jul 02 20:58:43.646117 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:43.646086 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0ac181c-c78c-46d2-8667-da61b325b034-workload-certs\") pod \"e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r\" (UID: \"b0ac181c-c78c-46d2-8667-da61b325b034\") " pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" Jul 02 20:58:43.646216 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:43.645730 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0ac181c-c78c-46d2-8667-da61b325b034-istio-token\") pod \"e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r\" (UID: \"b0ac181c-c78c-46d2-8667-da61b325b034\") " pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" Jul 02 20:58:43.646216 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:43.646213 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0ac181c-c78c-46d2-8667-da61b325b034-istio-data\") pod \"e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r\" (UID: \"b0ac181c-c78c-46d2-8667-da61b325b034\") " pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" Jul 02 20:58:43.646562 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:43.646538 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0ac181c-c78c-46d2-8667-da61b325b034-istiod-ca-cert\") pod \"e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r\" (UID: \"b0ac181c-c78c-46d2-8667-da61b325b034\") " pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" Jul 02 20:58:43.647940 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:43.647919 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0ac181c-c78c-46d2-8667-da61b325b034-istio-envoy\") pod \"e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r\" (UID: \"b0ac181c-c78c-46d2-8667-da61b325b034\") " pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" Jul 02 20:58:43.648141 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:43.648125 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0ac181c-c78c-46d2-8667-da61b325b034-istio-podinfo\") pod \"e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r\" (UID: \"b0ac181c-c78c-46d2-8667-da61b325b034\") " pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" Jul 02 20:58:43.653665 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:43.653645 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0ac181c-c78c-46d2-8667-da61b325b034-istio-token\") pod \"e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r\" (UID: \"b0ac181c-c78c-46d2-8667-da61b325b034\") " pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" Jul 02 20:58:43.653665 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:43.653654 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6gtl4\" (UniqueName: \"kubernetes.io/projected/b0ac181c-c78c-46d2-8667-da61b325b034-kube-api-access-6gtl4\") pod \"e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r\" (UID: \"b0ac181c-c78c-46d2-8667-da61b325b034\") " pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" Jul 02 20:58:43.744507 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:43.744449 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" Jul 02 20:58:43.880699 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:43.880673 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r"] Jul 02 20:58:43.882830 ip-10-0-137-144 kubenswrapper[2568]: W0702 20:58:43.882796 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0ac181c_c78c_46d2_8667_da61b325b034.slice/crio-70f167df709f70a3222bf23075c9f9bff9d177620c1f716bca267243a25213f5 WatchSource:0}: Error finding container 70f167df709f70a3222bf23075c9f9bff9d177620c1f716bca267243a25213f5: Status 404 returned error can't find the container with id 70f167df709f70a3222bf23075c9f9bff9d177620c1f716bca267243a25213f5 Jul 02 20:58:43.885447 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:43.885415 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:58:43.885531 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:43.885478 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:58:43.885531 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:43.885519 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:58:44.425822 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:44.425784 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" event={"ID":"b0ac181c-c78c-46d2-8667-da61b325b034","Type":"ContainerStarted","Data":"196b065a3cb04d29b2555413906fb7ef9b3eab7e09168d63bbdea1573622b305"} Jul 02 20:58:44.426038 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:44.425842 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" event={"ID":"b0ac181c-c78c-46d2-8667-da61b325b034","Type":"ContainerStarted","Data":"70f167df709f70a3222bf23075c9f9bff9d177620c1f716bca267243a25213f5"} Jul 02 20:58:44.444041 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:44.443938 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" podStartSLOduration=1.443920399 podStartE2EDuration="1.443920399s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:58:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:58:44.443555963 +0000 UTC m=+1562.896477061" watchObservedRunningTime="2026-07-02 20:58:44.443920399 +0000 UTC m=+1562.896841498" Jul 02 20:58:44.745209 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:44.745118 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" Jul 02 20:58:44.750119 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:44.750085 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" Jul 02 20:58:45.431839 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:45.431807 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" Jul 02 20:58:45.432730 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:45.432711 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" Jul 02 20:58:49.325802 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:49.325762 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r"] Jul 02 20:58:49.326199 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:49.326040 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" podUID="b0ac181c-c78c-46d2-8667-da61b325b034" containerName="istio-proxy" containerID="cri-o://196b065a3cb04d29b2555413906fb7ef9b3eab7e09168d63bbdea1573622b305" gracePeriod=30 Jul 02 20:58:55.887158 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:55.887136 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" Jul 02 20:58:55.982485 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:55.982413 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0ac181c-c78c-46d2-8667-da61b325b034-istio-data\") pod \"b0ac181c-c78c-46d2-8667-da61b325b034\" (UID: \"b0ac181c-c78c-46d2-8667-da61b325b034\") " Jul 02 20:58:55.982485 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:55.982451 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0ac181c-c78c-46d2-8667-da61b325b034-istio-envoy\") pod \"b0ac181c-c78c-46d2-8667-da61b325b034\" (UID: \"b0ac181c-c78c-46d2-8667-da61b325b034\") " Jul 02 20:58:55.982485 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:55.982477 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ac181c-c78c-46d2-8667-da61b325b034-credential-socket\") pod \"b0ac181c-c78c-46d2-8667-da61b325b034\" (UID: \"b0ac181c-c78c-46d2-8667-da61b325b034\") " Jul 02 20:58:55.982732 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:55.982538 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ac181c-c78c-46d2-8667-da61b325b034-workload-socket\") pod \"b0ac181c-c78c-46d2-8667-da61b325b034\" (UID: \"b0ac181c-c78c-46d2-8667-da61b325b034\") " Jul 02 20:58:55.982732 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:55.982560 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0ac181c-c78c-46d2-8667-da61b325b034-istiod-ca-cert\") pod \"b0ac181c-c78c-46d2-8667-da61b325b034\" (UID: \"b0ac181c-c78c-46d2-8667-da61b325b034\") " Jul 02 20:58:55.982732 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:55.982605 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0ac181c-c78c-46d2-8667-da61b325b034-istio-token\") pod \"b0ac181c-c78c-46d2-8667-da61b325b034\" (UID: \"b0ac181c-c78c-46d2-8667-da61b325b034\") " Jul 02 20:58:55.982732 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:55.982649 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0ac181c-c78c-46d2-8667-da61b325b034-istio-podinfo\") pod \"b0ac181c-c78c-46d2-8667-da61b325b034\" (UID: \"b0ac181c-c78c-46d2-8667-da61b325b034\") " Jul 02 20:58:55.982732 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:55.982683 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6gtl4\" (UniqueName: \"kubernetes.io/projected/b0ac181c-c78c-46d2-8667-da61b325b034-kube-api-access-6gtl4\") pod \"b0ac181c-c78c-46d2-8667-da61b325b034\" (UID: \"b0ac181c-c78c-46d2-8667-da61b325b034\") " Jul 02 20:58:55.983014 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:55.982728 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0ac181c-c78c-46d2-8667-da61b325b034-workload-certs\") pod \"b0ac181c-c78c-46d2-8667-da61b325b034\" (UID: \"b0ac181c-c78c-46d2-8667-da61b325b034\") " Jul 02 20:58:55.983014 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:55.982816 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0ac181c-c78c-46d2-8667-da61b325b034-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b0ac181c-c78c-46d2-8667-da61b325b034" (UID: "b0ac181c-c78c-46d2-8667-da61b325b034"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:58:55.983014 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:55.982828 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0ac181c-c78c-46d2-8667-da61b325b034-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b0ac181c-c78c-46d2-8667-da61b325b034" (UID: "b0ac181c-c78c-46d2-8667-da61b325b034"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:58:55.983171 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:55.983031 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0ac181c-c78c-46d2-8667-da61b325b034-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b0ac181c-c78c-46d2-8667-da61b325b034" (UID: "b0ac181c-c78c-46d2-8667-da61b325b034"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:58:55.983171 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:55.983139 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0ac181c-c78c-46d2-8667-da61b325b034-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b0ac181c-c78c-46d2-8667-da61b325b034" (UID: "b0ac181c-c78c-46d2-8667-da61b325b034"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:58:55.983344 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:55.983239 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ac181c-c78c-46d2-8667-da61b325b034-workload-socket\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:58:55.983344 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:55.983258 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b0ac181c-c78c-46d2-8667-da61b325b034-istiod-ca-cert\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:58:55.983344 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:55.983275 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b0ac181c-c78c-46d2-8667-da61b325b034-workload-certs\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:58:55.983344 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:55.983287 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b0ac181c-c78c-46d2-8667-da61b325b034-credential-socket\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:58:55.983870 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:55.983822 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0ac181c-c78c-46d2-8667-da61b325b034-istio-data" (OuterVolumeSpecName: "istio-data") pod "b0ac181c-c78c-46d2-8667-da61b325b034" (UID: "b0ac181c-c78c-46d2-8667-da61b325b034"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:58:55.984944 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:55.984917 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b0ac181c-c78c-46d2-8667-da61b325b034-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b0ac181c-c78c-46d2-8667-da61b325b034" (UID: "b0ac181c-c78c-46d2-8667-da61b325b034"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:58:55.985230 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:55.985205 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0ac181c-c78c-46d2-8667-da61b325b034-istio-token" (OuterVolumeSpecName: "istio-token") pod "b0ac181c-c78c-46d2-8667-da61b325b034" (UID: "b0ac181c-c78c-46d2-8667-da61b325b034"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:58:55.985230 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:55.985218 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b0ac181c-c78c-46d2-8667-da61b325b034-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b0ac181c-c78c-46d2-8667-da61b325b034" (UID: "b0ac181c-c78c-46d2-8667-da61b325b034"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 20:58:55.985350 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:55.985336 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0ac181c-c78c-46d2-8667-da61b325b034-kube-api-access-6gtl4" (OuterVolumeSpecName: "kube-api-access-6gtl4") pod "b0ac181c-c78c-46d2-8667-da61b325b034" (UID: "b0ac181c-c78c-46d2-8667-da61b325b034"). InnerVolumeSpecName "kube-api-access-6gtl4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:58:56.084378 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:56.084349 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b0ac181c-c78c-46d2-8667-da61b325b034-istio-token\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:58:56.084378 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:56.084375 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b0ac181c-c78c-46d2-8667-da61b325b034-istio-podinfo\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:58:56.084378 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:56.084383 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6gtl4\" (UniqueName: \"kubernetes.io/projected/b0ac181c-c78c-46d2-8667-da61b325b034-kube-api-access-6gtl4\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:58:56.084601 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:56.084392 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b0ac181c-c78c-46d2-8667-da61b325b034-istio-data\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:58:56.084601 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:56.084401 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b0ac181c-c78c-46d2-8667-da61b325b034-istio-envoy\") on node \"ip-10-0-137-144.ec2.internal\" DevicePath \"\"" Jul 02 20:58:56.495689 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:56.495657 2568 generic.go:356] "Generic (PLEG): container finished" podID="b0ac181c-c78c-46d2-8667-da61b325b034" containerID="196b065a3cb04d29b2555413906fb7ef9b3eab7e09168d63bbdea1573622b305" exitCode=0 Jul 02 20:58:56.495874 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:56.495718 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" Jul 02 20:58:56.495874 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:56.495759 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" event={"ID":"b0ac181c-c78c-46d2-8667-da61b325b034","Type":"ContainerDied","Data":"196b065a3cb04d29b2555413906fb7ef9b3eab7e09168d63bbdea1573622b305"} Jul 02 20:58:56.495975 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:56.495887 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r" event={"ID":"b0ac181c-c78c-46d2-8667-da61b325b034","Type":"ContainerDied","Data":"70f167df709f70a3222bf23075c9f9bff9d177620c1f716bca267243a25213f5"} Jul 02 20:58:56.495975 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:56.495930 2568 scope.go:117] "RemoveContainer" containerID="196b065a3cb04d29b2555413906fb7ef9b3eab7e09168d63bbdea1573622b305" Jul 02 20:58:56.506219 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:56.506201 2568 scope.go:117] "RemoveContainer" containerID="196b065a3cb04d29b2555413906fb7ef9b3eab7e09168d63bbdea1573622b305" Jul 02 20:58:56.506488 ip-10-0-137-144 kubenswrapper[2568]: E0702 20:58:56.506471 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"196b065a3cb04d29b2555413906fb7ef9b3eab7e09168d63bbdea1573622b305\": container with ID starting with 196b065a3cb04d29b2555413906fb7ef9b3eab7e09168d63bbdea1573622b305 not found: ID does not exist" containerID="196b065a3cb04d29b2555413906fb7ef9b3eab7e09168d63bbdea1573622b305" Jul 02 20:58:56.506558 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:56.506496 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"196b065a3cb04d29b2555413906fb7ef9b3eab7e09168d63bbdea1573622b305"} err="failed to get container status \"196b065a3cb04d29b2555413906fb7ef9b3eab7e09168d63bbdea1573622b305\": rpc error: code = NotFound desc = could not find container \"196b065a3cb04d29b2555413906fb7ef9b3eab7e09168d63bbdea1573622b305\": container with ID starting with 196b065a3cb04d29b2555413906fb7ef9b3eab7e09168d63bbdea1573622b305 not found: ID does not exist" Jul 02 20:58:56.515099 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:56.515078 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r"] Jul 02 20:58:56.519242 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:56.519222 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-a3fd23bb-openshift-default-66845586bc-xbc5r"] Jul 02 20:58:58.363990 ip-10-0-137-144 kubenswrapper[2568]: I0702 20:58:58.363960 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0ac181c-c78c-46d2-8667-da61b325b034" path="/var/lib/kubelet/pods/b0ac181c-c78c-46d2-8667-da61b325b034/volumes" Jul 02 21:13:11.888365 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:11.888290 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-744b689b78-6k66x_94018d83-1ac0-4aef-9dce-0de84d774942/authorino/0.log" Jul 02 21:13:16.663486 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:16.663452 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-svgb4_667003da-7aff-4b8c-acf4-68288835814d/manager/0.log" Jul 02 21:13:16.786232 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:16.786202 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-dngrh_e059fe1a-b773-4a3c-be9b-e679d5f763e5/manager/0.log" Jul 02 21:13:16.907885 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:16.907840 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-67c4fd747d-m8m58_1934c3ed-11e9-4155-aee8-3332b580a8a6/maas-api/0.log" Jul 02 21:13:17.022168 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:17.022096 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717085-6ltxx_34b4f5f7-9572-41e5-89ab-b3e97046c3e8/cleanup/0.log" Jul 02 21:13:17.305365 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:17.305287 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-75b95d8b57-hc8jt_a3dee8fb-c814-44cf-bade-ab45cfd43d08/manager/0.log" Jul 02 21:13:17.424710 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:17.424678 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-jqhb2_ef87df6e-102e-4922-a871-25cffbd425b5/server/0.log" Jul 02 21:13:17.554721 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:17.554689 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-nht7x_bf997017-5106-439c-b4c0-cd0a5cac8a45/manager/0.log" Jul 02 21:13:17.943953 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:17.943928 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-857d77d4-wnfrc_8ef0a4c4-44e7-4db8-a3e1-fc4f8157fd3c/copy-manifests/0.log" Jul 02 21:13:17.950638 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:17.950618 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-857d77d4-wnfrc_8ef0a4c4-44e7-4db8-a3e1-fc4f8157fd3c/manager/0.log" Jul 02 21:13:18.068924 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:18.068900 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-lkjcm_16476007-8920-4b0d-9809-ac9bb3093900/postgres/0.log" Jul 02 21:13:19.354437 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:19.354406 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-744b689b78-6k66x_94018d83-1ac0-4aef-9dce-0de84d774942/authorino/0.log" Jul 02 21:13:19.468183 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:19.468157 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-r4bv9_95cade37-7239-44fd-9abd-50668cbd5bc6/manager/0.log" Jul 02 21:13:19.579983 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:19.579954 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-qlv5j_ee4e3e0a-627b-4033-968e-2cc8f8fb43ca/manager/0.log" Jul 02 21:13:19.814973 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:19.814944 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-fgppc_b51f11ee-1142-4ab2-bea4-5a82a6f2f29a/registry-server/0.log" Jul 02 21:13:19.937549 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:19.937525 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-l8rq2_f5670433-3af6-4c67-92d8-832d90b43c7c/manager/0.log" Jul 02 21:13:20.175349 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:20.175319 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-mkwwv_c68c3411-b472-4b48-aaef-b036051d630a/manager/0.log" Jul 02 21:13:20.556104 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:20.556034 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4n6fvr_37e0a6e2-fadc-4db4-818e-e62b0ccecbc6/istio-proxy/0.log" Jul 02 21:13:20.906144 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:20.906118 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-84bc744f59-646fq_d681a289-1348-42c3-b53c-2b2dfaa77d0c/kube-auth-proxy/0.log" Jul 02 21:13:21.023353 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:21.023324 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-phcmp_81c70b4a-1052-4408-b325-39b47def09bb/istio-proxy/1.log" Jul 02 21:13:21.137814 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:21.137758 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-9jwzw_28d96b3e-c62f-492e-adb5-9a82ca2fbd84/payload-pre-processing/0.log" Jul 02 21:13:21.259428 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:21.259337 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-lhqtj_72121762-0f5d-46d9-b80d-be803711aa92/payload-processing/0.log" Jul 02 21:13:21.399668 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:21.399643 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bcf6499df-kdlwt_23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3/router/0.log" Jul 02 21:13:21.765125 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:21.765102 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-f28rx_d3e94b87-2236-4e6e-b5f3-6aa033d2e3f4/main/0.log" Jul 02 21:13:29.300721 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:29.300690 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6r6ph_cce9f678-db00-4f8d-bdaa-b2479796b62e/global-pull-secret-syncer/0.log" Jul 02 21:13:29.495813 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:29.495785 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-tnmd2_061a3e0f-48fe-4a8f-8b89-d0931f9e404d/konnectivity-agent/0.log" Jul 02 21:13:29.536410 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:29.536381 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-144.ec2.internal_a3daa949ad2399aa2ae00a9f45c827ee/haproxy/0.log" Jul 02 21:13:34.929229 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:34.929191 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-744b689b78-6k66x_94018d83-1ac0-4aef-9dce-0de84d774942/authorino/0.log" Jul 02 21:13:34.953060 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:34.953039 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-r4bv9_95cade37-7239-44fd-9abd-50668cbd5bc6/manager/0.log" Jul 02 21:13:34.975101 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:34.975076 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-qlv5j_ee4e3e0a-627b-4033-968e-2cc8f8fb43ca/manager/0.log" Jul 02 21:13:35.049938 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:35.049916 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-fgppc_b51f11ee-1142-4ab2-bea4-5a82a6f2f29a/registry-server/0.log" Jul 02 21:13:35.182613 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:35.182525 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-l8rq2_f5670433-3af6-4c67-92d8-832d90b43c7c/manager/0.log" Jul 02 21:13:35.264116 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:35.264090 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-mkwwv_c68c3411-b472-4b48-aaef-b036051d630a/manager/0.log" Jul 02 21:13:37.080125 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:37.080096 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-c99pw_0ee7e6d8-0e22-4375-9960-f84947ae2770/kube-state-metrics/0.log" Jul 02 21:13:37.097959 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:37.097933 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-c99pw_0ee7e6d8-0e22-4375-9960-f84947ae2770/kube-rbac-proxy-main/0.log" Jul 02 21:13:37.117040 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:37.117023 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-c99pw_0ee7e6d8-0e22-4375-9960-f84947ae2770/kube-rbac-proxy-self/0.log" Jul 02 21:13:37.175882 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:37.175795 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-8z9pk_a239902c-ff93-4680-828e-7bce6705a027/monitoring-plugin/0.log" Jul 02 21:13:37.278627 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:37.278608 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-47sv5_93ba4cee-8bca-48f6-8ae3-5b69ee3967f3/node-exporter/0.log" Jul 02 21:13:37.296773 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:37.296745 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-47sv5_93ba4cee-8bca-48f6-8ae3-5b69ee3967f3/kube-rbac-proxy/0.log" Jul 02 21:13:37.315792 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:37.315775 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-47sv5_93ba4cee-8bca-48f6-8ae3-5b69ee3967f3/init-textfile/0.log" Jul 02 21:13:37.493507 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:37.493424 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_95d00282-87de-4c17-a64a-aa4c88e6a01e/prometheus/0.log" Jul 02 21:13:37.515612 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:37.515588 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_95d00282-87de-4c17-a64a-aa4c88e6a01e/config-reloader/0.log" Jul 02 21:13:37.538990 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:37.538973 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_95d00282-87de-4c17-a64a-aa4c88e6a01e/thanos-sidecar/0.log" Jul 02 21:13:37.560777 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:37.560754 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_95d00282-87de-4c17-a64a-aa4c88e6a01e/kube-rbac-proxy-web/0.log" Jul 02 21:13:37.579441 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:37.579422 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_95d00282-87de-4c17-a64a-aa4c88e6a01e/kube-rbac-proxy/0.log" Jul 02 21:13:37.603994 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:37.603973 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_95d00282-87de-4c17-a64a-aa4c88e6a01e/kube-rbac-proxy-thanos/0.log" Jul 02 21:13:37.626506 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:37.626490 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_95d00282-87de-4c17-a64a-aa4c88e6a01e/init-config-reloader/0.log" Jul 02 21:13:37.910262 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:37.910228 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-576648f479-7nhsg_72f7a0ca-962c-4f3e-a451-b0a03b267c2e/thanos-query/0.log" Jul 02 21:13:37.932284 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:37.932259 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-576648f479-7nhsg_72f7a0ca-962c-4f3e-a451-b0a03b267c2e/kube-rbac-proxy-web/0.log" Jul 02 21:13:37.957434 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:37.957414 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-576648f479-7nhsg_72f7a0ca-962c-4f3e-a451-b0a03b267c2e/kube-rbac-proxy/0.log" Jul 02 21:13:37.978069 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:37.978049 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-576648f479-7nhsg_72f7a0ca-962c-4f3e-a451-b0a03b267c2e/prom-label-proxy/0.log" Jul 02 21:13:38.002996 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:38.002976 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-576648f479-7nhsg_72f7a0ca-962c-4f3e-a451-b0a03b267c2e/kube-rbac-proxy-rules/0.log" Jul 02 21:13:38.028496 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:38.028468 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-576648f479-7nhsg_72f7a0ca-962c-4f3e-a451-b0a03b267c2e/kube-rbac-proxy-metrics/0.log" Jul 02 21:13:39.151011 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:39.150984 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-h9hft_e3e8f80d-94d0-41f1-aac8-7107b503496d/networking-console-plugin/0.log" Jul 02 21:13:39.447566 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:39.447489 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-mt95b/perf-node-gather-daemonset-n9mlc"] Jul 02 21:13:39.448030 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:39.448007 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0ac181c-c78c-46d2-8667-da61b325b034" containerName="istio-proxy" Jul 02 21:13:39.448030 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:39.448027 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0ac181c-c78c-46d2-8667-da61b325b034" containerName="istio-proxy" Jul 02 21:13:39.448216 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:39.448150 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0ac181c-c78c-46d2-8667-da61b325b034" containerName="istio-proxy" Jul 02 21:13:39.451550 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:39.451532 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-n9mlc" Jul 02 21:13:39.453526 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:39.453507 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mt95b\"/\"kube-root-ca.crt\"" Jul 02 21:13:39.453627 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:39.453507 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-mt95b\"/\"default-dockercfg-czfgl\"" Jul 02 21:13:39.454307 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:39.454291 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-mt95b\"/\"openshift-service-ca.crt\"" Jul 02 21:13:39.460673 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:39.460653 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mt95b/perf-node-gather-daemonset-n9mlc"] Jul 02 21:13:39.532560 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:39.532524 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/24d2f9dd-05d6-474d-8981-66ca6b7be716-sys\") pod \"perf-node-gather-daemonset-n9mlc\" (UID: \"24d2f9dd-05d6-474d-8981-66ca6b7be716\") " pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-n9mlc" Jul 02 21:13:39.532674 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:39.532605 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/24d2f9dd-05d6-474d-8981-66ca6b7be716-lib-modules\") pod \"perf-node-gather-daemonset-n9mlc\" (UID: \"24d2f9dd-05d6-474d-8981-66ca6b7be716\") " pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-n9mlc" Jul 02 21:13:39.532674 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:39.532641 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/24d2f9dd-05d6-474d-8981-66ca6b7be716-podres\") pod \"perf-node-gather-daemonset-n9mlc\" (UID: \"24d2f9dd-05d6-474d-8981-66ca6b7be716\") " pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-n9mlc" Jul 02 21:13:39.532746 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:39.532694 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/24d2f9dd-05d6-474d-8981-66ca6b7be716-proc\") pod \"perf-node-gather-daemonset-n9mlc\" (UID: \"24d2f9dd-05d6-474d-8981-66ca6b7be716\") " pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-n9mlc" Jul 02 21:13:39.532746 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:39.532719 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5ckq\" (UniqueName: \"kubernetes.io/projected/24d2f9dd-05d6-474d-8981-66ca6b7be716-kube-api-access-l5ckq\") pod \"perf-node-gather-daemonset-n9mlc\" (UID: \"24d2f9dd-05d6-474d-8981-66ca6b7be716\") " pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-n9mlc" Jul 02 21:13:39.633135 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:39.633111 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/24d2f9dd-05d6-474d-8981-66ca6b7be716-lib-modules\") pod \"perf-node-gather-daemonset-n9mlc\" (UID: \"24d2f9dd-05d6-474d-8981-66ca6b7be716\") " pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-n9mlc" Jul 02 21:13:39.633250 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:39.633155 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/24d2f9dd-05d6-474d-8981-66ca6b7be716-podres\") pod \"perf-node-gather-daemonset-n9mlc\" (UID: \"24d2f9dd-05d6-474d-8981-66ca6b7be716\") " pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-n9mlc" Jul 02 21:13:39.633250 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:39.633180 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/24d2f9dd-05d6-474d-8981-66ca6b7be716-proc\") pod \"perf-node-gather-daemonset-n9mlc\" (UID: \"24d2f9dd-05d6-474d-8981-66ca6b7be716\") " pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-n9mlc" Jul 02 21:13:39.633250 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:39.633198 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5ckq\" (UniqueName: \"kubernetes.io/projected/24d2f9dd-05d6-474d-8981-66ca6b7be716-kube-api-access-l5ckq\") pod \"perf-node-gather-daemonset-n9mlc\" (UID: \"24d2f9dd-05d6-474d-8981-66ca6b7be716\") " pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-n9mlc" Jul 02 21:13:39.633250 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:39.633229 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/24d2f9dd-05d6-474d-8981-66ca6b7be716-sys\") pod \"perf-node-gather-daemonset-n9mlc\" (UID: \"24d2f9dd-05d6-474d-8981-66ca6b7be716\") " pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-n9mlc" Jul 02 21:13:39.633425 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:39.633281 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/24d2f9dd-05d6-474d-8981-66ca6b7be716-lib-modules\") pod \"perf-node-gather-daemonset-n9mlc\" (UID: \"24d2f9dd-05d6-474d-8981-66ca6b7be716\") " pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-n9mlc" Jul 02 21:13:39.633425 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:39.633301 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/24d2f9dd-05d6-474d-8981-66ca6b7be716-sys\") pod \"perf-node-gather-daemonset-n9mlc\" (UID: \"24d2f9dd-05d6-474d-8981-66ca6b7be716\") " pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-n9mlc" Jul 02 21:13:39.633425 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:39.633301 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/24d2f9dd-05d6-474d-8981-66ca6b7be716-proc\") pod \"perf-node-gather-daemonset-n9mlc\" (UID: \"24d2f9dd-05d6-474d-8981-66ca6b7be716\") " pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-n9mlc" Jul 02 21:13:39.633425 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:39.633338 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/24d2f9dd-05d6-474d-8981-66ca6b7be716-podres\") pod \"perf-node-gather-daemonset-n9mlc\" (UID: \"24d2f9dd-05d6-474d-8981-66ca6b7be716\") " pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-n9mlc" Jul 02 21:13:39.640733 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:39.640712 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5ckq\" (UniqueName: \"kubernetes.io/projected/24d2f9dd-05d6-474d-8981-66ca6b7be716-kube-api-access-l5ckq\") pod \"perf-node-gather-daemonset-n9mlc\" (UID: \"24d2f9dd-05d6-474d-8981-66ca6b7be716\") " pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-n9mlc" Jul 02 21:13:39.762021 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:39.761950 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-n9mlc" Jul 02 21:13:40.107806 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:40.107774 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-mt95b/perf-node-gather-daemonset-n9mlc"] Jul 02 21:13:40.108527 ip-10-0-137-144 kubenswrapper[2568]: W0702 21:13:40.108500 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod24d2f9dd_05d6_474d_8981_66ca6b7be716.slice/crio-6a1200a872d7eb1d772a71f7f18cd0e9192aed1d72701bb22b19ccba02eb7ada WatchSource:0}: Error finding container 6a1200a872d7eb1d772a71f7f18cd0e9192aed1d72701bb22b19ccba02eb7ada: Status 404 returned error can't find the container with id 6a1200a872d7eb1d772a71f7f18cd0e9192aed1d72701bb22b19ccba02eb7ada Jul 02 21:13:40.180148 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:40.180118 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-n9mlc" event={"ID":"24d2f9dd-05d6-474d-8981-66ca6b7be716","Type":"ContainerStarted","Data":"6a1200a872d7eb1d772a71f7f18cd0e9192aed1d72701bb22b19ccba02eb7ada"} Jul 02 21:13:40.271647 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:40.271612 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-685bfb5f64-9spck_19fac57d-e5fc-4182-8cd3-60bd9a80d34f/download-server/0.log" Jul 02 21:13:41.188160 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:41.188113 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-n9mlc" event={"ID":"24d2f9dd-05d6-474d-8981-66ca6b7be716","Type":"ContainerStarted","Data":"0ca2a82121caa404a766d22a21b6f88b2aef98ea22db7e3dbe7315902ba9cc5f"} Jul 02 21:13:41.188631 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:41.188203 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-n9mlc" Jul 02 21:13:41.206760 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:41.206712 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-n9mlc" podStartSLOduration=2.20669795 podStartE2EDuration="2.20669795s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 21:13:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 21:13:41.20467735 +0000 UTC m=+2459.657598451" watchObservedRunningTime="2026-07-02 21:13:41.20669795 +0000 UTC m=+2459.659619084" Jul 02 21:13:41.877517 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:41.877490 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xmprk_1705bb5f-096c-48a1-84ec-bd013e7d0349/dns/0.log" Jul 02 21:13:41.896204 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:41.896182 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xmprk_1705bb5f-096c-48a1-84ec-bd013e7d0349/kube-rbac-proxy/0.log" Jul 02 21:13:41.919553 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:41.919530 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-hlj5p_2f642606-1324-47e9-a987-6007d50f7707/dns-node-resolver/0.log" Jul 02 21:13:42.462943 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:42.462915 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-6df6c84d95-l9gpq_f82f44ef-89ff-44e6-a7c5-12b0e0fb3433/registry/0.log" Jul 02 21:13:42.508537 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:42.508490 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q8p8n_b7d5983b-3afb-4507-abeb-871f909d6414/node-ca/0.log" Jul 02 21:13:43.422823 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:43.422795 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4n6fvr_37e0a6e2-fadc-4db4-818e-e62b0ccecbc6/istio-proxy/0.log" Jul 02 21:13:43.576100 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:43.576072 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-84bc744f59-646fq_d681a289-1348-42c3-b53c-2b2dfaa77d0c/kube-auth-proxy/0.log" Jul 02 21:13:43.600986 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:43.600939 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-phcmp_81c70b4a-1052-4408-b325-39b47def09bb/istio-proxy/0.log" Jul 02 21:13:43.628246 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:43.628219 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-phcmp_81c70b4a-1052-4408-b325-39b47def09bb/istio-proxy/1.log" Jul 02 21:13:43.659321 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:43.659292 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-9jwzw_28d96b3e-c62f-492e-adb5-9a82ca2fbd84/payload-pre-processing/0.log" Jul 02 21:13:43.704144 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:43.704089 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-lhqtj_72121762-0f5d-46d9-b80d-be803711aa92/payload-processing/0.log" Jul 02 21:13:43.726131 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:43.726101 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bcf6499df-kdlwt_23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3/router/0.log" Jul 02 21:13:44.424820 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:44.424788 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-s2t78_a5763ddc-b57e-4b60-9779-a16c70e04461/serve-healthcheck-canary/0.log" Jul 02 21:13:44.859110 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:44.859025 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-6n7zw_9119d7cb-306a-4d98-a453-f123ab249419/insights-operator/0.log" Jul 02 21:13:44.859602 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:44.859586 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-6n7zw_9119d7cb-306a-4d98-a453-f123ab249419/insights-operator/1.log" Jul 02 21:13:45.009909 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:45.009882 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xlr9j_4588daf7-7cbc-4731-a3f5-de94d6fc9d60/kube-rbac-proxy/0.log" Jul 02 21:13:45.030014 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:45.029991 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xlr9j_4588daf7-7cbc-4731-a3f5-de94d6fc9d60/exporter/0.log" Jul 02 21:13:45.052557 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:45.052537 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-xlr9j_4588daf7-7cbc-4731-a3f5-de94d6fc9d60/extractor/0.log" Jul 02 21:13:47.089074 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:47.089036 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-svgb4_667003da-7aff-4b8c-acf4-68288835814d/manager/0.log" Jul 02 21:13:47.203825 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:47.203794 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-mt95b/perf-node-gather-daemonset-n9mlc" Jul 02 21:13:47.211062 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:47.211039 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-dngrh_e059fe1a-b773-4a3c-be9b-e679d5f763e5/manager/0.log" Jul 02 21:13:47.282881 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:47.282839 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-67c4fd747d-m8m58_1934c3ed-11e9-4155-aee8-3332b580a8a6/maas-api/0.log" Jul 02 21:13:47.301008 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:47.300983 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29717085-6ltxx_34b4f5f7-9572-41e5-89ab-b3e97046c3e8/cleanup/0.log" Jul 02 21:13:47.420900 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:47.420869 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-75b95d8b57-hc8jt_a3dee8fb-c814-44cf-bade-ab45cfd43d08/manager/0.log" Jul 02 21:13:47.440085 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:47.440060 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-jqhb2_ef87df6e-102e-4922-a871-25cffbd425b5/server/0.log" Jul 02 21:13:47.504363 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:47.504334 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-nht7x_bf997017-5106-439c-b4c0-cd0a5cac8a45/manager/0.log" Jul 02 21:13:47.696770 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:47.696671 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-857d77d4-wnfrc_8ef0a4c4-44e7-4db8-a3e1-fc4f8157fd3c/manager/0.log" Jul 02 21:13:47.715455 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:47.715428 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-857d77d4-wnfrc_8ef0a4c4-44e7-4db8-a3e1-fc4f8157fd3c/copy-manifests/0.log" Jul 02 21:13:47.738268 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:47.738234 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-lkjcm_16476007-8920-4b0d-9809-ac9bb3093900/postgres/0.log" Jul 02 21:13:49.616377 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:49.616295 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4n6fvr_37e0a6e2-fadc-4db4-818e-e62b0ccecbc6/istio-proxy/0.log" Jul 02 21:13:49.740197 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:49.740171 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-84bc744f59-646fq_d681a289-1348-42c3-b53c-2b2dfaa77d0c/kube-auth-proxy/0.log" Jul 02 21:13:49.756283 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:49.756263 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-phcmp_81c70b4a-1052-4408-b325-39b47def09bb/istio-proxy/0.log" Jul 02 21:13:49.783082 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:49.783063 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-phcmp_81c70b4a-1052-4408-b325-39b47def09bb/istio-proxy/1.log" Jul 02 21:13:49.805506 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:49.805486 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-9jwzw_28d96b3e-c62f-492e-adb5-9a82ca2fbd84/payload-pre-processing/0.log" Jul 02 21:13:49.842193 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:49.842175 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-lhqtj_72121762-0f5d-46d9-b80d-be803711aa92/payload-processing/0.log" Jul 02 21:13:49.856456 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:49.856435 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bcf6499df-kdlwt_23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3/router/0.log" Jul 02 21:13:50.993734 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:50.993711 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4n6fvr_37e0a6e2-fadc-4db4-818e-e62b0ccecbc6/istio-proxy/0.log" Jul 02 21:13:51.122486 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:51.122461 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-84bc744f59-646fq_d681a289-1348-42c3-b53c-2b2dfaa77d0c/kube-auth-proxy/0.log" Jul 02 21:13:51.145914 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:51.145888 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-phcmp_81c70b4a-1052-4408-b325-39b47def09bb/istio-proxy/0.log" Jul 02 21:13:51.176281 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:51.176261 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-phcmp_81c70b4a-1052-4408-b325-39b47def09bb/istio-proxy/1.log" Jul 02 21:13:51.196541 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:51.196520 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-9jwzw_28d96b3e-c62f-492e-adb5-9a82ca2fbd84/payload-pre-processing/0.log" Jul 02 21:13:51.236270 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:51.236248 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-lhqtj_72121762-0f5d-46d9-b80d-be803711aa92/payload-processing/0.log" Jul 02 21:13:51.249330 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:51.249276 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6bcf6499df-kdlwt_23c9bbc2-b5d6-42c6-b5eb-c573692bb5b3/router/0.log" Jul 02 21:13:54.410182 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:54.410150 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-rjw76_04592575-7bc0-4f9f-9396-e286c6b76413/kube-storage-version-migrator-operator/1.log" Jul 02 21:13:54.411086 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:54.411067 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-rjw76_04592575-7bc0-4f9f-9396-e286c6b76413/kube-storage-version-migrator-operator/0.log" Jul 02 21:13:55.633724 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:55.633692 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xkk7n_02a28c36-499c-40df-92ac-4cf4b1222c70/kube-multus-additional-cni-plugins/0.log" Jul 02 21:13:55.654445 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:55.654425 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xkk7n_02a28c36-499c-40df-92ac-4cf4b1222c70/egress-router-binary-copy/0.log" Jul 02 21:13:55.673553 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:55.673533 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xkk7n_02a28c36-499c-40df-92ac-4cf4b1222c70/cni-plugins/0.log" Jul 02 21:13:55.692363 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:55.692346 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xkk7n_02a28c36-499c-40df-92ac-4cf4b1222c70/bond-cni-plugin/0.log" Jul 02 21:13:55.712067 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:55.712043 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xkk7n_02a28c36-499c-40df-92ac-4cf4b1222c70/routeoverride-cni/0.log" Jul 02 21:13:55.731820 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:55.731790 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xkk7n_02a28c36-499c-40df-92ac-4cf4b1222c70/whereabouts-cni-bincopy/0.log" Jul 02 21:13:55.751079 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:55.751058 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-xkk7n_02a28c36-499c-40df-92ac-4cf4b1222c70/whereabouts-cni/0.log" Jul 02 21:13:55.955194 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:55.955108 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-n9rd8_2d608d9c-dccd-4a18-bc1f-b33258ff0874/kube-multus/0.log" Jul 02 21:13:56.042559 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:56.042534 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ls998_56e0a8da-b013-4d0c-b5e9-b9431f944da3/network-metrics-daemon/0.log" Jul 02 21:13:56.061212 ip-10-0-137-144 kubenswrapper[2568]: I0702 21:13:56.061189 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ls998_56e0a8da-b013-4d0c-b5e9-b9431f944da3/kube-rbac-proxy/0.log"