Jun 11 14:28:12.549706 ip-10-0-135-108 systemd[1]: Starting Kubernetes Kubelet... Jun 11 14:28:12.941184 ip-10-0-135-108 kubenswrapper[2574]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 14:28:12.941184 ip-10-0-135-108 kubenswrapper[2574]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 11 14:28:12.941184 ip-10-0-135-108 kubenswrapper[2574]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 14:28:12.941184 ip-10-0-135-108 kubenswrapper[2574]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 11 14:28:12.941184 ip-10-0-135-108 kubenswrapper[2574]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 11 14:28:12.941957 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.941866 2574 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 11 14:28:12.946074 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946056 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:28:12.946074 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946074 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:28:12.946140 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946079 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:28:12.946140 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946082 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:28:12.946140 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946085 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:28:12.946140 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946088 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:28:12.946140 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946091 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:28:12.946140 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946094 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:28:12.946140 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946096 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:28:12.946140 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946099 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:28:12.946140 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946102 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:28:12.946140 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946107 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:28:12.946140 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946110 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:28:12.946140 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946113 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:28:12.946140 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946116 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:28:12.946140 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946118 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:28:12.946140 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946121 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:28:12.946140 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946124 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:28:12.946140 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946127 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:28:12.946140 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946129 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:28:12.946140 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946132 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:28:12.946140 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946135 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:28:12.946682 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946138 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:28:12.946682 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946140 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:28:12.946682 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946143 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:28:12.946682 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946146 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:28:12.946682 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946149 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:28:12.946682 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946152 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:28:12.946682 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946155 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:28:12.946682 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946157 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:28:12.946682 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946160 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:28:12.946682 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946162 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:28:12.946682 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946165 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:28:12.946682 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946167 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:28:12.946682 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946170 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:28:12.946682 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946172 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:28:12.946682 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946175 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:28:12.946682 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946177 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:28:12.946682 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946181 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:28:12.946682 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946185 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:28:12.946682 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946189 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:28:12.947145 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946192 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:28:12.947145 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946195 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:28:12.947145 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946198 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:28:12.947145 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946201 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:28:12.947145 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946204 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:28:12.947145 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946206 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:28:12.947145 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946208 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:28:12.947145 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946211 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:28:12.947145 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946213 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:28:12.947145 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946216 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:28:12.947145 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946218 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:28:12.947145 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946221 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:28:12.947145 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946223 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:28:12.947145 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946226 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:28:12.947145 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946230 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:28:12.947145 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946233 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:28:12.947145 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946235 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:28:12.947145 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946239 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:28:12.947145 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946241 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:28:12.947684 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946244 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:28:12.947684 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946256 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:28:12.947684 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946259 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:28:12.947684 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946263 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:28:12.947684 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946265 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:28:12.947684 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946268 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:28:12.947684 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946270 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:28:12.947684 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946273 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:28:12.947684 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946276 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:28:12.947684 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946278 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:28:12.947684 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946281 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:28:12.947684 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946284 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:28:12.947684 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946288 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:28:12.947684 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946298 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:28:12.947684 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946302 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:28:12.947684 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946306 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:28:12.947684 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946309 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:28:12.947684 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946311 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:28:12.947684 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946314 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:28:12.947684 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946316 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:28:12.948178 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946320 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:28:12.948178 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946324 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:28:12.948178 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946327 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:28:12.948178 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946329 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:28:12.948178 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946332 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:28:12.948178 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946335 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:28:12.948178 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946337 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:28:12.948178 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946341 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:28:12.948178 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946344 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:28:12.948178 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946347 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:28:12.948178 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946349 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:28:12.948178 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946352 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:28:12.948178 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946354 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:28:12.948178 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946370 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:28:12.948178 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946373 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:28:12.948178 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946375 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:28:12.948178 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946378 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:28:12.948178 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946381 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:28:12.948178 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.946384 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:28:12.948702 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948049 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:28:12.948702 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948058 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:28:12.948702 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948062 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:28:12.948702 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948067 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:28:12.948702 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948070 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:28:12.948702 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948073 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:28:12.948702 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948076 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:28:12.948702 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948079 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:28:12.948702 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948082 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:28:12.948702 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948085 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:28:12.948702 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948088 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:28:12.948702 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948091 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:28:12.948702 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948093 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:28:12.948702 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948096 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:28:12.948702 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948099 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:28:12.948702 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948101 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:28:12.948702 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948104 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:28:12.948702 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948106 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:28:12.948702 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948109 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:28:12.949185 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948112 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:28:12.949185 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948115 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:28:12.949185 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948118 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:28:12.949185 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948121 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:28:12.949185 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948124 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:28:12.949185 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948127 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:28:12.949185 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948129 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:28:12.949185 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948132 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:28:12.949185 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948135 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:28:12.949185 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948137 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:28:12.949185 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948140 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:28:12.949185 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948143 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:28:12.949185 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948145 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:28:12.949185 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948149 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:28:12.949185 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948153 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:28:12.949185 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948155 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:28:12.949185 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948159 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:28:12.949185 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948164 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:28:12.949185 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948167 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:28:12.949185 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948170 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:28:12.949732 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948173 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:28:12.949732 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948176 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:28:12.949732 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948178 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:28:12.949732 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948182 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:28:12.949732 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948185 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:28:12.949732 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948188 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:28:12.949732 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948191 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:28:12.949732 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948194 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:28:12.949732 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948197 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:28:12.949732 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948199 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:28:12.949732 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948202 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:28:12.949732 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948205 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:28:12.949732 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948207 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:28:12.949732 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948210 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:28:12.949732 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948213 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:28:12.949732 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948216 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:28:12.949732 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948218 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:28:12.949732 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948221 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:28:12.949732 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948224 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:28:12.949732 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948226 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:28:12.950242 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948229 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:28:12.950242 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948231 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:28:12.950242 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948234 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:28:12.950242 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948237 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:28:12.950242 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948240 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:28:12.950242 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948242 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:28:12.950242 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948245 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:28:12.950242 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948247 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:28:12.950242 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948250 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:28:12.950242 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948252 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:28:12.950242 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948255 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:28:12.950242 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948257 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:28:12.950242 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948260 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:28:12.950242 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948262 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:28:12.950242 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948265 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:28:12.950242 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948268 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:28:12.950242 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948271 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:28:12.950242 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948276 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:28:12.950242 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948279 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:28:12.950758 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948282 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:28:12.950758 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948285 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:28:12.950758 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948288 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:28:12.950758 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948291 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:28:12.950758 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948293 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:28:12.950758 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948296 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:28:12.950758 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948299 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:28:12.950758 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948301 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:28:12.950758 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948304 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:28:12.950758 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948307 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:28:12.950758 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948311 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:28:12.950758 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948315 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:28:12.950758 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948318 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:28:12.950758 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948321 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:28:12.950758 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948324 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:28:12.950758 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948326 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:28:12.950758 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948329 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:28:12.950758 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948332 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:28:12.950758 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948334 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:28:12.951242 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948337 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:28:12.951242 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948340 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:28:12.951242 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948750 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:28:12.951242 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948756 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:28:12.951242 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948759 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:28:12.951242 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948762 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:28:12.951242 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948764 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:28:12.951242 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948767 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:28:12.951242 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948770 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:28:12.951242 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948772 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:28:12.951242 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948776 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:28:12.951242 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948781 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:28:12.951242 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948784 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:28:12.951242 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948786 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:28:12.951242 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948789 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:28:12.951242 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948792 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:28:12.951242 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948794 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:28:12.951242 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948799 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:28:12.951242 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948803 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:28:12.951848 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948807 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:28:12.951848 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948811 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:28:12.951848 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948814 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:28:12.951848 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948817 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:28:12.951848 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948819 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:28:12.951848 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948822 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:28:12.951848 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948824 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:28:12.951848 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948827 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:28:12.951848 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948830 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:28:12.951848 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948833 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:28:12.951848 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948835 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:28:12.951848 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948838 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:28:12.951848 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948840 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:28:12.951848 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948843 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:28:12.951848 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948845 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:28:12.951848 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948848 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:28:12.951848 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948850 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:28:12.951848 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948853 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:28:12.951848 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948855 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:28:12.951848 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948858 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:28:12.952373 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948861 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:28:12.952373 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948863 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:28:12.952373 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948865 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:28:12.952373 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948868 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:28:12.952373 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948873 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:28:12.952373 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948875 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:28:12.952373 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948878 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:28:12.952373 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948881 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:28:12.952373 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948884 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:28:12.952373 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948886 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:28:12.952373 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948889 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:28:12.952373 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948892 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:28:12.952373 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948894 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:28:12.952373 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948897 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:28:12.952373 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948900 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:28:12.952373 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948903 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:28:12.952373 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948905 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:28:12.952373 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948908 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:28:12.952373 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948912 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:28:12.952857 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948916 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:28:12.952857 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948918 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:28:12.952857 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948921 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:28:12.952857 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948924 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:28:12.952857 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948928 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:28:12.952857 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948930 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:28:12.952857 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948933 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:28:12.952857 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948935 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:28:12.952857 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948938 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:28:12.952857 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948940 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:28:12.952857 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948943 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:28:12.952857 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948946 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:28:12.952857 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948948 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:28:12.952857 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948951 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:28:12.952857 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948953 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:28:12.952857 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948955 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:28:12.952857 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948958 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:28:12.952857 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948962 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:28:12.952857 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948965 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:28:12.952857 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948967 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:28:12.953406 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948970 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:28:12.953406 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948973 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:28:12.953406 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948975 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:28:12.953406 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948978 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:28:12.953406 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948981 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:28:12.953406 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948983 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:28:12.953406 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948985 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:28:12.953406 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948988 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:28:12.953406 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948990 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:28:12.953406 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948993 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:28:12.953406 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948995 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:28:12.953406 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.948998 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:28:12.953406 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949000 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:28:12.953406 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949003 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:28:12.953406 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949005 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:28:12.953406 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949008 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:28:12.953406 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949010 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:28:12.953406 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949013 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:28:12.953406 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949015 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:28:12.953406 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949018 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:28:12.953908 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949020 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:28:12.953908 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949022 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:28:12.953908 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949025 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:28:12.953908 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949103 2574 flags.go:64] FLAG: --address="0.0.0.0" Jun 11 14:28:12.953908 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949111 2574 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 11 14:28:12.953908 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949117 2574 flags.go:64] FLAG: --anonymous-auth="true" Jun 11 14:28:12.953908 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949121 2574 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 11 14:28:12.953908 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949125 2574 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 11 14:28:12.953908 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949128 2574 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 11 14:28:12.953908 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949135 2574 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 11 14:28:12.953908 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949140 2574 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 11 14:28:12.953908 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949144 2574 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 11 14:28:12.953908 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949147 2574 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 11 14:28:12.953908 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949150 2574 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 11 14:28:12.953908 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949153 2574 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 11 14:28:12.953908 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949157 2574 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 11 14:28:12.953908 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949160 2574 flags.go:64] FLAG: --cgroup-root="" Jun 11 14:28:12.953908 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949163 2574 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 11 14:28:12.953908 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949166 2574 flags.go:64] FLAG: --client-ca-file="" Jun 11 14:28:12.953908 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949169 2574 flags.go:64] FLAG: --cloud-provider="external" Jun 11 14:28:12.953908 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949172 2574 flags.go:64] FLAG: --cluster-dns="[]" Jun 11 14:28:12.953908 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949177 2574 flags.go:64] FLAG: --cluster-domain="" Jun 11 14:28:12.953908 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949180 2574 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 11 14:28:12.953908 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949183 2574 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 11 14:28:12.954538 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949187 2574 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 11 14:28:12.954538 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949190 2574 flags.go:64] FLAG: --container-log-max-files="5" Jun 11 14:28:12.954538 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949195 2574 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 11 14:28:12.954538 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949198 2574 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 11 14:28:12.954538 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949201 2574 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 11 14:28:12.954538 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949205 2574 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 11 14:28:12.954538 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949208 2574 flags.go:64] FLAG: --contention-profiling="false" Jun 11 14:28:12.954538 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949211 2574 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 11 14:28:12.954538 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949214 2574 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 11 14:28:12.954538 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949217 2574 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 11 14:28:12.954538 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949219 2574 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 11 14:28:12.954538 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949224 2574 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 11 14:28:12.954538 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949226 2574 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 11 14:28:12.954538 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949229 2574 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 11 14:28:12.954538 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949232 2574 flags.go:64] FLAG: --enable-load-reader="false" Jun 11 14:28:12.954538 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949235 2574 flags.go:64] FLAG: --enable-server="true" Jun 11 14:28:12.954538 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949238 2574 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 11 14:28:12.954538 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949244 2574 flags.go:64] FLAG: --event-burst="100" Jun 11 14:28:12.954538 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949247 2574 flags.go:64] FLAG: --event-qps="50" Jun 11 14:28:12.954538 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949250 2574 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 11 14:28:12.954538 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949254 2574 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 11 14:28:12.954538 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949257 2574 flags.go:64] FLAG: --eviction-hard="" Jun 11 14:28:12.954538 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949261 2574 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 11 14:28:12.954538 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949265 2574 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 11 14:28:12.955132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949267 2574 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 11 14:28:12.955132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949270 2574 flags.go:64] FLAG: --eviction-soft="" Jun 11 14:28:12.955132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949273 2574 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 11 14:28:12.955132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949276 2574 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 11 14:28:12.955132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949279 2574 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 11 14:28:12.955132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949282 2574 flags.go:64] FLAG: --experimental-mounter-path="" Jun 11 14:28:12.955132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949285 2574 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 11 14:28:12.955132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949287 2574 flags.go:64] FLAG: --fail-swap-on="true" Jun 11 14:28:12.955132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949290 2574 flags.go:64] FLAG: --feature-gates="" Jun 11 14:28:12.955132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949294 2574 flags.go:64] FLAG: --file-check-frequency="20s" Jun 11 14:28:12.955132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949297 2574 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 11 14:28:12.955132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949300 2574 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 11 14:28:12.955132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949303 2574 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 11 14:28:12.955132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949306 2574 flags.go:64] FLAG: --healthz-port="10248" Jun 11 14:28:12.955132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949309 2574 flags.go:64] FLAG: --help="false" Jun 11 14:28:12.955132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949312 2574 flags.go:64] FLAG: --hostname-override="ip-10-0-135-108.ec2.internal" Jun 11 14:28:12.955132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949315 2574 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 11 14:28:12.955132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949318 2574 flags.go:64] FLAG: --http-check-frequency="20s" Jun 11 14:28:12.955132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949321 2574 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 11 14:28:12.955132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949324 2574 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 11 14:28:12.955132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949328 2574 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 11 14:28:12.955132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949331 2574 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 11 14:28:12.955132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949333 2574 flags.go:64] FLAG: --image-service-endpoint="" Jun 11 14:28:12.955798 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949336 2574 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 11 14:28:12.955798 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949339 2574 flags.go:64] FLAG: --kube-api-burst="100" Jun 11 14:28:12.955798 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949343 2574 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 11 14:28:12.955798 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949347 2574 flags.go:64] FLAG: --kube-api-qps="50" Jun 11 14:28:12.955798 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949350 2574 flags.go:64] FLAG: --kube-reserved="" Jun 11 14:28:12.955798 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949353 2574 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 11 14:28:12.955798 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949370 2574 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 11 14:28:12.955798 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949374 2574 flags.go:64] FLAG: --kubelet-cgroups="" Jun 11 14:28:12.955798 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949377 2574 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 11 14:28:12.955798 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949380 2574 flags.go:64] FLAG: --lock-file="" Jun 11 14:28:12.955798 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949382 2574 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 11 14:28:12.955798 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949385 2574 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 11 14:28:12.955798 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949388 2574 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 11 14:28:12.955798 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949394 2574 flags.go:64] FLAG: --log-json-split-stream="false" Jun 11 14:28:12.955798 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949397 2574 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 11 14:28:12.955798 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949399 2574 flags.go:64] FLAG: --log-text-split-stream="false" Jun 11 14:28:12.955798 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949402 2574 flags.go:64] FLAG: --logging-format="text" Jun 11 14:28:12.955798 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949405 2574 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 11 14:28:12.955798 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949409 2574 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 11 14:28:12.955798 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949411 2574 flags.go:64] FLAG: --manifest-url="" Jun 11 14:28:12.955798 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949414 2574 flags.go:64] FLAG: --manifest-url-header="" Jun 11 14:28:12.955798 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949419 2574 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 11 14:28:12.955798 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949422 2574 flags.go:64] FLAG: --max-open-files="1000000" Jun 11 14:28:12.955798 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949426 2574 flags.go:64] FLAG: --max-pods="110" Jun 11 14:28:12.955798 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949429 2574 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 11 14:28:12.956487 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949433 2574 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 11 14:28:12.956487 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949435 2574 flags.go:64] FLAG: --memory-manager-policy="None" Jun 11 14:28:12.956487 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949438 2574 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 11 14:28:12.956487 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949441 2574 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 11 14:28:12.956487 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949444 2574 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 11 14:28:12.956487 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949447 2574 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 11 14:28:12.956487 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949455 2574 flags.go:64] FLAG: --node-status-max-images="50" Jun 11 14:28:12.956487 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949458 2574 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 11 14:28:12.956487 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949461 2574 flags.go:64] FLAG: --oom-score-adj="-999" Jun 11 14:28:12.956487 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949465 2574 flags.go:64] FLAG: --pod-cidr="" Jun 11 14:28:12.956487 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949469 2574 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 11 14:28:12.956487 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949475 2574 flags.go:64] FLAG: --pod-manifest-path="" Jun 11 14:28:12.956487 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949478 2574 flags.go:64] FLAG: --pod-max-pids="-1" Jun 11 14:28:12.956487 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949481 2574 flags.go:64] FLAG: --pods-per-core="0" Jun 11 14:28:12.956487 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949484 2574 flags.go:64] FLAG: --port="10250" Jun 11 14:28:12.956487 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949487 2574 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 11 14:28:12.956487 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949490 2574 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-004d03b75fccfae88" Jun 11 14:28:12.956487 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949493 2574 flags.go:64] FLAG: --qos-reserved="" Jun 11 14:28:12.956487 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949496 2574 flags.go:64] FLAG: --read-only-port="10255" Jun 11 14:28:12.956487 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949499 2574 flags.go:64] FLAG: --register-node="true" Jun 11 14:28:12.956487 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949502 2574 flags.go:64] FLAG: --register-with-taints="" Jun 11 14:28:12.956487 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949506 2574 flags.go:64] FLAG: --registry-burst="10" Jun 11 14:28:12.956487 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949509 2574 flags.go:64] FLAG: --registry-qps="5" Jun 11 14:28:12.956487 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949512 2574 flags.go:64] FLAG: --reserved-cpus="" Jun 11 14:28:12.957132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949514 2574 flags.go:64] FLAG: --reserved-memory="" Jun 11 14:28:12.957132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949518 2574 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 11 14:28:12.957132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949521 2574 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 11 14:28:12.957132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949524 2574 flags.go:64] FLAG: --rotate-certificates="false" Jun 11 14:28:12.957132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949527 2574 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 11 14:28:12.957132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949530 2574 flags.go:64] FLAG: --runonce="false" Jun 11 14:28:12.957132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949532 2574 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 11 14:28:12.957132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949536 2574 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 11 14:28:12.957132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949539 2574 flags.go:64] FLAG: --seccomp-default="false" Jun 11 14:28:12.957132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949541 2574 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 11 14:28:12.957132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949544 2574 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 11 14:28:12.957132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949547 2574 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 11 14:28:12.957132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949550 2574 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 11 14:28:12.957132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949553 2574 flags.go:64] FLAG: --storage-driver-password="root" Jun 11 14:28:12.957132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949556 2574 flags.go:64] FLAG: --storage-driver-secure="false" Jun 11 14:28:12.957132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949559 2574 flags.go:64] FLAG: --storage-driver-table="stats" Jun 11 14:28:12.957132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949561 2574 flags.go:64] FLAG: --storage-driver-user="root" Jun 11 14:28:12.957132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949564 2574 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 11 14:28:12.957132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949568 2574 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 11 14:28:12.957132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949571 2574 flags.go:64] FLAG: --system-cgroups="" Jun 11 14:28:12.957132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949574 2574 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 11 14:28:12.957132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949579 2574 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 11 14:28:12.957132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949582 2574 flags.go:64] FLAG: --tls-cert-file="" Jun 11 14:28:12.957132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949585 2574 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 11 14:28:12.957132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949590 2574 flags.go:64] FLAG: --tls-min-version="" Jun 11 14:28:12.957769 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949592 2574 flags.go:64] FLAG: --tls-private-key-file="" Jun 11 14:28:12.957769 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949595 2574 flags.go:64] FLAG: --topology-manager-policy="none" Jun 11 14:28:12.957769 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949598 2574 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 11 14:28:12.957769 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949601 2574 flags.go:64] FLAG: --topology-manager-scope="container" Jun 11 14:28:12.957769 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949604 2574 flags.go:64] FLAG: --v="2" Jun 11 14:28:12.957769 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949608 2574 flags.go:64] FLAG: --version="false" Jun 11 14:28:12.957769 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949612 2574 flags.go:64] FLAG: --vmodule="" Jun 11 14:28:12.957769 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949615 2574 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 11 14:28:12.957769 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.949619 2574 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 11 14:28:12.957769 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949759 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:28:12.957769 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949763 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:28:12.957769 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949767 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:28:12.957769 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949769 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:28:12.957769 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949772 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:28:12.957769 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949775 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:28:12.957769 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949777 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:28:12.957769 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949780 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:28:12.957769 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949783 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:28:12.957769 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949785 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:28:12.957769 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949788 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:28:12.957769 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949791 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:28:12.958303 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949793 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:28:12.958303 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949796 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:28:12.958303 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949799 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:28:12.958303 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949803 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:28:12.958303 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949807 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:28:12.958303 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949810 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:28:12.958303 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949812 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:28:12.958303 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949815 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:28:12.958303 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949818 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:28:12.958303 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949821 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:28:12.958303 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949826 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:28:12.958303 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949829 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:28:12.958303 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949832 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:28:12.958303 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949834 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:28:12.958303 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949837 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:28:12.958303 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949839 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:28:12.958303 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949841 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:28:12.958303 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949844 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:28:12.958303 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949846 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:28:12.958819 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949849 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:28:12.958819 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949852 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:28:12.958819 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949854 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:28:12.958819 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949857 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:28:12.958819 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949859 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:28:12.958819 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949862 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:28:12.958819 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949865 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:28:12.958819 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949867 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:28:12.958819 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949870 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:28:12.958819 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949872 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:28:12.958819 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949875 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:28:12.958819 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949877 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:28:12.958819 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949881 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:28:12.958819 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949885 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:28:12.958819 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949888 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:28:12.958819 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949891 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:28:12.958819 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949895 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:28:12.958819 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949899 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:28:12.958819 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949902 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:28:12.958819 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949905 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:28:12.959330 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949907 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:28:12.959330 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949910 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:28:12.959330 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949912 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:28:12.959330 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949915 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:28:12.959330 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949918 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:28:12.959330 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949921 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:28:12.959330 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949924 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:28:12.959330 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949926 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:28:12.959330 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949929 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:28:12.959330 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949931 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:28:12.959330 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949934 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:28:12.959330 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949936 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:28:12.959330 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949939 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:28:12.959330 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949941 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:28:12.959330 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949944 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:28:12.959330 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949946 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:28:12.959330 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949949 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:28:12.959330 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949952 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:28:12.959330 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949954 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:28:12.959330 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949956 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:28:12.959858 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949959 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:28:12.959858 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949962 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:28:12.959858 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949964 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:28:12.959858 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949967 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:28:12.959858 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949970 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:28:12.959858 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949972 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:28:12.959858 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949975 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:28:12.959858 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949977 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:28:12.959858 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949981 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:28:12.959858 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949985 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:28:12.959858 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949989 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:28:12.959858 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949992 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:28:12.959858 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949995 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:28:12.959858 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.949998 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:28:12.959858 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.950001 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:28:12.959858 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.950004 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:28:12.959858 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.950007 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:28:12.959858 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.950010 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:28:12.959858 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.950013 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:28:12.959858 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.950016 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:28:12.960380 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.950018 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:28:12.960380 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.950020 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:28:12.960380 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.950024 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:28:12.960380 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.950027 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:28:12.960380 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.950030 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:28:12.960380 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.950032 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:28:12.960380 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.950035 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:28:12.960380 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.950037 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:28:12.960380 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.950724 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 14:28:12.960380 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.958132 2574 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 11 14:28:12.960380 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.958150 2574 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 11 14:28:12.960380 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.958916 2574 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 11 14:28:12.960380 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.958924 2574 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 11 14:28:12.960380 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.958984 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:28:12.960759 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.958989 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:28:12.960759 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.958993 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:28:12.960759 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.958996 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:28:12.960759 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.958998 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:28:12.960759 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959001 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:28:12.960759 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959004 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:28:12.960759 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959007 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:28:12.960759 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959010 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:28:12.960759 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959013 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:28:12.960759 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959015 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:28:12.960759 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959018 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:28:12.960759 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959020 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:28:12.960759 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959023 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:28:12.960759 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959026 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:28:12.960759 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959028 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:28:12.960759 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959031 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:28:12.960759 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959033 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:28:12.960759 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959036 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:28:12.960759 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959038 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:28:12.960759 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959041 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:28:12.961265 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959043 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:28:12.961265 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959046 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:28:12.961265 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959048 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:28:12.961265 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959051 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:28:12.961265 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959053 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:28:12.961265 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959056 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:28:12.961265 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959059 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:28:12.961265 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959061 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:28:12.961265 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959066 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:28:12.961265 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959068 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:28:12.961265 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959071 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:28:12.961265 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959074 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:28:12.961265 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959077 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:28:12.961265 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959079 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:28:12.961265 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959082 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:28:12.961265 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959084 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:28:12.961265 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959086 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:28:12.961265 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959089 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:28:12.961265 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959092 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:28:12.961265 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959094 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:28:12.961787 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959097 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:28:12.961787 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959099 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:28:12.961787 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959102 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:28:12.961787 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959104 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:28:12.961787 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959107 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:28:12.961787 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959110 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:28:12.961787 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959112 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:28:12.961787 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959115 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:28:12.961787 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959117 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:28:12.961787 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959120 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:28:12.961787 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959122 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:28:12.961787 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959125 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:28:12.961787 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959128 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:28:12.961787 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959130 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:28:12.961787 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959133 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:28:12.961787 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959135 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:28:12.961787 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959138 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:28:12.961787 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959140 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:28:12.961787 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959143 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:28:12.961787 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959145 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:28:12.962293 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959148 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:28:12.962293 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959153 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:28:12.962293 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959157 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:28:12.962293 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959160 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:28:12.962293 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959163 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:28:12.962293 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959166 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:28:12.962293 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959170 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:28:12.962293 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959174 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:28:12.962293 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959178 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:28:12.962293 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959181 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:28:12.962293 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959184 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:28:12.962293 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959187 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:28:12.962293 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959190 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:28:12.962293 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959193 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:28:12.962293 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959196 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:28:12.962293 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959199 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:28:12.962293 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959201 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:28:12.962293 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959204 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:28:12.962293 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959207 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:28:12.962845 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959209 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:28:12.962845 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959212 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:28:12.962845 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959215 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:28:12.962845 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959217 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:28:12.962845 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959220 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:28:12.962845 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959223 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:28:12.962845 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959225 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:28:12.962845 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959228 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:28:12.962845 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959230 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:28:12.962845 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959233 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:28:12.962845 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959236 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:28:12.962845 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959238 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:28:12.962845 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959241 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:28:12.962845 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959245 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:28:12.962845 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959247 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:28:12.962845 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959250 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:28:12.962845 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959253 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:28:12.962845 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959256 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:28:12.962845 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959258 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:28:12.963343 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.959263 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 14:28:12.963343 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959404 2574 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 11 14:28:12.963343 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959409 2574 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 11 14:28:12.963343 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959412 2574 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 11 14:28:12.963343 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959415 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 11 14:28:12.963343 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959418 2574 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 11 14:28:12.963343 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959421 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 11 14:28:12.963343 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959423 2574 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 11 14:28:12.963343 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959426 2574 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 11 14:28:12.963343 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959429 2574 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 11 14:28:12.963343 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959431 2574 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 11 14:28:12.963343 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959434 2574 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 11 14:28:12.963343 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959436 2574 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 11 14:28:12.963343 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959439 2574 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 11 14:28:12.963343 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959441 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 11 14:28:12.963827 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959444 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 11 14:28:12.963827 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959446 2574 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 11 14:28:12.963827 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959449 2574 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 11 14:28:12.963827 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959452 2574 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 11 14:28:12.963827 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959454 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 11 14:28:12.963827 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959457 2574 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 11 14:28:12.963827 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959459 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 11 14:28:12.963827 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959462 2574 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 11 14:28:12.963827 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959465 2574 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 11 14:28:12.963827 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959468 2574 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 11 14:28:12.963827 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959471 2574 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 11 14:28:12.963827 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959473 2574 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 11 14:28:12.963827 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959476 2574 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 11 14:28:12.963827 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959478 2574 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 11 14:28:12.963827 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959482 2574 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 11 14:28:12.963827 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959484 2574 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 11 14:28:12.963827 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959487 2574 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 11 14:28:12.963827 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959489 2574 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 11 14:28:12.963827 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959492 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 11 14:28:12.963827 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959495 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 11 14:28:12.964334 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959497 2574 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 11 14:28:12.964334 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959500 2574 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 11 14:28:12.964334 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959503 2574 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 11 14:28:12.964334 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959507 2574 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 11 14:28:12.964334 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959510 2574 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 11 14:28:12.964334 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959512 2574 feature_gate.go:328] unrecognized feature gate: Example2 Jun 11 14:28:12.964334 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959515 2574 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 11 14:28:12.964334 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959518 2574 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 11 14:28:12.964334 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959521 2574 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 11 14:28:12.964334 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959523 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 11 14:28:12.964334 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959526 2574 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 11 14:28:12.964334 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959528 2574 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 11 14:28:12.964334 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959530 2574 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 11 14:28:12.964334 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959535 2574 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 11 14:28:12.964334 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959538 2574 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 11 14:28:12.964334 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959541 2574 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 11 14:28:12.964334 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959544 2574 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 11 14:28:12.964334 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959547 2574 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 11 14:28:12.964334 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959549 2574 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 11 14:28:12.964824 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959552 2574 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 11 14:28:12.964824 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959556 2574 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 11 14:28:12.964824 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959559 2574 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 11 14:28:12.964824 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959562 2574 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 11 14:28:12.964824 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959565 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 11 14:28:12.964824 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959568 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 11 14:28:12.964824 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959571 2574 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 11 14:28:12.964824 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959573 2574 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 11 14:28:12.964824 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959576 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 11 14:28:12.964824 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959578 2574 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 11 14:28:12.964824 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959581 2574 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 11 14:28:12.964824 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959584 2574 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 11 14:28:12.964824 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959586 2574 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 11 14:28:12.964824 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959589 2574 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 11 14:28:12.964824 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959592 2574 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 11 14:28:12.964824 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959594 2574 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 11 14:28:12.964824 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959596 2574 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 11 14:28:12.964824 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959599 2574 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 11 14:28:12.964824 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959602 2574 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 11 14:28:12.965293 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959604 2574 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 11 14:28:12.965293 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959607 2574 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 11 14:28:12.965293 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959609 2574 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 11 14:28:12.965293 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959612 2574 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 11 14:28:12.965293 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959614 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 11 14:28:12.965293 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959617 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 11 14:28:12.965293 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959619 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 11 14:28:12.965293 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959622 2574 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 11 14:28:12.965293 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959624 2574 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 11 14:28:12.965293 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959627 2574 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 11 14:28:12.965293 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959629 2574 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 11 14:28:12.965293 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959632 2574 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 11 14:28:12.965293 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959634 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 11 14:28:12.965293 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959637 2574 feature_gate.go:328] unrecognized feature gate: Example Jun 11 14:28:12.965293 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959639 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 11 14:28:12.965293 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959642 2574 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 11 14:28:12.965293 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959644 2574 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 11 14:28:12.965293 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959647 2574 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 11 14:28:12.965293 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959649 2574 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 11 14:28:12.965293 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959652 2574 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 11 14:28:12.965823 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959654 2574 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 11 14:28:12.965823 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959657 2574 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 11 14:28:12.965823 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959661 2574 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 11 14:28:12.965823 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959663 2574 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 11 14:28:12.965823 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959666 2574 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 11 14:28:12.965823 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959668 2574 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 11 14:28:12.965823 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:12.959671 2574 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 11 14:28:12.965823 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.959676 2574 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 11 14:28:12.965823 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.959796 2574 server.go:962] "Client rotation is on, will bootstrap in background" Jun 11 14:28:12.965823 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.962797 2574 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 11 14:28:12.965823 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.964118 2574 server.go:1019] "Starting client certificate rotation" Jun 11 14:28:12.965823 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.964220 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 14:28:12.965823 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.964851 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 11 14:28:12.966711 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.966696 2574 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 14:28:12.975671 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.969908 2574 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 11 14:28:12.980478 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.980458 2574 log.go:25] "Validated CRI v1 runtime API" Jun 11 14:28:12.983451 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.983432 2574 log.go:25] "Validated CRI v1 image API" Jun 11 14:28:12.984372 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.984347 2574 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 11 14:28:12.988880 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.988855 2574 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 88fa563a-27d9-45a0-afd9-5dc231c1ff93:/dev/nvme0n1p4 cb4f8e81-c113-4e50-9f55-9851b653b1f1:/dev/nvme0n1p3] Jun 11 14:28:12.988961 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.988879 2574 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 11 14:28:12.993452 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.993314 2574 manager.go:216] Machine: {Timestamp:2026-06-11 14:28:12.992797564 +0000 UTC m=+0.325375057 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3112279 MemoryCapacity:32812171264 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23bc7f38312e8aab4076a07f06193a SystemUUID:ec23bc7f-3831-2e8a-ab40-76a07f06193a BootID:5c142565-9409-48de-b2b9-50f771859aee Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f8:ff:8d:42:b7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f8:ff:8d:42:b7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a6:c9:86:a8:00:e9 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812171264 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 11 14:28:12.993452 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.993447 2574 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 11 14:28:12.993580 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.993573 2574 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 11 14:28:12.996586 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.996557 2574 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 11 14:28:12.996757 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.996590 2574 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-135-108.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 11 14:28:12.997298 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.997286 2574 topology_manager.go:138] "Creating topology manager with none policy" Jun 11 14:28:12.997351 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.997306 2574 container_manager_linux.go:309] "Creating device plugin manager" Jun 11 14:28:12.997351 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.997316 2574 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 14:28:12.998032 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.998020 2574 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 11 14:28:12.999749 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:12.999734 2574 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 11 14:28:13.001589 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.001571 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 14:28:13.003047 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.003033 2574 state_mem.go:36] "Initialized new in-memory state store" Jun 11 14:28:13.003198 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.003186 2574 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 11 14:28:13.003267 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.003226 2574 kubelet.go:486] "Attempting to sync node with API server" Jun 11 14:28:13.003267 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.003242 2574 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 11 14:28:13.003267 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.003263 2574 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 11 14:28:13.003422 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.003280 2574 kubelet.go:398] "Adding apiserver pod source" Jun 11 14:28:13.003422 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.003293 2574 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 11 14:28:13.003825 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.003809 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 14:28:13.003898 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.003834 2574 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 11 14:28:13.006443 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.006429 2574 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 11 14:28:13.013818 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.013803 2574 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 11 14:28:13.013891 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.013833 2574 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 11 14:28:13.015663 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.015648 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 11 14:28:13.015663 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.015667 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 11 14:28:13.015760 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.015673 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 11 14:28:13.015760 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.015679 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 11 14:28:13.015760 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.015689 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 11 14:28:13.015760 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.015695 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 11 14:28:13.015760 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.015704 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 11 14:28:13.015760 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.015709 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 11 14:28:13.015760 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.015715 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 11 14:28:13.015760 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.015722 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 11 14:28:13.015760 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.015737 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 11 14:28:13.015760 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.015742 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 11 14:28:13.016562 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.016548 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 11 14:28:13.016562 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.016559 2574 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 11 14:28:13.019852 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.019834 2574 server.go:1268] "Started kubelet" Jun 11 14:28:13.019986 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.019954 2574 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 11 14:28:13.020457 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.020426 2574 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 11 14:28:13.020542 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.020478 2574 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 11 14:28:13.021018 ip-10-0-135-108 systemd[1]: Started Kubernetes Kubelet. Jun 11 14:28:13.021603 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:13.021162 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-135-108.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 11 14:28:13.021603 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:13.021176 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 14:28:13.021603 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.021305 2574 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-135-108.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 11 14:28:13.022485 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.022474 2574 server.go:310] "Adding debug handlers to kubelet server" Jun 11 14:28:13.025779 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.025007 2574 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 11 14:28:13.029514 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:13.029487 2574 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 11 14:28:13.029709 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:13.028747 2574 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-135-108.ec2.internal.18b80d222a99bc78 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-135-108.ec2.internal,UID:ip-10-0-135-108.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-135-108.ec2.internal,},FirstTimestamp:2026-06-11 14:28:13.019798648 +0000 UTC m=+0.352376113,LastTimestamp:2026-06-11 14:28:13.019798648 +0000 UTC m=+0.352376113,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-135-108.ec2.internal,}" Jun 11 14:28:13.031338 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.031322 2574 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 11 14:28:13.031509 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:13.031447 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-108.ec2.internal\" not found" Jun 11 14:28:13.031659 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.031628 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7rfcn" Jun 11 14:28:13.032078 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.032064 2574 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 11 14:28:13.032220 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.032081 2574 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 11 14:28:13.032534 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.032522 2574 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 11 14:28:13.032692 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.032542 2574 factory.go:55] Registering systemd factory Jun 11 14:28:13.032767 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.032754 2574 factory.go:223] Registration of the systemd container factory successfully Jun 11 14:28:13.032767 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.032706 2574 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 11 14:28:13.032865 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.032795 2574 reconstruct.go:97] "Volume reconstruction finished" Jun 11 14:28:13.032865 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.032806 2574 reconciler.go:29] "Reconciler: start to sync state" Jun 11 14:28:13.033211 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.033195 2574 factory.go:153] Registering CRI-O factory Jun 11 14:28:13.033279 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.033214 2574 factory.go:223] Registration of the crio container factory successfully Jun 11 14:28:13.033318 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.033308 2574 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 11 14:28:13.033373 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.033347 2574 factory.go:103] Registering Raw factory Jun 11 14:28:13.033373 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.033360 2574 manager.go:1196] Started watching for new ooms in manager Jun 11 14:28:13.033460 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:13.033375 2574 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-135-108.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 11 14:28:13.033460 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:13.033415 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 11 14:28:13.033802 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.033789 2574 manager.go:349] Starting recovery of all containers Jun 11 14:28:13.040153 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.040134 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7rfcn" Jun 11 14:28:13.043116 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.043100 2574 manager.go:354] Recovery completed Jun 11 14:28:13.047281 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.047263 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:28:13.049310 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.049290 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-108.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:28:13.049420 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.049323 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-108.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:28:13.049420 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.049347 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-108.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:28:13.049886 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.049872 2574 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 11 14:28:13.049963 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.049886 2574 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 11 14:28:13.049963 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.049896 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:28:13.049963 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.049907 2574 state_mem.go:36] "Initialized new in-memory state store" Jun 11 14:28:13.050654 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.050636 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-108.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:28:13.050735 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.050666 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-108.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:28:13.050735 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.050679 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-108.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:28:13.050979 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.050965 2574 policy_none.go:49] "None policy: Start" Jun 11 14:28:13.051029 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.050983 2574 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 11 14:28:13.051029 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.050994 2574 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 11 14:28:13.051918 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.051907 2574 policy_none.go:47] "Start" Jun 11 14:28:13.094964 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.094947 2574 manager.go:337] "Starting Device Plugin manager" Jun 11 14:28:13.103788 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:13.095062 2574 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 11 14:28:13.103788 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.095077 2574 server.go:87] "Starting device plugin registration server" Jun 11 14:28:13.103788 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.095344 2574 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 11 14:28:13.103788 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.095358 2574 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 11 14:28:13.103788 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.095457 2574 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 11 14:28:13.103788 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.095534 2574 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 11 14:28:13.103788 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.095543 2574 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 11 14:28:13.103788 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:13.096198 2574 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 11 14:28:13.103788 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:13.096244 2574 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-135-108.ec2.internal\" not found" Jun 11 14:28:13.105019 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.104996 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 11 14:28:13.106320 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.106299 2574 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 11 14:28:13.106441 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.106348 2574 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 11 14:28:13.106441 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.106369 2574 kubelet.go:2448] "Starting kubelet main sync loop" Jun 11 14:28:13.106441 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:13.106399 2574 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 11 14:28:13.108759 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.108739 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:28:13.196273 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.196195 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:28:13.197203 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.197179 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-108.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:28:13.197301 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.197219 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-108.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:28:13.197301 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.197229 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-108.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:28:13.197301 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.197252 2574 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-135-108.ec2.internal" Jun 11 14:28:13.204311 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.204293 2574 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-135-108.ec2.internal" Jun 11 14:28:13.204379 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:13.204319 2574 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-135-108.ec2.internal\": node \"ip-10-0-135-108.ec2.internal\" not found" Jun 11 14:28:13.207433 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.207415 2574 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-108.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-135-108.ec2.internal"] Jun 11 14:28:13.207485 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.207476 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:28:13.208299 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.208283 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-108.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:28:13.208361 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.208315 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-108.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:28:13.208361 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.208347 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-108.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:28:13.209524 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.209510 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:28:13.209691 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.209674 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-108.ec2.internal" Jun 11 14:28:13.209742 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.209712 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:28:13.210234 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.210209 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-108.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:28:13.210234 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.210235 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-108.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:28:13.210362 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.210244 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-108.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:28:13.210362 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.210271 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-108.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:28:13.210362 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.210298 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-108.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:28:13.210362 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.210313 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-108.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:28:13.211475 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.211459 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-108.ec2.internal" Jun 11 14:28:13.211537 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.211488 2574 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 11 14:28:13.212207 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.212192 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-108.ec2.internal" event="NodeHasSufficientMemory" Jun 11 14:28:13.212278 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.212217 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-108.ec2.internal" event="NodeHasNoDiskPressure" Jun 11 14:28:13.212278 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.212233 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-108.ec2.internal" event="NodeHasSufficientPID" Jun 11 14:28:13.233142 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.233103 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c0941fa4b66ece37ffb65738f439974f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-108.ec2.internal\" (UID: \"c0941fa4b66ece37ffb65738f439974f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-108.ec2.internal" Jun 11 14:28:13.233142 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.233141 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c0941fa4b66ece37ffb65738f439974f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-108.ec2.internal\" (UID: \"c0941fa4b66ece37ffb65738f439974f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-108.ec2.internal" Jun 11 14:28:13.233290 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.233156 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b858571848d1c6292ca0714814a05d2-config\") pod \"kube-apiserver-proxy-ip-10-0-135-108.ec2.internal\" (UID: \"8b858571848d1c6292ca0714814a05d2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-108.ec2.internal" Jun 11 14:28:13.234187 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:13.234172 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-108.ec2.internal\" not found" Jun 11 14:28:13.248120 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:13.248101 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-108.ec2.internal\" not found" node="ip-10-0-135-108.ec2.internal" Jun 11 14:28:13.252504 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:13.252488 2574 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-135-108.ec2.internal\" not found" node="ip-10-0-135-108.ec2.internal" Jun 11 14:28:13.333694 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.333665 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c0941fa4b66ece37ffb65738f439974f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-108.ec2.internal\" (UID: \"c0941fa4b66ece37ffb65738f439974f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-108.ec2.internal" Jun 11 14:28:13.333848 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.333695 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/c0941fa4b66ece37ffb65738f439974f-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-135-108.ec2.internal\" (UID: \"c0941fa4b66ece37ffb65738f439974f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-108.ec2.internal" Jun 11 14:28:13.333848 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.333740 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c0941fa4b66ece37ffb65738f439974f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-108.ec2.internal\" (UID: \"c0941fa4b66ece37ffb65738f439974f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-108.ec2.internal" Jun 11 14:28:13.333848 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.333757 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b858571848d1c6292ca0714814a05d2-config\") pod \"kube-apiserver-proxy-ip-10-0-135-108.ec2.internal\" (UID: \"8b858571848d1c6292ca0714814a05d2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-108.ec2.internal" Jun 11 14:28:13.333848 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.333789 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/8b858571848d1c6292ca0714814a05d2-config\") pod \"kube-apiserver-proxy-ip-10-0-135-108.ec2.internal\" (UID: \"8b858571848d1c6292ca0714814a05d2\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-135-108.ec2.internal" Jun 11 14:28:13.333848 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.333813 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c0941fa4b66ece37ffb65738f439974f-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-135-108.ec2.internal\" (UID: \"c0941fa4b66ece37ffb65738f439974f\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-108.ec2.internal" Jun 11 14:28:13.334679 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:13.334658 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-108.ec2.internal\" not found" Jun 11 14:28:13.435251 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:13.435210 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-108.ec2.internal\" not found" Jun 11 14:28:13.536031 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:13.535962 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-108.ec2.internal\" not found" Jun 11 14:28:13.553175 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.553128 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-108.ec2.internal" Jun 11 14:28:13.557909 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.557894 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-108.ec2.internal" Jun 11 14:28:13.636164 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:13.636129 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-108.ec2.internal\" not found" Jun 11 14:28:13.736579 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:13.736543 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-108.ec2.internal\" not found" Jun 11 14:28:13.837167 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:13.837096 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-108.ec2.internal\" not found" Jun 11 14:28:13.937618 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:13.937585 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-108.ec2.internal\" not found" Jun 11 14:28:13.964073 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.964049 2574 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 11 14:28:13.964817 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:13.964163 2574 request.go:1196] "Unexpected error when reading response body" err="read tcp 10.0.135.108:41610->3.215.3.120:6443: use of closed network connection" Jun 11 14:28:13.964817 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:13.964202 2574 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 11 14:28:13.964817 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:13.964244 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: unexpected error when reading response body. Please retry. Original error: read tcp 10.0.135.108:41610->3.215.3.120:6443: use of closed network connection" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 11 14:28:14.018382 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:14.018318 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0941fa4b66ece37ffb65738f439974f.slice/crio-b06b8fcdf8b24f96786d36e118a83e088213532b646c02ccc0cbf069d1e7d5f4 WatchSource:0}: Error finding container b06b8fcdf8b24f96786d36e118a83e088213532b646c02ccc0cbf069d1e7d5f4: Status 404 returned error can't find the container with id b06b8fcdf8b24f96786d36e118a83e088213532b646c02ccc0cbf069d1e7d5f4 Jun 11 14:28:14.018590 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:14.018566 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b858571848d1c6292ca0714814a05d2.slice/crio-5114606908e7fa7557df8e62e3045a6ff2d76f2f8d69230b39069b8ee4f3beeb WatchSource:0}: Error finding container 5114606908e7fa7557df8e62e3045a6ff2d76f2f8d69230b39069b8ee4f3beeb: Status 404 returned error can't find the container with id 5114606908e7fa7557df8e62e3045a6ff2d76f2f8d69230b39069b8ee4f3beeb Jun 11 14:28:14.023588 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:14.023573 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 14:28:14.037882 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:14.037862 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-108.ec2.internal\" not found" Jun 11 14:28:14.043783 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:14.043752 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-10 14:23:13 +0000 UTC" deadline="2028-02-10 09:22:29.128602595 +0000 UTC" Jun 11 14:28:14.043783 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:14.043781 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14610h54m15.084825661s" Jun 11 14:28:14.110461 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:14.110345 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-108.ec2.internal" event={"ID":"c0941fa4b66ece37ffb65738f439974f","Type":"ContainerStarted","Data":"b06b8fcdf8b24f96786d36e118a83e088213532b646c02ccc0cbf069d1e7d5f4"} Jun 11 14:28:14.111288 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:14.111267 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-108.ec2.internal" event={"ID":"8b858571848d1c6292ca0714814a05d2","Type":"ContainerStarted","Data":"5114606908e7fa7557df8e62e3045a6ff2d76f2f8d69230b39069b8ee4f3beeb"} Jun 11 14:28:14.138702 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:14.138673 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-108.ec2.internal\" not found" Jun 11 14:28:14.239265 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:14.239226 2574 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-135-108.ec2.internal\" not found" Jun 11 14:28:14.324470 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:14.324438 2574 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:28:14.332230 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:14.332204 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-108.ec2.internal" Jun 11 14:28:14.352920 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:14.352892 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 14:28:14.354900 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:14.354868 2574 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-108.ec2.internal" Jun 11 14:28:14.373186 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:14.373119 2574 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 11 14:28:14.604922 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:14.604892 2574 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:28:15.004820 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.004783 2574 apiserver.go:52] "Watching apiserver" Jun 11 14:28:15.014507 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.014479 2574 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 11 14:28:15.015680 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.015656 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-2vwxx","openshift-multus/multus-f4zh2","openshift-multus/network-metrics-daemon-2wxd2","openshift-network-diagnostics/network-check-target-9t6ww","kube-system/global-pull-secret-syncer-fddhk","kube-system/konnectivity-agent-trm4l","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-108.ec2.internal","openshift-multus/multus-additional-cni-plugins-ng4b5","openshift-network-operator/iptables-alerter-wsq5b","openshift-ovn-kubernetes/ovnkube-node-qld5j","kube-system/kube-apiserver-proxy-ip-10-0-135-108.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s82wr","openshift-cluster-node-tuning-operator/tuned-vnh2f","openshift-dns/node-resolver-nw644"] Jun 11 14:28:15.017416 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.017394 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.018699 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.018671 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.019761 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.019743 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wxd2" Jun 11 14:28:15.019849 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:15.019825 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wxd2" podUID="ab181ce2-5bb7-4882-8c14-6409a830fb89" Jun 11 14:28:15.021121 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.021102 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9t6ww" Jun 11 14:28:15.021225 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:15.021161 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9t6ww" podUID="aad14df7-79a7-45f8-a84f-5399cf2b54b5" Jun 11 14:28:15.022402 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.022381 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fddhk" Jun 11 14:28:15.022500 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:15.022447 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fddhk" podUID="9286b965-a177-4f5c-97b7-b239fb31c9bb" Jun 11 14:28:15.024021 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.023687 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-trm4l" Jun 11 14:28:15.028277 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.028016 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 11 14:28:15.028277 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.028213 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wsq5b" Jun 11 14:28:15.029853 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.029726 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 11 14:28:15.030063 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.030024 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 11 14:28:15.030159 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.030133 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-l2978\"" Jun 11 14:28:15.030421 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.030232 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 11 14:28:15.030421 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.030281 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 11 14:28:15.030567 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.030544 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 11 14:28:15.030567 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.030569 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 11 14:28:15.030784 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.030654 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-dtfct\"" Jun 11 14:28:15.030784 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.030661 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-2rhhp\"" Jun 11 14:28:15.030784 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.030677 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 11 14:28:15.030784 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.030691 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 11 14:28:15.030784 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.030678 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 11 14:28:15.031866 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.031846 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nw644" Jun 11 14:28:15.033505 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.033484 2574 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 11 14:28:15.033596 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.033496 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.035494 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.035164 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2vwxx" Jun 11 14:28:15.036749 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.036730 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ng4b5" Jun 11 14:28:15.038745 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.038727 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s82wr" Jun 11 14:28:15.039888 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.039867 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 11 14:28:15.039960 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.039934 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 11 14:28:15.040145 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.040101 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 11 14:28:15.040250 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.040182 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 11 14:28:15.040250 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.040210 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 11 14:28:15.040250 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.040210 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 11 14:28:15.040487 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.040252 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-mtlm7\"" Jun 11 14:28:15.040487 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.040341 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 11 14:28:15.041109 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.041090 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-5nn9b\"" Jun 11 14:28:15.041193 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.041116 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 11 14:28:15.041193 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.041156 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 11 14:28:15.041193 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.041162 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 11 14:28:15.041361 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.041216 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-shlwm\"" Jun 11 14:28:15.041361 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.041296 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-8ngxp\"" Jun 11 14:28:15.041510 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.041492 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 11 14:28:15.041606 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.041535 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 11 14:28:15.041667 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.041607 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 11 14:28:15.041667 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.041606 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7pjgr\"" Jun 11 14:28:15.042634 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.042612 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-multus-cni-dir\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.042741 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.042644 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-hostroot\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.042741 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.042670 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-etc-kubernetes\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.042741 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.042696 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9286b965-a177-4f5c-97b7-b239fb31c9bb-original-pull-secret\") pod \"global-pull-secret-syncer-fddhk\" (UID: \"9286b965-a177-4f5c-97b7-b239fb31c9bb\") " pod="kube-system/global-pull-secret-syncer-fddhk" Jun 11 14:28:15.042741 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.042726 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-systemd-units\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.042935 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.042749 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-host-run-netns\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.042935 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.042771 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnxqc\" (UniqueName: \"kubernetes.io/projected/4586b811-c0d9-48ae-a089-7416a9309720-kube-api-access-dnxqc\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.042935 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.042811 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/40408934-44bd-4c56-9c0c-13296258e82b-lib-modules\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.042935 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.042837 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab181ce2-5bb7-4882-8c14-6409a830fb89-metrics-certs\") pod \"network-metrics-daemon-2wxd2\" (UID: \"ab181ce2-5bb7-4882-8c14-6409a830fb89\") " pod="openshift-multus/network-metrics-daemon-2wxd2" Jun 11 14:28:15.042935 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.042860 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fc6cedcf-ee56-4afc-a1c3-c702501ccd08-host-slash\") pod \"iptables-alerter-wsq5b\" (UID: \"fc6cedcf-ee56-4afc-a1c3-c702501ccd08\") " pod="openshift-network-operator/iptables-alerter-wsq5b" Jun 11 14:28:15.042935 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.042897 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/81420dd7-ea56-423e-af93-80009c14c162-agent-certs\") pod \"konnectivity-agent-trm4l\" (UID: \"81420dd7-ea56-423e-af93-80009c14c162\") " pod="kube-system/konnectivity-agent-trm4l" Jun 11 14:28:15.043160 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.042944 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4nm2d\" (UniqueName: \"kubernetes.io/projected/40408934-44bd-4c56-9c0c-13296258e82b-kube-api-access-4nm2d\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.043160 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.042971 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e2e1c881-454a-4129-b1c4-82db9c5f65ed-hosts-file\") pod \"node-resolver-nw644\" (UID: \"e2e1c881-454a-4129-b1c4-82db9c5f65ed\") " pod="openshift-dns/node-resolver-nw644" Jun 11 14:28:15.043160 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.043001 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.043160 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.043017 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-ovn-node-metrics-cert\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.043160 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.043062 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-host-run-ovn-kubernetes\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.043160 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.043094 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4586b811-c0d9-48ae-a089-7416a9309720-cni-binary-copy\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.043160 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.043139 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/40408934-44bd-4c56-9c0c-13296258e82b-etc-modprobe-d\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.043523 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.043170 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/40408934-44bd-4c56-9c0c-13296258e82b-sys\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.043523 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.043188 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2e1c881-454a-4129-b1c4-82db9c5f65ed-tmp-dir\") pod \"node-resolver-nw644\" (UID: \"e2e1c881-454a-4129-b1c4-82db9c5f65ed\") " pod="openshift-dns/node-resolver-nw644" Jun 11 14:28:15.043523 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.043208 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8mfv\" (UniqueName: \"kubernetes.io/projected/aad14df7-79a7-45f8-a84f-5399cf2b54b5-kube-api-access-x8mfv\") pod \"network-check-target-9t6ww\" (UID: \"aad14df7-79a7-45f8-a84f-5399cf2b54b5\") " pod="openshift-network-diagnostics/network-check-target-9t6ww" Jun 11 14:28:15.043523 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.043228 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmb8h\" (UniqueName: \"kubernetes.io/projected/fc6cedcf-ee56-4afc-a1c3-c702501ccd08-kube-api-access-hmb8h\") pod \"iptables-alerter-wsq5b\" (UID: \"fc6cedcf-ee56-4afc-a1c3-c702501ccd08\") " pod="openshift-network-operator/iptables-alerter-wsq5b" Jun 11 14:28:15.043523 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.043266 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-etc-openvswitch\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.043523 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.043306 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-os-release\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.043523 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.043376 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4586b811-c0d9-48ae-a089-7416a9309720-multus-daemon-config\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.043523 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.043403 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/40408934-44bd-4c56-9c0c-13296258e82b-etc-tuned\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.043523 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.043436 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40408934-44bd-4c56-9c0c-13296258e82b-tmp\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.043523 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.043481 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-run-openvswitch\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.043523 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.043515 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-host-run-multus-certs\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.044001 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.043552 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fc6cedcf-ee56-4afc-a1c3-c702501ccd08-iptables-alerter-script\") pod \"iptables-alerter-wsq5b\" (UID: \"fc6cedcf-ee56-4afc-a1c3-c702501ccd08\") " pod="openshift-network-operator/iptables-alerter-wsq5b" Jun 11 14:28:15.044001 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.043577 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-cnibin\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.044001 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.043599 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-host-var-lib-cni-bin\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.044001 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.043614 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-host-var-lib-cni-multus\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.044001 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.043628 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/40408934-44bd-4c56-9c0c-13296258e82b-run\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.044001 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.043646 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/40408934-44bd-4c56-9c0c-13296258e82b-host\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.044001 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.043669 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-host-cni-bin\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.044001 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.043688 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-host-run-netns\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.044001 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.043702 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/81420dd7-ea56-423e-af93-80009c14c162-konnectivity-ca\") pod \"konnectivity-agent-trm4l\" (UID: \"81420dd7-ea56-423e-af93-80009c14c162\") " pod="kube-system/konnectivity-agent-trm4l" Jun 11 14:28:15.044001 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.043715 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/40408934-44bd-4c56-9c0c-13296258e82b-etc-sysctl-conf\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.044001 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.043757 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-var-lib-openvswitch\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.044001 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.043778 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40408934-44bd-4c56-9c0c-13296258e82b-etc-kubernetes\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.044001 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.043802 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/40408934-44bd-4c56-9c0c-13296258e82b-etc-sysctl-d\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.044001 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.043827 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-system-cni-dir\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.044001 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.043854 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-host-var-lib-kubelet\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.044001 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.043876 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sgzhj\" (UniqueName: \"kubernetes.io/projected/ab181ce2-5bb7-4882-8c14-6409a830fb89-kube-api-access-sgzhj\") pod \"network-metrics-daemon-2wxd2\" (UID: \"ab181ce2-5bb7-4882-8c14-6409a830fb89\") " pod="openshift-multus/network-metrics-daemon-2wxd2" Jun 11 14:28:15.044001 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.043904 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9286b965-a177-4f5c-97b7-b239fb31c9bb-dbus\") pod \"global-pull-secret-syncer-fddhk\" (UID: \"9286b965-a177-4f5c-97b7-b239fb31c9bb\") " pod="kube-system/global-pull-secret-syncer-fddhk" Jun 11 14:28:15.044783 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.043926 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-log-socket\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.044783 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.043946 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-multus-socket-dir-parent\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.044783 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.043969 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-multus-conf-dir\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.044783 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.044000 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 11 14:28:15.044783 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.044011 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/40408934-44bd-4c56-9c0c-13296258e82b-etc-sysconfig\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.044783 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.044033 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9286b965-a177-4f5c-97b7-b239fb31c9bb-kubelet-config\") pod \"global-pull-secret-syncer-fddhk\" (UID: \"9286b965-a177-4f5c-97b7-b239fb31c9bb\") " pod="kube-system/global-pull-secret-syncer-fddhk" Jun 11 14:28:15.044783 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.044056 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-run-ovn\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.044783 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.044084 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-host-cni-netd\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.044783 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.044107 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40408934-44bd-4c56-9c0c-13296258e82b-var-lib-kubelet\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.044783 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.044129 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-ovnkube-config\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.044783 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.044167 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-env-overrides\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.044783 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.044198 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-host-run-k8s-cni-cncf-io\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.044783 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.044232 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-run-systemd\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.044783 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.044257 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j42sg\" (UniqueName: \"kubernetes.io/projected/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-kube-api-access-j42sg\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.044783 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.044281 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/40408934-44bd-4c56-9c0c-13296258e82b-etc-systemd\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.044783 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.044303 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb2r9\" (UniqueName: \"kubernetes.io/projected/e2e1c881-454a-4129-b1c4-82db9c5f65ed-kube-api-access-qb2r9\") pod \"node-resolver-nw644\" (UID: \"e2e1c881-454a-4129-b1c4-82db9c5f65ed\") " pod="openshift-dns/node-resolver-nw644" Jun 11 14:28:15.044783 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.044393 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-host-kubelet\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.046014 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.044418 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-host-slash\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.046014 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.044439 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-node-log\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.046014 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.044461 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-ovnkube-script-lib\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.046014 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.045229 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 11 14:28:15.046014 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.045437 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 11 14:28:15.046014 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.045510 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-c4njk\"" Jun 11 14:28:15.046014 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.045712 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 11 14:28:15.063869 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.063842 2574 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 11 14:28:15.132789 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.132759 2574 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 11 14:28:15.145492 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.145462 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-multus-socket-dir-parent\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.145635 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.145497 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-multus-conf-dir\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.145635 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.145519 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/40408934-44bd-4c56-9c0c-13296258e82b-etc-sysconfig\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.145635 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.145590 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-multus-conf-dir\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.145635 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.145600 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-multus-socket-dir-parent\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.145814 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.145643 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/40408934-44bd-4c56-9c0c-13296258e82b-etc-sysconfig\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.145814 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.145666 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/72644857-34e8-4609-b2f0-6e21db6d182d-os-release\") pod \"multus-additional-cni-plugins-ng4b5\" (UID: \"72644857-34e8-4609-b2f0-6e21db6d182d\") " pod="openshift-multus/multus-additional-cni-plugins-ng4b5" Jun 11 14:28:15.145814 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.145686 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/72644857-34e8-4609-b2f0-6e21db6d182d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ng4b5\" (UID: \"72644857-34e8-4609-b2f0-6e21db6d182d\") " pod="openshift-multus/multus-additional-cni-plugins-ng4b5" Jun 11 14:28:15.145814 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.145705 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9286b965-a177-4f5c-97b7-b239fb31c9bb-kubelet-config\") pod \"global-pull-secret-syncer-fddhk\" (UID: \"9286b965-a177-4f5c-97b7-b239fb31c9bb\") " pod="kube-system/global-pull-secret-syncer-fddhk" Jun 11 14:28:15.145814 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.145757 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/72644857-34e8-4609-b2f0-6e21db6d182d-cnibin\") pod \"multus-additional-cni-plugins-ng4b5\" (UID: \"72644857-34e8-4609-b2f0-6e21db6d182d\") " pod="openshift-multus/multus-additional-cni-plugins-ng4b5" Jun 11 14:28:15.145814 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.145783 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/9286b965-a177-4f5c-97b7-b239fb31c9bb-kubelet-config\") pod \"global-pull-secret-syncer-fddhk\" (UID: \"9286b965-a177-4f5c-97b7-b239fb31c9bb\") " pod="kube-system/global-pull-secret-syncer-fddhk" Jun 11 14:28:15.146115 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.145854 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5295eaf0-10c6-4062-a7c1-38da29c14fe1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s82wr\" (UID: \"5295eaf0-10c6-4062-a7c1-38da29c14fe1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s82wr" Jun 11 14:28:15.146115 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.145883 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5295eaf0-10c6-4062-a7c1-38da29c14fe1-sys-fs\") pod \"aws-ebs-csi-driver-node-s82wr\" (UID: \"5295eaf0-10c6-4062-a7c1-38da29c14fe1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s82wr" Jun 11 14:28:15.146115 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.145912 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-run-ovn\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.146115 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.145937 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-host-cni-netd\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.146115 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.145968 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40408934-44bd-4c56-9c0c-13296258e82b-var-lib-kubelet\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.146115 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.145999 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-run-ovn\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.146115 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.145994 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8mlgh\" (UniqueName: \"kubernetes.io/projected/5295eaf0-10c6-4062-a7c1-38da29c14fe1-kube-api-access-8mlgh\") pod \"aws-ebs-csi-driver-node-s82wr\" (UID: \"5295eaf0-10c6-4062-a7c1-38da29c14fe1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s82wr" Jun 11 14:28:15.146115 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146012 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-host-cni-netd\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.146115 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146028 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-ovnkube-config\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.146115 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146033 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/40408934-44bd-4c56-9c0c-13296258e82b-var-lib-kubelet\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.146115 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146056 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-env-overrides\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.146115 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146079 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-host-run-k8s-cni-cncf-io\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.146115 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146102 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-run-systemd\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.146804 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146124 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j42sg\" (UniqueName: \"kubernetes.io/projected/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-kube-api-access-j42sg\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.146804 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146148 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/40408934-44bd-4c56-9c0c-13296258e82b-etc-systemd\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.146804 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146172 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb2r9\" (UniqueName: \"kubernetes.io/projected/e2e1c881-454a-4129-b1c4-82db9c5f65ed-kube-api-access-qb2r9\") pod \"node-resolver-nw644\" (UID: \"e2e1c881-454a-4129-b1c4-82db9c5f65ed\") " pod="openshift-dns/node-resolver-nw644" Jun 11 14:28:15.146804 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146194 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-host-kubelet\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.146804 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146218 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-host-slash\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.146804 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146240 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-node-log\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.146804 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146263 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-ovnkube-script-lib\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.146804 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146292 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-multus-cni-dir\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.146804 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146313 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-hostroot\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.146804 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146359 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-etc-kubernetes\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.146804 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146391 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9286b965-a177-4f5c-97b7-b239fb31c9bb-original-pull-secret\") pod \"global-pull-secret-syncer-fddhk\" (UID: \"9286b965-a177-4f5c-97b7-b239fb31c9bb\") " pod="kube-system/global-pull-secret-syncer-fddhk" Jun 11 14:28:15.146804 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146415 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-systemd-units\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.146804 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146438 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-host-run-netns\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.146804 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146465 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnxqc\" (UniqueName: \"kubernetes.io/projected/4586b811-c0d9-48ae-a089-7416a9309720-kube-api-access-dnxqc\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.146804 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146492 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/40408934-44bd-4c56-9c0c-13296258e82b-lib-modules\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.146804 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146515 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/92c15579-52ac-4218-a656-1981d234cd34-serviceca\") pod \"node-ca-2vwxx\" (UID: \"92c15579-52ac-4218-a656-1981d234cd34\") " pod="openshift-image-registry/node-ca-2vwxx" Jun 11 14:28:15.146804 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146538 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/72644857-34e8-4609-b2f0-6e21db6d182d-cni-binary-copy\") pod \"multus-additional-cni-plugins-ng4b5\" (UID: \"72644857-34e8-4609-b2f0-6e21db6d182d\") " pod="openshift-multus/multus-additional-cni-plugins-ng4b5" Jun 11 14:28:15.147597 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146548 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-ovnkube-config\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.147597 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146560 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5295eaf0-10c6-4062-a7c1-38da29c14fe1-registration-dir\") pod \"aws-ebs-csi-driver-node-s82wr\" (UID: \"5295eaf0-10c6-4062-a7c1-38da29c14fe1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s82wr" Jun 11 14:28:15.147597 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146585 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab181ce2-5bb7-4882-8c14-6409a830fb89-metrics-certs\") pod \"network-metrics-daemon-2wxd2\" (UID: \"ab181ce2-5bb7-4882-8c14-6409a830fb89\") " pod="openshift-multus/network-metrics-daemon-2wxd2" Jun 11 14:28:15.147597 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146610 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fc6cedcf-ee56-4afc-a1c3-c702501ccd08-host-slash\") pod \"iptables-alerter-wsq5b\" (UID: \"fc6cedcf-ee56-4afc-a1c3-c702501ccd08\") " pod="openshift-network-operator/iptables-alerter-wsq5b" Jun 11 14:28:15.147597 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146633 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-multus-cni-dir\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.147597 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146652 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/81420dd7-ea56-423e-af93-80009c14c162-agent-certs\") pod \"konnectivity-agent-trm4l\" (UID: \"81420dd7-ea56-423e-af93-80009c14c162\") " pod="kube-system/konnectivity-agent-trm4l" Jun 11 14:28:15.147597 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146678 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4nm2d\" (UniqueName: \"kubernetes.io/projected/40408934-44bd-4c56-9c0c-13296258e82b-kube-api-access-4nm2d\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.147597 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146700 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/92c15579-52ac-4218-a656-1981d234cd34-host\") pod \"node-ca-2vwxx\" (UID: \"92c15579-52ac-4218-a656-1981d234cd34\") " pod="openshift-image-registry/node-ca-2vwxx" Jun 11 14:28:15.147597 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146728 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e2e1c881-454a-4129-b1c4-82db9c5f65ed-hosts-file\") pod \"node-resolver-nw644\" (UID: \"e2e1c881-454a-4129-b1c4-82db9c5f65ed\") " pod="openshift-dns/node-resolver-nw644" Jun 11 14:28:15.147597 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146753 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.147597 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146780 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-ovn-node-metrics-cert\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.147597 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146807 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72644857-34e8-4609-b2f0-6e21db6d182d-system-cni-dir\") pod \"multus-additional-cni-plugins-ng4b5\" (UID: \"72644857-34e8-4609-b2f0-6e21db6d182d\") " pod="openshift-multus/multus-additional-cni-plugins-ng4b5" Jun 11 14:28:15.147597 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146834 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-host-run-ovn-kubernetes\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.147597 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146859 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4586b811-c0d9-48ae-a089-7416a9309720-cni-binary-copy\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.147597 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146883 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/40408934-44bd-4c56-9c0c-13296258e82b-etc-modprobe-d\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.147597 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146910 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-env-overrides\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.147597 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146909 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/40408934-44bd-4c56-9c0c-13296258e82b-sys\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.148576 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146945 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j4998\" (UniqueName: \"kubernetes.io/projected/92c15579-52ac-4218-a656-1981d234cd34-kube-api-access-j4998\") pod \"node-ca-2vwxx\" (UID: \"92c15579-52ac-4218-a656-1981d234cd34\") " pod="openshift-image-registry/node-ca-2vwxx" Jun 11 14:28:15.148576 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146962 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/40408934-44bd-4c56-9c0c-13296258e82b-sys\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.148576 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.146966 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5295eaf0-10c6-4062-a7c1-38da29c14fe1-etc-selinux\") pod \"aws-ebs-csi-driver-node-s82wr\" (UID: \"5295eaf0-10c6-4062-a7c1-38da29c14fe1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s82wr" Jun 11 14:28:15.148576 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.147001 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2e1c881-454a-4129-b1c4-82db9c5f65ed-tmp-dir\") pod \"node-resolver-nw644\" (UID: \"e2e1c881-454a-4129-b1c4-82db9c5f65ed\") " pod="openshift-dns/node-resolver-nw644" Jun 11 14:28:15.148576 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.147102 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-host-run-ovn-kubernetes\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.148576 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:15.147172 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:28:15.148576 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.147190 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/40408934-44bd-4c56-9c0c-13296258e82b-etc-modprobe-d\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.148576 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.147231 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-systemd-units\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.148576 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:15.147266 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9286b965-a177-4f5c-97b7-b239fb31c9bb-original-pull-secret podName:9286b965-a177-4f5c-97b7-b239fb31c9bb nodeName:}" failed. No retries permitted until 2026-06-11 14:28:15.647246807 +0000 UTC m=+2.979824258 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9286b965-a177-4f5c-97b7-b239fb31c9bb-original-pull-secret") pod "global-pull-secret-syncer-fddhk" (UID: "9286b965-a177-4f5c-97b7-b239fb31c9bb") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:28:15.148576 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.147360 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8mfv\" (UniqueName: \"kubernetes.io/projected/aad14df7-79a7-45f8-a84f-5399cf2b54b5-kube-api-access-x8mfv\") pod \"network-check-target-9t6ww\" (UID: \"aad14df7-79a7-45f8-a84f-5399cf2b54b5\") " pod="openshift-network-diagnostics/network-check-target-9t6ww" Jun 11 14:28:15.148576 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.147372 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/40408934-44bd-4c56-9c0c-13296258e82b-etc-systemd\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.148576 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.147399 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmb8h\" (UniqueName: \"kubernetes.io/projected/fc6cedcf-ee56-4afc-a1c3-c702501ccd08-kube-api-access-hmb8h\") pod \"iptables-alerter-wsq5b\" (UID: \"fc6cedcf-ee56-4afc-a1c3-c702501ccd08\") " pod="openshift-network-operator/iptables-alerter-wsq5b" Jun 11 14:28:15.148576 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.147410 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e2e1c881-454a-4129-b1c4-82db9c5f65ed-hosts-file\") pod \"node-resolver-nw644\" (UID: \"e2e1c881-454a-4129-b1c4-82db9c5f65ed\") " pod="openshift-dns/node-resolver-nw644" Jun 11 14:28:15.148576 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.147426 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-etc-openvswitch\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.148576 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.147450 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-os-release\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.148576 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.147461 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-host-run-netns\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.148576 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.147472 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4586b811-c0d9-48ae-a089-7416a9309720-multus-daemon-config\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.149415 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.147507 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/40408934-44bd-4c56-9c0c-13296258e82b-etc-tuned\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.149415 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.147539 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40408934-44bd-4c56-9c0c-13296258e82b-tmp\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.149415 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.147555 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-run-openvswitch\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.149415 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.147571 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-host-run-multus-certs\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.149415 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.147567 2574 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 11 14:28:15.149415 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.147628 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/fc6cedcf-ee56-4afc-a1c3-c702501ccd08-host-slash\") pod \"iptables-alerter-wsq5b\" (UID: \"fc6cedcf-ee56-4afc-a1c3-c702501ccd08\") " pod="openshift-network-operator/iptables-alerter-wsq5b" Jun 11 14:28:15.149415 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.147654 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-hostroot\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.149415 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.147684 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-etc-kubernetes\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.149415 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.147716 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-run-openvswitch\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.149415 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.147904 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-node-log\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.149415 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.147599 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/72644857-34e8-4609-b2f0-6e21db6d182d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ng4b5\" (UID: \"72644857-34e8-4609-b2f0-6e21db6d182d\") " pod="openshift-multus/multus-additional-cni-plugins-ng4b5" Jun 11 14:28:15.149415 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.148009 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e2e1c881-454a-4129-b1c4-82db9c5f65ed-tmp-dir\") pod \"node-resolver-nw644\" (UID: \"e2e1c881-454a-4129-b1c4-82db9c5f65ed\") " pod="openshift-dns/node-resolver-nw644" Jun 11 14:28:15.149415 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.148045 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/4586b811-c0d9-48ae-a089-7416a9309720-multus-daemon-config\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.149415 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.148133 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-host-kubelet\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.149415 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.148154 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-host-slash\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.149415 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.148200 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-host-run-multus-certs\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.149415 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:15.148213 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:28:15.149415 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.148232 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/40408934-44bd-4c56-9c0c-13296258e82b-lib-modules\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.149415 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.148268 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-etc-openvswitch\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.151027 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:15.148278 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab181ce2-5bb7-4882-8c14-6409a830fb89-metrics-certs podName:ab181ce2-5bb7-4882-8c14-6409a830fb89 nodeName:}" failed. No retries permitted until 2026-06-11 14:28:15.648261114 +0000 UTC m=+2.980838581 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab181ce2-5bb7-4882-8c14-6409a830fb89-metrics-certs") pod "network-metrics-daemon-2wxd2" (UID: "ab181ce2-5bb7-4882-8c14-6409a830fb89") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:28:15.151027 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.148516 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-os-release\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.151027 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.148559 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fc6cedcf-ee56-4afc-a1c3-c702501ccd08-iptables-alerter-script\") pod \"iptables-alerter-wsq5b\" (UID: \"fc6cedcf-ee56-4afc-a1c3-c702501ccd08\") " pod="openshift-network-operator/iptables-alerter-wsq5b" Jun 11 14:28:15.151027 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.148586 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-cnibin\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.151027 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.148595 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-ovnkube-script-lib\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.151027 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.148612 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-host-var-lib-cni-bin\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.151027 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.148659 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4586b811-c0d9-48ae-a089-7416a9309720-cni-binary-copy\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.151027 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.148661 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.151027 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.148672 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-host-var-lib-cni-multus\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.151027 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.148708 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-run-systemd\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.151027 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.148703 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/40408934-44bd-4c56-9c0c-13296258e82b-run\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.151027 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.148736 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/40408934-44bd-4c56-9c0c-13296258e82b-host\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.151027 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.148739 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-host-var-lib-cni-bin\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.151027 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.148764 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-host-cni-bin\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.151027 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.148795 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-host-run-netns\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.151027 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.148807 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-host-cni-bin\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.151027 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.148824 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/81420dd7-ea56-423e-af93-80009c14c162-konnectivity-ca\") pod \"konnectivity-agent-trm4l\" (UID: \"81420dd7-ea56-423e-af93-80009c14c162\") " pod="kube-system/konnectivity-agent-trm4l" Jun 11 14:28:15.151611 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.148850 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/40408934-44bd-4c56-9c0c-13296258e82b-etc-sysctl-conf\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.151611 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.148855 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-cnibin\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.151611 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.148877 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/72644857-34e8-4609-b2f0-6e21db6d182d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ng4b5\" (UID: \"72644857-34e8-4609-b2f0-6e21db6d182d\") " pod="openshift-multus/multus-additional-cni-plugins-ng4b5" Jun 11 14:28:15.151611 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.148915 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgdlr\" (UniqueName: \"kubernetes.io/projected/72644857-34e8-4609-b2f0-6e21db6d182d-kube-api-access-hgdlr\") pod \"multus-additional-cni-plugins-ng4b5\" (UID: \"72644857-34e8-4609-b2f0-6e21db6d182d\") " pod="openshift-multus/multus-additional-cni-plugins-ng4b5" Jun 11 14:28:15.151611 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.148945 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5295eaf0-10c6-4062-a7c1-38da29c14fe1-socket-dir\") pod \"aws-ebs-csi-driver-node-s82wr\" (UID: \"5295eaf0-10c6-4062-a7c1-38da29c14fe1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s82wr" Jun 11 14:28:15.151611 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.149001 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-var-lib-openvswitch\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.151611 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.149027 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40408934-44bd-4c56-9c0c-13296258e82b-etc-kubernetes\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.151611 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.149052 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/40408934-44bd-4c56-9c0c-13296258e82b-etc-sysctl-d\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.151611 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.149079 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5295eaf0-10c6-4062-a7c1-38da29c14fe1-device-dir\") pod \"aws-ebs-csi-driver-node-s82wr\" (UID: \"5295eaf0-10c6-4062-a7c1-38da29c14fe1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s82wr" Jun 11 14:28:15.151611 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.149217 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-system-cni-dir\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.151611 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.149281 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/fc6cedcf-ee56-4afc-a1c3-c702501ccd08-iptables-alerter-script\") pod \"iptables-alerter-wsq5b\" (UID: \"fc6cedcf-ee56-4afc-a1c3-c702501ccd08\") " pod="openshift-network-operator/iptables-alerter-wsq5b" Jun 11 14:28:15.151611 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.149300 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-host-var-lib-kubelet\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.151611 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.149315 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-host-var-lib-cni-multus\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.151611 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.149345 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sgzhj\" (UniqueName: \"kubernetes.io/projected/ab181ce2-5bb7-4882-8c14-6409a830fb89-kube-api-access-sgzhj\") pod \"network-metrics-daemon-2wxd2\" (UID: \"ab181ce2-5bb7-4882-8c14-6409a830fb89\") " pod="openshift-multus/network-metrics-daemon-2wxd2" Jun 11 14:28:15.151611 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.149359 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-host-run-k8s-cni-cncf-io\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.151611 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.149374 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9286b965-a177-4f5c-97b7-b239fb31c9bb-dbus\") pod \"global-pull-secret-syncer-fddhk\" (UID: \"9286b965-a177-4f5c-97b7-b239fb31c9bb\") " pod="kube-system/global-pull-secret-syncer-fddhk" Jun 11 14:28:15.151611 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.149419 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-host-var-lib-kubelet\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.152172 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.149448 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-log-socket\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.152172 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.149453 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/40408934-44bd-4c56-9c0c-13296258e82b-host\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.152172 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.149491 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-var-lib-openvswitch\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.152172 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.149503 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-log-socket\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.152172 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.149529 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/40408934-44bd-4c56-9c0c-13296258e82b-run\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.152172 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.149533 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/40408934-44bd-4c56-9c0c-13296258e82b-etc-kubernetes\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.152172 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.149550 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-host-run-netns\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.152172 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.149632 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/9286b965-a177-4f5c-97b7-b239fb31c9bb-dbus\") pod \"global-pull-secret-syncer-fddhk\" (UID: \"9286b965-a177-4f5c-97b7-b239fb31c9bb\") " pod="kube-system/global-pull-secret-syncer-fddhk" Jun 11 14:28:15.152172 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.149710 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/40408934-44bd-4c56-9c0c-13296258e82b-etc-sysctl-d\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.152172 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.149751 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4586b811-c0d9-48ae-a089-7416a9309720-system-cni-dir\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.152172 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.149861 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/81420dd7-ea56-423e-af93-80009c14c162-konnectivity-ca\") pod \"konnectivity-agent-trm4l\" (UID: \"81420dd7-ea56-423e-af93-80009c14c162\") " pod="kube-system/konnectivity-agent-trm4l" Jun 11 14:28:15.152172 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.149943 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/40408934-44bd-4c56-9c0c-13296258e82b-etc-sysctl-conf\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.152172 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.150517 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40408934-44bd-4c56-9c0c-13296258e82b-tmp\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.152172 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.150887 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/81420dd7-ea56-423e-af93-80009c14c162-agent-certs\") pod \"konnectivity-agent-trm4l\" (UID: \"81420dd7-ea56-423e-af93-80009c14c162\") " pod="kube-system/konnectivity-agent-trm4l" Jun 11 14:28:15.152172 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.150895 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/40408934-44bd-4c56-9c0c-13296258e82b-etc-tuned\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.152742 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.152412 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-ovn-node-metrics-cert\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.165267 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:15.165245 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:28:15.165267 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:15.165266 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:28:15.165437 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:15.165276 2574 projected.go:196] Error preparing data for projected volume kube-api-access-x8mfv for pod openshift-network-diagnostics/network-check-target-9t6ww: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:28:15.165437 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:15.165341 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aad14df7-79a7-45f8-a84f-5399cf2b54b5-kube-api-access-x8mfv podName:aad14df7-79a7-45f8-a84f-5399cf2b54b5 nodeName:}" failed. No retries permitted until 2026-06-11 14:28:15.665312712 +0000 UTC m=+2.997890176 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-x8mfv" (UniqueName: "kubernetes.io/projected/aad14df7-79a7-45f8-a84f-5399cf2b54b5-kube-api-access-x8mfv") pod "network-check-target-9t6ww" (UID: "aad14df7-79a7-45f8-a84f-5399cf2b54b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:28:15.178663 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.178618 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnxqc\" (UniqueName: \"kubernetes.io/projected/4586b811-c0d9-48ae-a089-7416a9309720-kube-api-access-dnxqc\") pod \"multus-f4zh2\" (UID: \"4586b811-c0d9-48ae-a089-7416a9309720\") " pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.178802 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.178625 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb2r9\" (UniqueName: \"kubernetes.io/projected/e2e1c881-454a-4129-b1c4-82db9c5f65ed-kube-api-access-qb2r9\") pod \"node-resolver-nw644\" (UID: \"e2e1c881-454a-4129-b1c4-82db9c5f65ed\") " pod="openshift-dns/node-resolver-nw644" Jun 11 14:28:15.181343 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.181302 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmb8h\" (UniqueName: \"kubernetes.io/projected/fc6cedcf-ee56-4afc-a1c3-c702501ccd08-kube-api-access-hmb8h\") pod \"iptables-alerter-wsq5b\" (UID: \"fc6cedcf-ee56-4afc-a1c3-c702501ccd08\") " pod="openshift-network-operator/iptables-alerter-wsq5b" Jun 11 14:28:15.181646 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.181628 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j42sg\" (UniqueName: \"kubernetes.io/projected/37cb9247-f8d1-4b39-a031-89f74f7a8e1b-kube-api-access-j42sg\") pod \"ovnkube-node-qld5j\" (UID: \"37cb9247-f8d1-4b39-a031-89f74f7a8e1b\") " pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.191469 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.191444 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sgzhj\" (UniqueName: \"kubernetes.io/projected/ab181ce2-5bb7-4882-8c14-6409a830fb89-kube-api-access-sgzhj\") pod \"network-metrics-daemon-2wxd2\" (UID: \"ab181ce2-5bb7-4882-8c14-6409a830fb89\") " pod="openshift-multus/network-metrics-daemon-2wxd2" Jun 11 14:28:15.210983 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.210951 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4nm2d\" (UniqueName: \"kubernetes.io/projected/40408934-44bd-4c56-9c0c-13296258e82b-kube-api-access-4nm2d\") pod \"tuned-vnh2f\" (UID: \"40408934-44bd-4c56-9c0c-13296258e82b\") " pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.220122 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.220093 2574 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-gfmcw" Jun 11 14:28:15.250517 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.250479 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/72644857-34e8-4609-b2f0-6e21db6d182d-os-release\") pod \"multus-additional-cni-plugins-ng4b5\" (UID: \"72644857-34e8-4609-b2f0-6e21db6d182d\") " pod="openshift-multus/multus-additional-cni-plugins-ng4b5" Jun 11 14:28:15.250517 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.250520 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/72644857-34e8-4609-b2f0-6e21db6d182d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ng4b5\" (UID: \"72644857-34e8-4609-b2f0-6e21db6d182d\") " pod="openshift-multus/multus-additional-cni-plugins-ng4b5" Jun 11 14:28:15.250746 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.250545 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/72644857-34e8-4609-b2f0-6e21db6d182d-cnibin\") pod \"multus-additional-cni-plugins-ng4b5\" (UID: \"72644857-34e8-4609-b2f0-6e21db6d182d\") " pod="openshift-multus/multus-additional-cni-plugins-ng4b5" Jun 11 14:28:15.250746 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.250566 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5295eaf0-10c6-4062-a7c1-38da29c14fe1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s82wr\" (UID: \"5295eaf0-10c6-4062-a7c1-38da29c14fe1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s82wr" Jun 11 14:28:15.250746 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.250585 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5295eaf0-10c6-4062-a7c1-38da29c14fe1-sys-fs\") pod \"aws-ebs-csi-driver-node-s82wr\" (UID: \"5295eaf0-10c6-4062-a7c1-38da29c14fe1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s82wr" Jun 11 14:28:15.250746 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.250631 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8mlgh\" (UniqueName: \"kubernetes.io/projected/5295eaf0-10c6-4062-a7c1-38da29c14fe1-kube-api-access-8mlgh\") pod \"aws-ebs-csi-driver-node-s82wr\" (UID: \"5295eaf0-10c6-4062-a7c1-38da29c14fe1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s82wr" Jun 11 14:28:15.250746 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.250638 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/72644857-34e8-4609-b2f0-6e21db6d182d-cnibin\") pod \"multus-additional-cni-plugins-ng4b5\" (UID: \"72644857-34e8-4609-b2f0-6e21db6d182d\") " pod="openshift-multus/multus-additional-cni-plugins-ng4b5" Jun 11 14:28:15.250746 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.250666 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/5295eaf0-10c6-4062-a7c1-38da29c14fe1-kubelet-dir\") pod \"aws-ebs-csi-driver-node-s82wr\" (UID: \"5295eaf0-10c6-4062-a7c1-38da29c14fe1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s82wr" Jun 11 14:28:15.250746 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.250638 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/72644857-34e8-4609-b2f0-6e21db6d182d-os-release\") pod \"multus-additional-cni-plugins-ng4b5\" (UID: \"72644857-34e8-4609-b2f0-6e21db6d182d\") " pod="openshift-multus/multus-additional-cni-plugins-ng4b5" Jun 11 14:28:15.250746 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.250710 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/92c15579-52ac-4218-a656-1981d234cd34-serviceca\") pod \"node-ca-2vwxx\" (UID: \"92c15579-52ac-4218-a656-1981d234cd34\") " pod="openshift-image-registry/node-ca-2vwxx" Jun 11 14:28:15.250746 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.250738 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/72644857-34e8-4609-b2f0-6e21db6d182d-cni-binary-copy\") pod \"multus-additional-cni-plugins-ng4b5\" (UID: \"72644857-34e8-4609-b2f0-6e21db6d182d\") " pod="openshift-multus/multus-additional-cni-plugins-ng4b5" Jun 11 14:28:15.251182 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.250681 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/5295eaf0-10c6-4062-a7c1-38da29c14fe1-sys-fs\") pod \"aws-ebs-csi-driver-node-s82wr\" (UID: \"5295eaf0-10c6-4062-a7c1-38da29c14fe1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s82wr" Jun 11 14:28:15.251182 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.250762 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5295eaf0-10c6-4062-a7c1-38da29c14fe1-registration-dir\") pod \"aws-ebs-csi-driver-node-s82wr\" (UID: \"5295eaf0-10c6-4062-a7c1-38da29c14fe1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s82wr" Jun 11 14:28:15.251182 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.250801 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/5295eaf0-10c6-4062-a7c1-38da29c14fe1-registration-dir\") pod \"aws-ebs-csi-driver-node-s82wr\" (UID: \"5295eaf0-10c6-4062-a7c1-38da29c14fe1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s82wr" Jun 11 14:28:15.251182 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.250831 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/92c15579-52ac-4218-a656-1981d234cd34-host\") pod \"node-ca-2vwxx\" (UID: \"92c15579-52ac-4218-a656-1981d234cd34\") " pod="openshift-image-registry/node-ca-2vwxx" Jun 11 14:28:15.251182 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.250864 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72644857-34e8-4609-b2f0-6e21db6d182d-system-cni-dir\") pod \"multus-additional-cni-plugins-ng4b5\" (UID: \"72644857-34e8-4609-b2f0-6e21db6d182d\") " pod="openshift-multus/multus-additional-cni-plugins-ng4b5" Jun 11 14:28:15.251182 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.250892 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j4998\" (UniqueName: \"kubernetes.io/projected/92c15579-52ac-4218-a656-1981d234cd34-kube-api-access-j4998\") pod \"node-ca-2vwxx\" (UID: \"92c15579-52ac-4218-a656-1981d234cd34\") " pod="openshift-image-registry/node-ca-2vwxx" Jun 11 14:28:15.251182 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.250917 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5295eaf0-10c6-4062-a7c1-38da29c14fe1-etc-selinux\") pod \"aws-ebs-csi-driver-node-s82wr\" (UID: \"5295eaf0-10c6-4062-a7c1-38da29c14fe1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s82wr" Jun 11 14:28:15.251182 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.250932 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/92c15579-52ac-4218-a656-1981d234cd34-host\") pod \"node-ca-2vwxx\" (UID: \"92c15579-52ac-4218-a656-1981d234cd34\") " pod="openshift-image-registry/node-ca-2vwxx" Jun 11 14:28:15.251182 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.250952 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/72644857-34e8-4609-b2f0-6e21db6d182d-system-cni-dir\") pod \"multus-additional-cni-plugins-ng4b5\" (UID: \"72644857-34e8-4609-b2f0-6e21db6d182d\") " pod="openshift-multus/multus-additional-cni-plugins-ng4b5" Jun 11 14:28:15.251182 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.250970 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/72644857-34e8-4609-b2f0-6e21db6d182d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ng4b5\" (UID: \"72644857-34e8-4609-b2f0-6e21db6d182d\") " pod="openshift-multus/multus-additional-cni-plugins-ng4b5" Jun 11 14:28:15.251182 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.251018 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/5295eaf0-10c6-4062-a7c1-38da29c14fe1-etc-selinux\") pod \"aws-ebs-csi-driver-node-s82wr\" (UID: \"5295eaf0-10c6-4062-a7c1-38da29c14fe1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s82wr" Jun 11 14:28:15.251182 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.251032 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/72644857-34e8-4609-b2f0-6e21db6d182d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ng4b5\" (UID: \"72644857-34e8-4609-b2f0-6e21db6d182d\") " pod="openshift-multus/multus-additional-cni-plugins-ng4b5" Jun 11 14:28:15.251182 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.251061 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgdlr\" (UniqueName: \"kubernetes.io/projected/72644857-34e8-4609-b2f0-6e21db6d182d-kube-api-access-hgdlr\") pod \"multus-additional-cni-plugins-ng4b5\" (UID: \"72644857-34e8-4609-b2f0-6e21db6d182d\") " pod="openshift-multus/multus-additional-cni-plugins-ng4b5" Jun 11 14:28:15.251182 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.251085 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5295eaf0-10c6-4062-a7c1-38da29c14fe1-socket-dir\") pod \"aws-ebs-csi-driver-node-s82wr\" (UID: \"5295eaf0-10c6-4062-a7c1-38da29c14fe1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s82wr" Jun 11 14:28:15.251182 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.251111 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5295eaf0-10c6-4062-a7c1-38da29c14fe1-device-dir\") pod \"aws-ebs-csi-driver-node-s82wr\" (UID: \"5295eaf0-10c6-4062-a7c1-38da29c14fe1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s82wr" Jun 11 14:28:15.251182 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.251127 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/72644857-34e8-4609-b2f0-6e21db6d182d-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ng4b5\" (UID: \"72644857-34e8-4609-b2f0-6e21db6d182d\") " pod="openshift-multus/multus-additional-cni-plugins-ng4b5" Jun 11 14:28:15.251182 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.251143 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/92c15579-52ac-4218-a656-1981d234cd34-serviceca\") pod \"node-ca-2vwxx\" (UID: \"92c15579-52ac-4218-a656-1981d234cd34\") " pod="openshift-image-registry/node-ca-2vwxx" Jun 11 14:28:15.251848 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.251185 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/72644857-34e8-4609-b2f0-6e21db6d182d-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ng4b5\" (UID: \"72644857-34e8-4609-b2f0-6e21db6d182d\") " pod="openshift-multus/multus-additional-cni-plugins-ng4b5" Jun 11 14:28:15.251848 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.251189 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/5295eaf0-10c6-4062-a7c1-38da29c14fe1-device-dir\") pod \"aws-ebs-csi-driver-node-s82wr\" (UID: \"5295eaf0-10c6-4062-a7c1-38da29c14fe1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s82wr" Jun 11 14:28:15.251848 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.251239 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/5295eaf0-10c6-4062-a7c1-38da29c14fe1-socket-dir\") pod \"aws-ebs-csi-driver-node-s82wr\" (UID: \"5295eaf0-10c6-4062-a7c1-38da29c14fe1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s82wr" Jun 11 14:28:15.251848 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.251282 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/72644857-34e8-4609-b2f0-6e21db6d182d-cni-binary-copy\") pod \"multus-additional-cni-plugins-ng4b5\" (UID: \"72644857-34e8-4609-b2f0-6e21db6d182d\") " pod="openshift-multus/multus-additional-cni-plugins-ng4b5" Jun 11 14:28:15.251848 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.251550 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/72644857-34e8-4609-b2f0-6e21db6d182d-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ng4b5\" (UID: \"72644857-34e8-4609-b2f0-6e21db6d182d\") " pod="openshift-multus/multus-additional-cni-plugins-ng4b5" Jun 11 14:28:15.256878 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.256815 2574 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-gfmcw" Jun 11 14:28:15.273002 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.272968 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgdlr\" (UniqueName: \"kubernetes.io/projected/72644857-34e8-4609-b2f0-6e21db6d182d-kube-api-access-hgdlr\") pod \"multus-additional-cni-plugins-ng4b5\" (UID: \"72644857-34e8-4609-b2f0-6e21db6d182d\") " pod="openshift-multus/multus-additional-cni-plugins-ng4b5" Jun 11 14:28:15.273970 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.273937 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j4998\" (UniqueName: \"kubernetes.io/projected/92c15579-52ac-4218-a656-1981d234cd34-kube-api-access-j4998\") pod \"node-ca-2vwxx\" (UID: \"92c15579-52ac-4218-a656-1981d234cd34\") " pod="openshift-image-registry/node-ca-2vwxx" Jun 11 14:28:15.283251 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.283222 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8mlgh\" (UniqueName: \"kubernetes.io/projected/5295eaf0-10c6-4062-a7c1-38da29c14fe1-kube-api-access-8mlgh\") pod \"aws-ebs-csi-driver-node-s82wr\" (UID: \"5295eaf0-10c6-4062-a7c1-38da29c14fe1\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s82wr" Jun 11 14:28:15.332601 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.332570 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:15.337617 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.337593 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" Jun 11 14:28:15.344678 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.344658 2574 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:28:15.347689 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.347666 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-trm4l" Jun 11 14:28:15.353552 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.353530 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-wsq5b" Jun 11 14:28:15.360773 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.360752 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-nw644" Jun 11 14:28:15.367285 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.367266 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-f4zh2" Jun 11 14:28:15.372914 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.372896 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-2vwxx" Jun 11 14:28:15.380386 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.380368 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ng4b5" Jun 11 14:28:15.387277 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.387259 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s82wr" Jun 11 14:28:15.654514 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.654412 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9286b965-a177-4f5c-97b7-b239fb31c9bb-original-pull-secret\") pod \"global-pull-secret-syncer-fddhk\" (UID: \"9286b965-a177-4f5c-97b7-b239fb31c9bb\") " pod="kube-system/global-pull-secret-syncer-fddhk" Jun 11 14:28:15.654514 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.654487 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab181ce2-5bb7-4882-8c14-6409a830fb89-metrics-certs\") pod \"network-metrics-daemon-2wxd2\" (UID: \"ab181ce2-5bb7-4882-8c14-6409a830fb89\") " pod="openshift-multus/network-metrics-daemon-2wxd2" Jun 11 14:28:15.654728 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:15.654532 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:28:15.654728 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:15.654601 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:28:15.654728 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:15.654614 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9286b965-a177-4f5c-97b7-b239fb31c9bb-original-pull-secret podName:9286b965-a177-4f5c-97b7-b239fb31c9bb nodeName:}" failed. No retries permitted until 2026-06-11 14:28:16.654594175 +0000 UTC m=+3.987171630 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9286b965-a177-4f5c-97b7-b239fb31c9bb-original-pull-secret") pod "global-pull-secret-syncer-fddhk" (UID: "9286b965-a177-4f5c-97b7-b239fb31c9bb") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:28:15.654728 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:15.654675 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab181ce2-5bb7-4882-8c14-6409a830fb89-metrics-certs podName:ab181ce2-5bb7-4882-8c14-6409a830fb89 nodeName:}" failed. No retries permitted until 2026-06-11 14:28:16.654656337 +0000 UTC m=+3.987233788 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab181ce2-5bb7-4882-8c14-6409a830fb89-metrics-certs") pod "network-metrics-daemon-2wxd2" (UID: "ab181ce2-5bb7-4882-8c14-6409a830fb89") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:28:15.755582 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:15.755543 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8mfv\" (UniqueName: \"kubernetes.io/projected/aad14df7-79a7-45f8-a84f-5399cf2b54b5-kube-api-access-x8mfv\") pod \"network-check-target-9t6ww\" (UID: \"aad14df7-79a7-45f8-a84f-5399cf2b54b5\") " pod="openshift-network-diagnostics/network-check-target-9t6ww" Jun 11 14:28:15.755761 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:15.755731 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:28:15.755761 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:15.755754 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:28:15.755888 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:15.755765 2574 projected.go:196] Error preparing data for projected volume kube-api-access-x8mfv for pod openshift-network-diagnostics/network-check-target-9t6ww: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:28:15.755888 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:15.755823 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aad14df7-79a7-45f8-a84f-5399cf2b54b5-kube-api-access-x8mfv podName:aad14df7-79a7-45f8-a84f-5399cf2b54b5 nodeName:}" failed. No retries permitted until 2026-06-11 14:28:16.755809722 +0000 UTC m=+4.088387172 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-x8mfv" (UniqueName: "kubernetes.io/projected/aad14df7-79a7-45f8-a84f-5399cf2b54b5-kube-api-access-x8mfv") pod "network-check-target-9t6ww" (UID: "aad14df7-79a7-45f8-a84f-5399cf2b54b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:28:15.807054 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:15.807009 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc6cedcf_ee56_4afc_a1c3_c702501ccd08.slice/crio-fd386295d0558c120a62657b4ced54591b129ee9601cfabac8cb2ac9cced51ce WatchSource:0}: Error finding container fd386295d0558c120a62657b4ced54591b129ee9601cfabac8cb2ac9cced51ce: Status 404 returned error can't find the container with id fd386295d0558c120a62657b4ced54591b129ee9601cfabac8cb2ac9cced51ce Jun 11 14:28:15.809495 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:15.809467 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72644857_34e8_4609_b2f0_6e21db6d182d.slice/crio-1dce7ab8cf7b24c388597edd99bf16413574f492c8ddc1c813515d29d0f2ac86 WatchSource:0}: Error finding container 1dce7ab8cf7b24c388597edd99bf16413574f492c8ddc1c813515d29d0f2ac86: Status 404 returned error can't find the container with id 1dce7ab8cf7b24c388597edd99bf16413574f492c8ddc1c813515d29d0f2ac86 Jun 11 14:28:15.810271 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:15.810209 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81420dd7_ea56_423e_af93_80009c14c162.slice/crio-de58e9ab7afdfdc1a18b329bb525d7357a947d00034acafd5a961b83639a59ef WatchSource:0}: Error finding container de58e9ab7afdfdc1a18b329bb525d7357a947d00034acafd5a961b83639a59ef: Status 404 returned error can't find the container with id de58e9ab7afdfdc1a18b329bb525d7357a947d00034acafd5a961b83639a59ef Jun 11 14:28:15.813484 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:15.813466 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5295eaf0_10c6_4062_a7c1_38da29c14fe1.slice/crio-5a8391bf9ffc410a8e9d9607f3a36ad3a0f44e565412f0173f3e5e3f5f8fdf65 WatchSource:0}: Error finding container 5a8391bf9ffc410a8e9d9607f3a36ad3a0f44e565412f0173f3e5e3f5f8fdf65: Status 404 returned error can't find the container with id 5a8391bf9ffc410a8e9d9607f3a36ad3a0f44e565412f0173f3e5e3f5f8fdf65 Jun 11 14:28:15.814206 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:15.814183 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2e1c881_454a_4129_b1c4_82db9c5f65ed.slice/crio-0c8668fd03c425d0ef0c27d20c4490e52f9acd92883f4d4b6dac05116ae5a4ca WatchSource:0}: Error finding container 0c8668fd03c425d0ef0c27d20c4490e52f9acd92883f4d4b6dac05116ae5a4ca: Status 404 returned error can't find the container with id 0c8668fd03c425d0ef0c27d20c4490e52f9acd92883f4d4b6dac05116ae5a4ca Jun 11 14:28:15.815666 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:15.815530 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4586b811_c0d9_48ae_a089_7416a9309720.slice/crio-097e7a4455a51cda419e1a02fa667e7edd6f643fe3d01093a0e54f0ff3c93a1f WatchSource:0}: Error finding container 097e7a4455a51cda419e1a02fa667e7edd6f643fe3d01093a0e54f0ff3c93a1f: Status 404 returned error can't find the container with id 097e7a4455a51cda419e1a02fa667e7edd6f643fe3d01093a0e54f0ff3c93a1f Jun 11 14:28:15.817237 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:15.817203 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod92c15579_52ac_4218_a656_1981d234cd34.slice/crio-647f9fb47a744f1402869e36573e2cae581f3b1de8a054655ae761a9b6cba2a8 WatchSource:0}: Error finding container 647f9fb47a744f1402869e36573e2cae581f3b1de8a054655ae761a9b6cba2a8: Status 404 returned error can't find the container with id 647f9fb47a744f1402869e36573e2cae581f3b1de8a054655ae761a9b6cba2a8 Jun 11 14:28:15.819358 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:15.819251 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37cb9247_f8d1_4b39_a031_89f74f7a8e1b.slice/crio-eab725d61e715c0e5a965aba71e3e2c7cb90f0498bcfd94bd90b18fd3d951b6d WatchSource:0}: Error finding container eab725d61e715c0e5a965aba71e3e2c7cb90f0498bcfd94bd90b18fd3d951b6d: Status 404 returned error can't find the container with id eab725d61e715c0e5a965aba71e3e2c7cb90f0498bcfd94bd90b18fd3d951b6d Jun 11 14:28:15.819857 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:15.819833 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40408934_44bd_4c56_9c0c_13296258e82b.slice/crio-ef049603da6105b5c8c55eeebe4eb490cbb7d831d78526e7bba24e6ae5320aca WatchSource:0}: Error finding container ef049603da6105b5c8c55eeebe4eb490cbb7d831d78526e7bba24e6ae5320aca: Status 404 returned error can't find the container with id ef049603da6105b5c8c55eeebe4eb490cbb7d831d78526e7bba24e6ae5320aca Jun 11 14:28:16.106899 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:16.106872 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9t6ww" Jun 11 14:28:16.107355 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:16.106984 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9t6ww" podUID="aad14df7-79a7-45f8-a84f-5399cf2b54b5" Jun 11 14:28:16.115901 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:16.115871 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s82wr" event={"ID":"5295eaf0-10c6-4062-a7c1-38da29c14fe1","Type":"ContainerStarted","Data":"5a8391bf9ffc410a8e9d9607f3a36ad3a0f44e565412f0173f3e5e3f5f8fdf65"} Jun 11 14:28:16.117268 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:16.117237 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ng4b5" event={"ID":"72644857-34e8-4609-b2f0-6e21db6d182d","Type":"ContainerStarted","Data":"1dce7ab8cf7b24c388597edd99bf16413574f492c8ddc1c813515d29d0f2ac86"} Jun 11 14:28:16.118590 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:16.118561 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" event={"ID":"40408934-44bd-4c56-9c0c-13296258e82b","Type":"ContainerStarted","Data":"ef049603da6105b5c8c55eeebe4eb490cbb7d831d78526e7bba24e6ae5320aca"} Jun 11 14:28:16.119858 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:16.119835 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2vwxx" event={"ID":"92c15579-52ac-4218-a656-1981d234cd34","Type":"ContainerStarted","Data":"647f9fb47a744f1402869e36573e2cae581f3b1de8a054655ae761a9b6cba2a8"} Jun 11 14:28:16.121204 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:16.121178 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-trm4l" event={"ID":"81420dd7-ea56-423e-af93-80009c14c162","Type":"ContainerStarted","Data":"de58e9ab7afdfdc1a18b329bb525d7357a947d00034acafd5a961b83639a59ef"} Jun 11 14:28:16.122567 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:16.122543 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wsq5b" event={"ID":"fc6cedcf-ee56-4afc-a1c3-c702501ccd08","Type":"ContainerStarted","Data":"fd386295d0558c120a62657b4ced54591b129ee9601cfabac8cb2ac9cced51ce"} Jun 11 14:28:16.125391 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:16.124760 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-108.ec2.internal" event={"ID":"c0941fa4b66ece37ffb65738f439974f","Type":"ContainerStarted","Data":"26b971088a95f10e5e80a844725a2fa84232adaedeac46561db5d10aca0826ff"} Jun 11 14:28:16.128031 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:16.128008 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-108.ec2.internal" event={"ID":"8b858571848d1c6292ca0714814a05d2","Type":"ContainerStarted","Data":"ffa62b57349fc4cce3cfcc0312bfb6c61b12abca58609f459dbd9cd9a76f7f0c"} Jun 11 14:28:16.129264 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:16.129240 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" event={"ID":"37cb9247-f8d1-4b39-a031-89f74f7a8e1b","Type":"ContainerStarted","Data":"eab725d61e715c0e5a965aba71e3e2c7cb90f0498bcfd94bd90b18fd3d951b6d"} Jun 11 14:28:16.130896 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:16.130871 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f4zh2" event={"ID":"4586b811-c0d9-48ae-a089-7416a9309720","Type":"ContainerStarted","Data":"097e7a4455a51cda419e1a02fa667e7edd6f643fe3d01093a0e54f0ff3c93a1f"} Jun 11 14:28:16.132092 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:16.132067 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nw644" event={"ID":"e2e1c881-454a-4129-b1c4-82db9c5f65ed","Type":"ContainerStarted","Data":"0c8668fd03c425d0ef0c27d20c4490e52f9acd92883f4d4b6dac05116ae5a4ca"} Jun 11 14:28:16.260501 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:16.260400 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 14:23:15 +0000 UTC" deadline="2028-02-24 16:23:50.402519784 +0000 UTC" Jun 11 14:28:16.260501 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:16.260441 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14953h55m34.142083432s" Jun 11 14:28:16.386414 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:16.386016 2574 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 11 14:28:16.662573 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:16.662483 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9286b965-a177-4f5c-97b7-b239fb31c9bb-original-pull-secret\") pod \"global-pull-secret-syncer-fddhk\" (UID: \"9286b965-a177-4f5c-97b7-b239fb31c9bb\") " pod="kube-system/global-pull-secret-syncer-fddhk" Jun 11 14:28:16.662573 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:16.662542 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab181ce2-5bb7-4882-8c14-6409a830fb89-metrics-certs\") pod \"network-metrics-daemon-2wxd2\" (UID: \"ab181ce2-5bb7-4882-8c14-6409a830fb89\") " pod="openshift-multus/network-metrics-daemon-2wxd2" Jun 11 14:28:16.662797 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:16.662768 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:28:16.662854 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:16.662836 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab181ce2-5bb7-4882-8c14-6409a830fb89-metrics-certs podName:ab181ce2-5bb7-4882-8c14-6409a830fb89 nodeName:}" failed. No retries permitted until 2026-06-11 14:28:18.662816001 +0000 UTC m=+5.995393455 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab181ce2-5bb7-4882-8c14-6409a830fb89-metrics-certs") pod "network-metrics-daemon-2wxd2" (UID: "ab181ce2-5bb7-4882-8c14-6409a830fb89") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:28:16.663261 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:16.663241 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:28:16.663369 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:16.663294 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9286b965-a177-4f5c-97b7-b239fb31c9bb-original-pull-secret podName:9286b965-a177-4f5c-97b7-b239fb31c9bb nodeName:}" failed. No retries permitted until 2026-06-11 14:28:18.663279291 +0000 UTC m=+5.995856743 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9286b965-a177-4f5c-97b7-b239fb31c9bb-original-pull-secret") pod "global-pull-secret-syncer-fddhk" (UID: "9286b965-a177-4f5c-97b7-b239fb31c9bb") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:28:16.763273 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:16.763235 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8mfv\" (UniqueName: \"kubernetes.io/projected/aad14df7-79a7-45f8-a84f-5399cf2b54b5-kube-api-access-x8mfv\") pod \"network-check-target-9t6ww\" (UID: \"aad14df7-79a7-45f8-a84f-5399cf2b54b5\") " pod="openshift-network-diagnostics/network-check-target-9t6ww" Jun 11 14:28:16.763453 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:16.763412 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:28:16.763453 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:16.763430 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:28:16.763453 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:16.763443 2574 projected.go:196] Error preparing data for projected volume kube-api-access-x8mfv for pod openshift-network-diagnostics/network-check-target-9t6ww: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:28:16.763633 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:16.763499 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aad14df7-79a7-45f8-a84f-5399cf2b54b5-kube-api-access-x8mfv podName:aad14df7-79a7-45f8-a84f-5399cf2b54b5 nodeName:}" failed. No retries permitted until 2026-06-11 14:28:18.763481233 +0000 UTC m=+6.096058701 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-x8mfv" (UniqueName: "kubernetes.io/projected/aad14df7-79a7-45f8-a84f-5399cf2b54b5-kube-api-access-x8mfv") pod "network-check-target-9t6ww" (UID: "aad14df7-79a7-45f8-a84f-5399cf2b54b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:28:17.116031 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:17.115994 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wxd2" Jun 11 14:28:17.116735 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:17.116195 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wxd2" podUID="ab181ce2-5bb7-4882-8c14-6409a830fb89" Jun 11 14:28:17.116735 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:17.116718 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fddhk" Jun 11 14:28:17.116898 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:17.116858 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fddhk" podUID="9286b965-a177-4f5c-97b7-b239fb31c9bb" Jun 11 14:28:17.151417 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:17.150807 2574 generic.go:356] "Generic (PLEG): container finished" podID="c0941fa4b66ece37ffb65738f439974f" containerID="26b971088a95f10e5e80a844725a2fa84232adaedeac46561db5d10aca0826ff" exitCode=0 Jun 11 14:28:17.151417 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:17.150922 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-108.ec2.internal" event={"ID":"c0941fa4b66ece37ffb65738f439974f","Type":"ContainerDied","Data":"26b971088a95f10e5e80a844725a2fa84232adaedeac46561db5d10aca0826ff"} Jun 11 14:28:17.178719 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:17.177907 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-135-108.ec2.internal" podStartSLOduration=3.177887075 podStartE2EDuration="3.177887075s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:28:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:28:16.164617473 +0000 UTC m=+3.497194945" watchObservedRunningTime="2026-06-11 14:28:17.177887075 +0000 UTC m=+4.510464551" Jun 11 14:28:17.260598 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:17.260539 2574 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-10 14:23:15 +0000 UTC" deadline="2027-12-04 13:19:50.886680391 +0000 UTC" Jun 11 14:28:17.260598 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:17.260593 2574 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12982h51m33.626090429s" Jun 11 14:28:18.106968 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:18.106939 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9t6ww" Jun 11 14:28:18.107140 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:18.107063 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9t6ww" podUID="aad14df7-79a7-45f8-a84f-5399cf2b54b5" Jun 11 14:28:18.179358 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:18.179241 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-108.ec2.internal" event={"ID":"c0941fa4b66ece37ffb65738f439974f","Type":"ContainerStarted","Data":"e71e31501c8d51ca96848c620b4316d39eb37a2db90431be51508980e93bdefe"} Jun 11 14:28:18.199361 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:18.199283 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-135-108.ec2.internal" podStartSLOduration=4.199261566 podStartE2EDuration="4.199261566s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:28:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:28:18.198636217 +0000 UTC m=+5.531213691" watchObservedRunningTime="2026-06-11 14:28:18.199261566 +0000 UTC m=+5.531839043" Jun 11 14:28:18.677512 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:18.677474 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9286b965-a177-4f5c-97b7-b239fb31c9bb-original-pull-secret\") pod \"global-pull-secret-syncer-fddhk\" (UID: \"9286b965-a177-4f5c-97b7-b239fb31c9bb\") " pod="kube-system/global-pull-secret-syncer-fddhk" Jun 11 14:28:18.677697 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:18.677532 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab181ce2-5bb7-4882-8c14-6409a830fb89-metrics-certs\") pod \"network-metrics-daemon-2wxd2\" (UID: \"ab181ce2-5bb7-4882-8c14-6409a830fb89\") " pod="openshift-multus/network-metrics-daemon-2wxd2" Jun 11 14:28:18.677748 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:18.677701 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:28:18.677797 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:18.677762 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab181ce2-5bb7-4882-8c14-6409a830fb89-metrics-certs podName:ab181ce2-5bb7-4882-8c14-6409a830fb89 nodeName:}" failed. No retries permitted until 2026-06-11 14:28:22.677744378 +0000 UTC m=+10.010321831 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab181ce2-5bb7-4882-8c14-6409a830fb89-metrics-certs") pod "network-metrics-daemon-2wxd2" (UID: "ab181ce2-5bb7-4882-8c14-6409a830fb89") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:28:18.677850 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:18.677826 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:28:18.677898 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:18.677861 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9286b965-a177-4f5c-97b7-b239fb31c9bb-original-pull-secret podName:9286b965-a177-4f5c-97b7-b239fb31c9bb nodeName:}" failed. No retries permitted until 2026-06-11 14:28:22.677848654 +0000 UTC m=+10.010426106 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9286b965-a177-4f5c-97b7-b239fb31c9bb-original-pull-secret") pod "global-pull-secret-syncer-fddhk" (UID: "9286b965-a177-4f5c-97b7-b239fb31c9bb") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:28:18.777873 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:18.777837 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8mfv\" (UniqueName: \"kubernetes.io/projected/aad14df7-79a7-45f8-a84f-5399cf2b54b5-kube-api-access-x8mfv\") pod \"network-check-target-9t6ww\" (UID: \"aad14df7-79a7-45f8-a84f-5399cf2b54b5\") " pod="openshift-network-diagnostics/network-check-target-9t6ww" Jun 11 14:28:18.778069 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:18.778019 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:28:18.778069 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:18.778034 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:28:18.778069 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:18.778043 2574 projected.go:196] Error preparing data for projected volume kube-api-access-x8mfv for pod openshift-network-diagnostics/network-check-target-9t6ww: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:28:18.778246 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:18.778097 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aad14df7-79a7-45f8-a84f-5399cf2b54b5-kube-api-access-x8mfv podName:aad14df7-79a7-45f8-a84f-5399cf2b54b5 nodeName:}" failed. No retries permitted until 2026-06-11 14:28:22.778077649 +0000 UTC m=+10.110655103 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-x8mfv" (UniqueName: "kubernetes.io/projected/aad14df7-79a7-45f8-a84f-5399cf2b54b5-kube-api-access-x8mfv") pod "network-check-target-9t6ww" (UID: "aad14df7-79a7-45f8-a84f-5399cf2b54b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:28:19.108457 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:19.108422 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wxd2" Jun 11 14:28:19.108645 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:19.108551 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wxd2" podUID="ab181ce2-5bb7-4882-8c14-6409a830fb89" Jun 11 14:28:19.108939 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:19.108918 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fddhk" Jun 11 14:28:19.109054 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:19.109027 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fddhk" podUID="9286b965-a177-4f5c-97b7-b239fb31c9bb" Jun 11 14:28:20.106706 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:20.106671 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9t6ww" Jun 11 14:28:20.107237 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:20.106807 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9t6ww" podUID="aad14df7-79a7-45f8-a84f-5399cf2b54b5" Jun 11 14:28:21.107048 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:21.107014 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fddhk" Jun 11 14:28:21.107048 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:21.107047 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wxd2" Jun 11 14:28:21.107581 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:21.107144 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fddhk" podUID="9286b965-a177-4f5c-97b7-b239fb31c9bb" Jun 11 14:28:21.107581 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:21.107276 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wxd2" podUID="ab181ce2-5bb7-4882-8c14-6409a830fb89" Jun 11 14:28:22.106849 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:22.106807 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9t6ww" Jun 11 14:28:22.107042 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:22.106942 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9t6ww" podUID="aad14df7-79a7-45f8-a84f-5399cf2b54b5" Jun 11 14:28:22.706206 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:22.706166 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9286b965-a177-4f5c-97b7-b239fb31c9bb-original-pull-secret\") pod \"global-pull-secret-syncer-fddhk\" (UID: \"9286b965-a177-4f5c-97b7-b239fb31c9bb\") " pod="kube-system/global-pull-secret-syncer-fddhk" Jun 11 14:28:22.706635 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:22.706222 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab181ce2-5bb7-4882-8c14-6409a830fb89-metrics-certs\") pod \"network-metrics-daemon-2wxd2\" (UID: \"ab181ce2-5bb7-4882-8c14-6409a830fb89\") " pod="openshift-multus/network-metrics-daemon-2wxd2" Jun 11 14:28:22.706635 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:22.706405 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:28:22.706635 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:22.706467 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab181ce2-5bb7-4882-8c14-6409a830fb89-metrics-certs podName:ab181ce2-5bb7-4882-8c14-6409a830fb89 nodeName:}" failed. No retries permitted until 2026-06-11 14:28:30.706448034 +0000 UTC m=+18.039025485 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab181ce2-5bb7-4882-8c14-6409a830fb89-metrics-certs") pod "network-metrics-daemon-2wxd2" (UID: "ab181ce2-5bb7-4882-8c14-6409a830fb89") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:28:22.706811 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:22.706790 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:28:22.706928 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:22.706843 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9286b965-a177-4f5c-97b7-b239fb31c9bb-original-pull-secret podName:9286b965-a177-4f5c-97b7-b239fb31c9bb nodeName:}" failed. No retries permitted until 2026-06-11 14:28:30.706827329 +0000 UTC m=+18.039404783 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9286b965-a177-4f5c-97b7-b239fb31c9bb-original-pull-secret") pod "global-pull-secret-syncer-fddhk" (UID: "9286b965-a177-4f5c-97b7-b239fb31c9bb") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:28:22.806674 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:22.806548 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8mfv\" (UniqueName: \"kubernetes.io/projected/aad14df7-79a7-45f8-a84f-5399cf2b54b5-kube-api-access-x8mfv\") pod \"network-check-target-9t6ww\" (UID: \"aad14df7-79a7-45f8-a84f-5399cf2b54b5\") " pod="openshift-network-diagnostics/network-check-target-9t6ww" Jun 11 14:28:22.806829 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:22.806759 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:28:22.806829 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:22.806786 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:28:22.806829 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:22.806800 2574 projected.go:196] Error preparing data for projected volume kube-api-access-x8mfv for pod openshift-network-diagnostics/network-check-target-9t6ww: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:28:22.806995 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:22.806862 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aad14df7-79a7-45f8-a84f-5399cf2b54b5-kube-api-access-x8mfv podName:aad14df7-79a7-45f8-a84f-5399cf2b54b5 nodeName:}" failed. No retries permitted until 2026-06-11 14:28:30.80684333 +0000 UTC m=+18.139420795 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-x8mfv" (UniqueName: "kubernetes.io/projected/aad14df7-79a7-45f8-a84f-5399cf2b54b5-kube-api-access-x8mfv") pod "network-check-target-9t6ww" (UID: "aad14df7-79a7-45f8-a84f-5399cf2b54b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:28:23.108119 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:23.108088 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wxd2" Jun 11 14:28:23.108278 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:23.108211 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wxd2" podUID="ab181ce2-5bb7-4882-8c14-6409a830fb89" Jun 11 14:28:23.108278 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:23.108271 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fddhk" Jun 11 14:28:23.108424 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:23.108368 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fddhk" podUID="9286b965-a177-4f5c-97b7-b239fb31c9bb" Jun 11 14:28:24.107132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:24.106654 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9t6ww" Jun 11 14:28:24.107132 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:24.106783 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9t6ww" podUID="aad14df7-79a7-45f8-a84f-5399cf2b54b5" Jun 11 14:28:25.107363 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:25.107313 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wxd2" Jun 11 14:28:25.107767 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:25.107313 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fddhk" Jun 11 14:28:25.107767 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:25.107493 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wxd2" podUID="ab181ce2-5bb7-4882-8c14-6409a830fb89" Jun 11 14:28:25.107767 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:25.107558 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fddhk" podUID="9286b965-a177-4f5c-97b7-b239fb31c9bb" Jun 11 14:28:26.107488 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:26.107456 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9t6ww" Jun 11 14:28:26.107933 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:26.107573 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9t6ww" podUID="aad14df7-79a7-45f8-a84f-5399cf2b54b5" Jun 11 14:28:27.106888 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:27.106859 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fddhk" Jun 11 14:28:27.107045 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:27.106860 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wxd2" Jun 11 14:28:27.107045 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:27.106991 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fddhk" podUID="9286b965-a177-4f5c-97b7-b239fb31c9bb" Jun 11 14:28:27.107156 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:27.107090 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wxd2" podUID="ab181ce2-5bb7-4882-8c14-6409a830fb89" Jun 11 14:28:28.107254 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:28.107220 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9t6ww" Jun 11 14:28:28.107724 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:28.107375 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9t6ww" podUID="aad14df7-79a7-45f8-a84f-5399cf2b54b5" Jun 11 14:28:29.107533 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:29.107495 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fddhk" Jun 11 14:28:29.107934 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:29.107496 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wxd2" Jun 11 14:28:29.107934 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:29.107652 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fddhk" podUID="9286b965-a177-4f5c-97b7-b239fb31c9bb" Jun 11 14:28:29.107934 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:29.107714 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wxd2" podUID="ab181ce2-5bb7-4882-8c14-6409a830fb89" Jun 11 14:28:30.107712 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:30.107163 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9t6ww" Jun 11 14:28:30.107712 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:30.107296 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9t6ww" podUID="aad14df7-79a7-45f8-a84f-5399cf2b54b5" Jun 11 14:28:30.773171 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:30.772951 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9286b965-a177-4f5c-97b7-b239fb31c9bb-original-pull-secret\") pod \"global-pull-secret-syncer-fddhk\" (UID: \"9286b965-a177-4f5c-97b7-b239fb31c9bb\") " pod="kube-system/global-pull-secret-syncer-fddhk" Jun 11 14:28:30.773284 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:30.773211 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab181ce2-5bb7-4882-8c14-6409a830fb89-metrics-certs\") pod \"network-metrics-daemon-2wxd2\" (UID: \"ab181ce2-5bb7-4882-8c14-6409a830fb89\") " pod="openshift-multus/network-metrics-daemon-2wxd2" Jun 11 14:28:30.773428 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:30.773410 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:28:30.773505 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:30.773487 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab181ce2-5bb7-4882-8c14-6409a830fb89-metrics-certs podName:ab181ce2-5bb7-4882-8c14-6409a830fb89 nodeName:}" failed. No retries permitted until 2026-06-11 14:28:46.773468249 +0000 UTC m=+34.106045719 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab181ce2-5bb7-4882-8c14-6409a830fb89-metrics-certs") pod "network-metrics-daemon-2wxd2" (UID: "ab181ce2-5bb7-4882-8c14-6409a830fb89") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:28:30.773505 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:30.773411 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:28:30.773610 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:30.773554 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9286b965-a177-4f5c-97b7-b239fb31c9bb-original-pull-secret podName:9286b965-a177-4f5c-97b7-b239fb31c9bb nodeName:}" failed. No retries permitted until 2026-06-11 14:28:46.773536823 +0000 UTC m=+34.106114288 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9286b965-a177-4f5c-97b7-b239fb31c9bb-original-pull-secret") pod "global-pull-secret-syncer-fddhk" (UID: "9286b965-a177-4f5c-97b7-b239fb31c9bb") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:28:30.873670 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:30.873638 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8mfv\" (UniqueName: \"kubernetes.io/projected/aad14df7-79a7-45f8-a84f-5399cf2b54b5-kube-api-access-x8mfv\") pod \"network-check-target-9t6ww\" (UID: \"aad14df7-79a7-45f8-a84f-5399cf2b54b5\") " pod="openshift-network-diagnostics/network-check-target-9t6ww" Jun 11 14:28:30.873851 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:30.873786 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:28:30.873851 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:30.873813 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:28:30.873851 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:30.873827 2574 projected.go:196] Error preparing data for projected volume kube-api-access-x8mfv for pod openshift-network-diagnostics/network-check-target-9t6ww: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:28:30.873995 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:30.873885 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aad14df7-79a7-45f8-a84f-5399cf2b54b5-kube-api-access-x8mfv podName:aad14df7-79a7-45f8-a84f-5399cf2b54b5 nodeName:}" failed. No retries permitted until 2026-06-11 14:28:46.873864944 +0000 UTC m=+34.206442411 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-x8mfv" (UniqueName: "kubernetes.io/projected/aad14df7-79a7-45f8-a84f-5399cf2b54b5-kube-api-access-x8mfv") pod "network-check-target-9t6ww" (UID: "aad14df7-79a7-45f8-a84f-5399cf2b54b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:28:31.107511 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:31.107485 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wxd2" Jun 11 14:28:31.107620 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:31.107594 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wxd2" podUID="ab181ce2-5bb7-4882-8c14-6409a830fb89" Jun 11 14:28:31.107682 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:31.107659 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fddhk" Jun 11 14:28:31.107797 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:31.107776 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fddhk" podUID="9286b965-a177-4f5c-97b7-b239fb31c9bb" Jun 11 14:28:31.210869 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:31.210659 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qld5j_37cb9247-f8d1-4b39-a031-89f74f7a8e1b/ovn-acl-logging/0.log" Jun 11 14:28:31.211216 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:31.211191 2574 generic.go:356] "Generic (PLEG): container finished" podID="37cb9247-f8d1-4b39-a031-89f74f7a8e1b" containerID="cbe428be4893ccf6f094e00fc806b8606f6dda01e9ce073eedd97af0f7370434" exitCode=1 Jun 11 14:28:31.211306 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:31.211260 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" event={"ID":"37cb9247-f8d1-4b39-a031-89f74f7a8e1b","Type":"ContainerStarted","Data":"e950b1bfd8e44d0b26514440bf86fc08658e8c73ce8d806e2f260071148e93a5"} Jun 11 14:28:31.211417 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:31.211384 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" event={"ID":"37cb9247-f8d1-4b39-a031-89f74f7a8e1b","Type":"ContainerStarted","Data":"6d403987e037c8dde40f167fd90370b4ef251e86b0ca4005185913718016ae51"} Jun 11 14:28:31.211519 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:31.211442 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" event={"ID":"37cb9247-f8d1-4b39-a031-89f74f7a8e1b","Type":"ContainerDied","Data":"cbe428be4893ccf6f094e00fc806b8606f6dda01e9ce073eedd97af0f7370434"} Jun 11 14:28:31.211519 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:31.211491 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" event={"ID":"37cb9247-f8d1-4b39-a031-89f74f7a8e1b","Type":"ContainerStarted","Data":"09db9bc2d0a1c7fe6b4d25673fecd03a1c381e364130d4c2186f6e130b0f685b"} Jun 11 14:28:31.212818 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:31.212798 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-nw644" event={"ID":"e2e1c881-454a-4129-b1c4-82db9c5f65ed","Type":"ContainerStarted","Data":"e64f5c6a29c2728b95b254b4790d7792d1aae4640781389a11aca3495727f6ab"} Jun 11 14:28:31.214074 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:31.214055 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s82wr" event={"ID":"5295eaf0-10c6-4062-a7c1-38da29c14fe1","Type":"ContainerStarted","Data":"677eed2b1ff70e84a25e987ae456568b755fc821c53f601f91723f5c13ef14e9"} Jun 11 14:28:31.218164 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:31.218137 2574 generic.go:356] "Generic (PLEG): container finished" podID="72644857-34e8-4609-b2f0-6e21db6d182d" containerID="41f38672939f1b694a77caac33a01119855826a79d23d473618b2a1e577f3379" exitCode=0 Jun 11 14:28:31.218249 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:31.218221 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ng4b5" event={"ID":"72644857-34e8-4609-b2f0-6e21db6d182d","Type":"ContainerDied","Data":"41f38672939f1b694a77caac33a01119855826a79d23d473618b2a1e577f3379"} Jun 11 14:28:31.219767 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:31.219749 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" event={"ID":"40408934-44bd-4c56-9c0c-13296258e82b","Type":"ContainerStarted","Data":"d739cecca61fe0276dccceb3a9ebe2754fa4160cb00486c4556c616717df571a"} Jun 11 14:28:31.221115 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:31.221058 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-2vwxx" event={"ID":"92c15579-52ac-4218-a656-1981d234cd34","Type":"ContainerStarted","Data":"9abb3a34107fc7d430ade2275e54a842b591b74af9814e6418b954f16c1ed768"} Jun 11 14:28:31.222502 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:31.222482 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-trm4l" event={"ID":"81420dd7-ea56-423e-af93-80009c14c162","Type":"ContainerStarted","Data":"481f93fcf8c3880c408fd92d22306657bfbad0a4238ee2c888a74d6bafd7f1be"} Jun 11 14:28:31.231267 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:31.231228 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-nw644" podStartSLOduration=3.410454308 podStartE2EDuration="18.231215443s" totalImagesPullingTime="14.820761135s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:28:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:28:31.230918823 +0000 UTC m=+18.563496296" watchObservedRunningTime="2026-06-11 14:28:31.231215443 +0000 UTC m=+18.563792916" Jun 11 14:28:31.265105 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:31.265063 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-2vwxx" podStartSLOduration=3.447431965 podStartE2EDuration="18.265049136s" totalImagesPullingTime="14.817617171s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:28:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:28:31.264708696 +0000 UTC m=+18.597286195" watchObservedRunningTime="2026-06-11 14:28:31.265049136 +0000 UTC m=+18.597626609" Jun 11 14:28:31.280276 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:31.280234 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vnh2f" podStartSLOduration=3.451015985 podStartE2EDuration="18.280218691s" totalImagesPullingTime="14.829202706s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:28:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:28:31.279694581 +0000 UTC m=+18.612272069" watchObservedRunningTime="2026-06-11 14:28:31.280218691 +0000 UTC m=+18.612796164" Jun 11 14:28:31.293907 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:31.293872 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-trm4l" podStartSLOduration=3.682753529 podStartE2EDuration="18.293856908s" totalImagesPullingTime="14.611103379s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:28:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:28:31.293757181 +0000 UTC m=+18.626334657" watchObservedRunningTime="2026-06-11 14:28:31.293856908 +0000 UTC m=+18.626434380" Jun 11 14:28:32.106705 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:32.106673 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9t6ww" Jun 11 14:28:32.106849 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:32.106782 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9t6ww" podUID="aad14df7-79a7-45f8-a84f-5399cf2b54b5" Jun 11 14:28:32.226804 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:32.226767 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-wsq5b" event={"ID":"fc6cedcf-ee56-4afc-a1c3-c702501ccd08","Type":"ContainerStarted","Data":"35f2322b5d58b7925a943ec543dd445e65d462d2936c74a81abb6633bd2ec265"} Jun 11 14:28:32.231553 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:32.231526 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qld5j_37cb9247-f8d1-4b39-a031-89f74f7a8e1b/ovn-acl-logging/0.log" Jun 11 14:28:32.232626 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:32.232393 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" event={"ID":"37cb9247-f8d1-4b39-a031-89f74f7a8e1b","Type":"ContainerStarted","Data":"c870ced459435693c517baabb330a0448fa60d501947f94824dbdc0f88bcec38"} Jun 11 14:28:32.232626 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:32.232481 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" event={"ID":"37cb9247-f8d1-4b39-a031-89f74f7a8e1b","Type":"ContainerStarted","Data":"cfbb98db9a460d78c7489aea015528ead596d0ee6b8d538857b39211a63ffdf2"} Jun 11 14:28:32.244379 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:32.244303 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-wsq5b" podStartSLOduration=4.416978509 podStartE2EDuration="19.244287164s" totalImagesPullingTime="14.827308655s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:28:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:28:32.243731023 +0000 UTC m=+19.576308514" watchObservedRunningTime="2026-06-11 14:28:32.244287164 +0000 UTC m=+19.576864636" Jun 11 14:28:33.115268 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:33.115238 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fddhk" Jun 11 14:28:33.115436 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:33.115242 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wxd2" Jun 11 14:28:33.115436 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:33.115391 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fddhk" podUID="9286b965-a177-4f5c-97b7-b239fb31c9bb" Jun 11 14:28:33.115551 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:33.115452 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wxd2" podUID="ab181ce2-5bb7-4882-8c14-6409a830fb89" Jun 11 14:28:33.688148 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:33.688066 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-trm4l" Jun 11 14:28:33.688611 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:33.688446 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-trm4l" Jun 11 14:28:34.106847 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:34.106809 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9t6ww" Jun 11 14:28:34.107014 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:34.106936 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9t6ww" podUID="aad14df7-79a7-45f8-a84f-5399cf2b54b5" Jun 11 14:28:34.237473 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:34.237441 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-trm4l" Jun 11 14:28:34.238161 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:34.238141 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-trm4l" Jun 11 14:28:35.107582 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:35.107545 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wxd2" Jun 11 14:28:35.108156 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:35.107689 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wxd2" podUID="ab181ce2-5bb7-4882-8c14-6409a830fb89" Jun 11 14:28:35.108156 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:35.108037 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fddhk" Jun 11 14:28:35.108156 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:35.108140 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fddhk" podUID="9286b965-a177-4f5c-97b7-b239fb31c9bb" Jun 11 14:28:36.107313 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:36.107279 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9t6ww" Jun 11 14:28:36.107507 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:36.107409 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9t6ww" podUID="aad14df7-79a7-45f8-a84f-5399cf2b54b5" Jun 11 14:28:37.107278 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:37.107079 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wxd2" Jun 11 14:28:37.107734 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:37.107136 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fddhk" Jun 11 14:28:37.107734 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:37.107414 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wxd2" podUID="ab181ce2-5bb7-4882-8c14-6409a830fb89" Jun 11 14:28:37.107734 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:37.107513 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fddhk" podUID="9286b965-a177-4f5c-97b7-b239fb31c9bb" Jun 11 14:28:38.106935 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:38.106898 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9t6ww" Jun 11 14:28:38.107109 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:38.107034 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9t6ww" podUID="aad14df7-79a7-45f8-a84f-5399cf2b54b5" Jun 11 14:28:38.200712 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:38.200683 2574 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 11 14:28:38.248819 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:38.248788 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qld5j_37cb9247-f8d1-4b39-a031-89f74f7a8e1b/ovn-acl-logging/0.log" Jun 11 14:28:38.249960 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:38.249921 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" event={"ID":"37cb9247-f8d1-4b39-a031-89f74f7a8e1b","Type":"ContainerStarted","Data":"d7dfd779c305bc325df84a7e78446a676bdf43cfc8de4e9fa82695479ba3fc47"} Jun 11 14:28:38.251986 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:38.251961 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s82wr" event={"ID":"5295eaf0-10c6-4062-a7c1-38da29c14fe1","Type":"ContainerStarted","Data":"650e96111b3e2613c9d2d31e3fb916de6e4d970f70a7e86eb531800619a56c7b"} Jun 11 14:28:38.253748 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:38.253725 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ng4b5" event={"ID":"72644857-34e8-4609-b2f0-6e21db6d182d","Type":"ContainerStarted","Data":"9a7ee5e2942e17ff5e60117edebdfb3a9988420a667d4f04d7f231d010e00a01"} Jun 11 14:28:39.107232 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:39.107197 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wxd2" Jun 11 14:28:39.107484 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:39.107200 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fddhk" Jun 11 14:28:39.107484 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:39.107298 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wxd2" podUID="ab181ce2-5bb7-4882-8c14-6409a830fb89" Jun 11 14:28:39.107484 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:39.107395 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fddhk" podUID="9286b965-a177-4f5c-97b7-b239fb31c9bb" Jun 11 14:28:39.107655 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:39.107510 2574 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-11T14:28:38.200709339Z","UUID":"6ce84252-df20-4f77-b24b-88267d56c739","Handler":null,"Name":"","Endpoint":""} Jun 11 14:28:39.108934 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:39.108915 2574 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 11 14:28:39.109050 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:39.108950 2574 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 11 14:28:39.257485 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:39.257389 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-f4zh2" event={"ID":"4586b811-c0d9-48ae-a089-7416a9309720","Type":"ContainerStarted","Data":"e71a4da9aeb78a4e6329ced9f730696df97ecd0ff10947465bbee54f81bcecf8"} Jun 11 14:28:39.259374 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:39.259346 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s82wr" event={"ID":"5295eaf0-10c6-4062-a7c1-38da29c14fe1","Type":"ContainerStarted","Data":"91a9d9b4c8e78e0d8901769c96fabb4c121e7f383ea7d26550d83bc01e0c7cea"} Jun 11 14:28:39.260941 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:39.260918 2574 generic.go:356] "Generic (PLEG): container finished" podID="72644857-34e8-4609-b2f0-6e21db6d182d" containerID="9a7ee5e2942e17ff5e60117edebdfb3a9988420a667d4f04d7f231d010e00a01" exitCode=0 Jun 11 14:28:39.261029 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:39.260954 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ng4b5" event={"ID":"72644857-34e8-4609-b2f0-6e21db6d182d","Type":"ContainerDied","Data":"9a7ee5e2942e17ff5e60117edebdfb3a9988420a667d4f04d7f231d010e00a01"} Jun 11 14:28:39.277610 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:39.277572 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-f4zh2" podStartSLOduration=3.870567168 podStartE2EDuration="26.277560325s" totalImagesPullingTime="22.406993157s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:28:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:28:39.277469475 +0000 UTC m=+26.610046966" watchObservedRunningTime="2026-06-11 14:28:39.277560325 +0000 UTC m=+26.610137825" Jun 11 14:28:39.319366 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:39.319290 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-s82wr" podStartSLOduration=3.569296376 podStartE2EDuration="26.31927596s" totalImagesPullingTime="22.749979584s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:28:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:28:39.318811953 +0000 UTC m=+26.651389436" watchObservedRunningTime="2026-06-11 14:28:39.31927596 +0000 UTC m=+26.651853433" Jun 11 14:28:40.107042 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:40.106862 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9t6ww" Jun 11 14:28:40.107168 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:40.107121 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9t6ww" podUID="aad14df7-79a7-45f8-a84f-5399cf2b54b5" Jun 11 14:28:40.267521 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:40.267193 2574 generic.go:356] "Generic (PLEG): container finished" podID="72644857-34e8-4609-b2f0-6e21db6d182d" containerID="90fa4da8f4586b67a55f8b730b1420d4afa78149e58d2a8c900317de2732eeff" exitCode=0 Jun 11 14:28:40.267521 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:40.267233 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ng4b5" event={"ID":"72644857-34e8-4609-b2f0-6e21db6d182d","Type":"ContainerDied","Data":"90fa4da8f4586b67a55f8b730b1420d4afa78149e58d2a8c900317de2732eeff"} Jun 11 14:28:40.271666 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:40.271613 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qld5j_37cb9247-f8d1-4b39-a031-89f74f7a8e1b/ovn-acl-logging/0.log" Jun 11 14:28:40.272093 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:40.272034 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" event={"ID":"37cb9247-f8d1-4b39-a031-89f74f7a8e1b","Type":"ContainerStarted","Data":"11136fad26b367a2140d2cfca73e950fac53f256d8df820966408a6e46d4009d"} Jun 11 14:28:40.272845 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:40.272769 2574 scope.go:117] "RemoveContainer" containerID="cbe428be4893ccf6f094e00fc806b8606f6dda01e9ce073eedd97af0f7370434" Jun 11 14:28:41.107360 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:41.107309 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wxd2" Jun 11 14:28:41.107596 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:41.107309 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fddhk" Jun 11 14:28:41.107596 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:41.107467 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wxd2" podUID="ab181ce2-5bb7-4882-8c14-6409a830fb89" Jun 11 14:28:41.107596 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:41.107505 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fddhk" podUID="9286b965-a177-4f5c-97b7-b239fb31c9bb" Jun 11 14:28:41.278067 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:41.278040 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qld5j_37cb9247-f8d1-4b39-a031-89f74f7a8e1b/ovn-acl-logging/0.log" Jun 11 14:28:41.278477 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:41.278369 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" event={"ID":"37cb9247-f8d1-4b39-a031-89f74f7a8e1b","Type":"ContainerStarted","Data":"a313ac0399955ca44bde6a0362313ff29b34726027c649a330906d33ab665c9f"} Jun 11 14:28:41.278710 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:41.278679 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:41.278788 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:41.278753 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:41.278849 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:41.278802 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:41.293983 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:41.293943 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:41.294102 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:41.294049 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:28:41.305483 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:41.305441 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" podStartSLOduration=13.430614472 podStartE2EDuration="28.305426286s" totalImagesPullingTime="14.874811814s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:28:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:28:41.304093267 +0000 UTC m=+28.636670756" watchObservedRunningTime="2026-06-11 14:28:41.305426286 +0000 UTC m=+28.638003758" Jun 11 14:28:42.107434 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:42.107234 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9t6ww" Jun 11 14:28:42.107602 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:42.107509 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9t6ww" podUID="aad14df7-79a7-45f8-a84f-5399cf2b54b5" Jun 11 14:28:42.184818 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:42.184787 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2wxd2"] Jun 11 14:28:42.184984 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:42.184947 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wxd2" Jun 11 14:28:42.185083 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:42.185062 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wxd2" podUID="ab181ce2-5bb7-4882-8c14-6409a830fb89" Jun 11 14:28:42.186607 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:42.186584 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fddhk"] Jun 11 14:28:42.186748 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:42.186678 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fddhk" Jun 11 14:28:42.186809 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:42.186767 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fddhk" podUID="9286b965-a177-4f5c-97b7-b239fb31c9bb" Jun 11 14:28:42.190864 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:42.190842 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9t6ww"] Jun 11 14:28:42.283275 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:42.283240 2574 generic.go:356] "Generic (PLEG): container finished" podID="72644857-34e8-4609-b2f0-6e21db6d182d" containerID="54ea56d24751cb0ccfb881143e61334e4e5e7ac6fbf0a2664ea2221431eef9d1" exitCode=0 Jun 11 14:28:42.283666 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:42.283348 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9t6ww" Jun 11 14:28:42.283666 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:42.283319 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ng4b5" event={"ID":"72644857-34e8-4609-b2f0-6e21db6d182d","Type":"ContainerDied","Data":"54ea56d24751cb0ccfb881143e61334e4e5e7ac6fbf0a2664ea2221431eef9d1"} Jun 11 14:28:42.283737 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:42.283654 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9t6ww" podUID="aad14df7-79a7-45f8-a84f-5399cf2b54b5" Jun 11 14:28:44.107142 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:44.107103 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fddhk" Jun 11 14:28:44.107142 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:44.107131 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wxd2" Jun 11 14:28:44.107709 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:44.107205 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9t6ww" Jun 11 14:28:44.107709 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:44.107214 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fddhk" podUID="9286b965-a177-4f5c-97b7-b239fb31c9bb" Jun 11 14:28:44.107709 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:44.107281 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wxd2" podUID="ab181ce2-5bb7-4882-8c14-6409a830fb89" Jun 11 14:28:44.107709 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:44.107358 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9t6ww" podUID="aad14df7-79a7-45f8-a84f-5399cf2b54b5" Jun 11 14:28:46.107056 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:46.107025 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wxd2" Jun 11 14:28:46.107588 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:46.107029 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fddhk" Jun 11 14:28:46.107588 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:46.107121 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wxd2" podUID="ab181ce2-5bb7-4882-8c14-6409a830fb89" Jun 11 14:28:46.107588 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:46.107202 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fddhk" podUID="9286b965-a177-4f5c-97b7-b239fb31c9bb" Jun 11 14:28:46.107588 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:46.107029 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9t6ww" Jun 11 14:28:46.107588 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:46.107282 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9t6ww" podUID="aad14df7-79a7-45f8-a84f-5399cf2b54b5" Jun 11 14:28:46.785859 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:46.785818 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9286b965-a177-4f5c-97b7-b239fb31c9bb-original-pull-secret\") pod \"global-pull-secret-syncer-fddhk\" (UID: \"9286b965-a177-4f5c-97b7-b239fb31c9bb\") " pod="kube-system/global-pull-secret-syncer-fddhk" Jun 11 14:28:46.785859 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:46.785864 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab181ce2-5bb7-4882-8c14-6409a830fb89-metrics-certs\") pod \"network-metrics-daemon-2wxd2\" (UID: \"ab181ce2-5bb7-4882-8c14-6409a830fb89\") " pod="openshift-multus/network-metrics-daemon-2wxd2" Jun 11 14:28:46.786115 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:46.785991 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:28:46.786115 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:46.785991 2574 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 11 14:28:46.786115 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:46.786058 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9286b965-a177-4f5c-97b7-b239fb31c9bb-original-pull-secret podName:9286b965-a177-4f5c-97b7-b239fb31c9bb nodeName:}" failed. No retries permitted until 2026-06-11 14:29:18.786039168 +0000 UTC m=+66.118616637 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/9286b965-a177-4f5c-97b7-b239fb31c9bb-original-pull-secret") pod "global-pull-secret-syncer-fddhk" (UID: "9286b965-a177-4f5c-97b7-b239fb31c9bb") : object "kube-system"/"original-pull-secret" not registered Jun 11 14:28:46.786115 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:46.786073 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab181ce2-5bb7-4882-8c14-6409a830fb89-metrics-certs podName:ab181ce2-5bb7-4882-8c14-6409a830fb89 nodeName:}" failed. No retries permitted until 2026-06-11 14:29:18.786066246 +0000 UTC m=+66.118643697 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab181ce2-5bb7-4882-8c14-6409a830fb89-metrics-certs") pod "network-metrics-daemon-2wxd2" (UID: "ab181ce2-5bb7-4882-8c14-6409a830fb89") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 11 14:28:46.887218 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:46.887180 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8mfv\" (UniqueName: \"kubernetes.io/projected/aad14df7-79a7-45f8-a84f-5399cf2b54b5-kube-api-access-x8mfv\") pod \"network-check-target-9t6ww\" (UID: \"aad14df7-79a7-45f8-a84f-5399cf2b54b5\") " pod="openshift-network-diagnostics/network-check-target-9t6ww" Jun 11 14:28:46.887414 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:46.887371 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 11 14:28:46.887414 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:46.887396 2574 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 11 14:28:46.887414 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:46.887406 2574 projected.go:196] Error preparing data for projected volume kube-api-access-x8mfv for pod openshift-network-diagnostics/network-check-target-9t6ww: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:28:46.887516 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:46.887459 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/aad14df7-79a7-45f8-a84f-5399cf2b54b5-kube-api-access-x8mfv podName:aad14df7-79a7-45f8-a84f-5399cf2b54b5 nodeName:}" failed. No retries permitted until 2026-06-11 14:29:18.887445568 +0000 UTC m=+66.220023019 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-x8mfv" (UniqueName: "kubernetes.io/projected/aad14df7-79a7-45f8-a84f-5399cf2b54b5-kube-api-access-x8mfv") pod "network-check-target-9t6ww" (UID: "aad14df7-79a7-45f8-a84f-5399cf2b54b5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 11 14:28:48.106636 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:48.106610 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wxd2" Jun 11 14:28:48.106636 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:48.106642 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9t6ww" Jun 11 14:28:48.107074 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:48.106610 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fddhk" Jun 11 14:28:48.107074 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:48.106725 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wxd2" podUID="ab181ce2-5bb7-4882-8c14-6409a830fb89" Jun 11 14:28:48.107074 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:48.106821 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9t6ww" podUID="aad14df7-79a7-45f8-a84f-5399cf2b54b5" Jun 11 14:28:48.107074 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:48.106875 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fddhk" podUID="9286b965-a177-4f5c-97b7-b239fb31c9bb" Jun 11 14:28:50.107671 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:50.106981 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fddhk" Jun 11 14:28:50.107671 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:50.107086 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wxd2" Jun 11 14:28:50.107671 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:50.107098 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fddhk" podUID="9286b965-a177-4f5c-97b7-b239fb31c9bb" Jun 11 14:28:50.107671 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:50.107114 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9t6ww" Jun 11 14:28:50.107671 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:50.107203 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wxd2" podUID="ab181ce2-5bb7-4882-8c14-6409a830fb89" Jun 11 14:28:50.107671 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:50.107300 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9t6ww" podUID="aad14df7-79a7-45f8-a84f-5399cf2b54b5" Jun 11 14:28:50.305694 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:50.305504 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ng4b5" event={"ID":"72644857-34e8-4609-b2f0-6e21db6d182d","Type":"ContainerStarted","Data":"aae6045e9efe50fb7f916dc78d1c6da7934b4e18b1c93f239fcca2d6468d578a"} Jun 11 14:28:51.310201 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:51.310122 2574 generic.go:356] "Generic (PLEG): container finished" podID="72644857-34e8-4609-b2f0-6e21db6d182d" containerID="aae6045e9efe50fb7f916dc78d1c6da7934b4e18b1c93f239fcca2d6468d578a" exitCode=0 Jun 11 14:28:51.310201 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:51.310179 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ng4b5" event={"ID":"72644857-34e8-4609-b2f0-6e21db6d182d","Type":"ContainerDied","Data":"aae6045e9efe50fb7f916dc78d1c6da7934b4e18b1c93f239fcca2d6468d578a"} Jun 11 14:28:52.106651 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:52.106565 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wxd2" Jun 11 14:28:52.106820 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:52.106565 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9t6ww" Jun 11 14:28:52.106820 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:52.106673 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2wxd2" podUID="ab181ce2-5bb7-4882-8c14-6409a830fb89" Jun 11 14:28:52.106820 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:52.106565 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fddhk" Jun 11 14:28:52.106820 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:52.106754 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-9t6ww" podUID="aad14df7-79a7-45f8-a84f-5399cf2b54b5" Jun 11 14:28:52.106820 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:52.106810 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fddhk" podUID="9286b965-a177-4f5c-97b7-b239fb31c9bb" Jun 11 14:28:52.315484 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:52.315450 2574 generic.go:356] "Generic (PLEG): container finished" podID="72644857-34e8-4609-b2f0-6e21db6d182d" containerID="92e7001651b9ea3f6694a63e9a9f109a4dc7cf6bdfc3b1d69ddb608d15bc4aef" exitCode=0 Jun 11 14:28:52.315833 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:52.315496 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ng4b5" event={"ID":"72644857-34e8-4609-b2f0-6e21db6d182d","Type":"ContainerDied","Data":"92e7001651b9ea3f6694a63e9a9f109a4dc7cf6bdfc3b1d69ddb608d15bc4aef"} Jun 11 14:28:53.012351 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:53.012305 2574 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-135-108.ec2.internal" event="NodeReady" Jun 11 14:28:53.012575 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:53.012459 2574 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 11 14:28:53.070046 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:53.070012 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-dfxs5"] Jun 11 14:28:53.093676 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:53.093649 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-6qt5g"] Jun 11 14:28:53.093846 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:53.093778 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dfxs5" Jun 11 14:28:53.096673 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:53.096645 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 11 14:28:53.096816 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:53.096659 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lsmch\"" Jun 11 14:28:53.096816 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:53.096791 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 11 14:28:53.117684 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:53.117660 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6qt5g"] Jun 11 14:28:53.117826 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:53.117747 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6qt5g" Jun 11 14:28:53.120167 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:53.120140 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 11 14:28:53.120299 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:53.120170 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-vhswp\"" Jun 11 14:28:53.120299 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:53.120170 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 11 14:28:53.120299 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:53.120175 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 11 14:28:53.120934 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:53.120920 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dfxs5"] Jun 11 14:28:53.231174 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:53.231146 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec9feeb0-c748-4e61-828d-f48ee812ad14-tmp-dir\") pod \"dns-default-dfxs5\" (UID: \"ec9feeb0-c748-4e61-828d-f48ee812ad14\") " pod="openshift-dns/dns-default-dfxs5" Jun 11 14:28:53.231174 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:53.231175 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d770ac0-988e-46c7-a44c-9d74cd45ad3c-cert\") pod \"ingress-canary-6qt5g\" (UID: \"2d770ac0-988e-46c7-a44c-9d74cd45ad3c\") " pod="openshift-ingress-canary/ingress-canary-6qt5g" Jun 11 14:28:53.231378 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:53.231192 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dcxsd\" (UniqueName: \"kubernetes.io/projected/2d770ac0-988e-46c7-a44c-9d74cd45ad3c-kube-api-access-dcxsd\") pod \"ingress-canary-6qt5g\" (UID: \"2d770ac0-988e-46c7-a44c-9d74cd45ad3c\") " pod="openshift-ingress-canary/ingress-canary-6qt5g" Jun 11 14:28:53.231378 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:53.231266 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4g7g\" (UniqueName: \"kubernetes.io/projected/ec9feeb0-c748-4e61-828d-f48ee812ad14-kube-api-access-h4g7g\") pod \"dns-default-dfxs5\" (UID: \"ec9feeb0-c748-4e61-828d-f48ee812ad14\") " pod="openshift-dns/dns-default-dfxs5" Jun 11 14:28:53.231378 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:53.231345 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ec9feeb0-c748-4e61-828d-f48ee812ad14-config-volume\") pod \"dns-default-dfxs5\" (UID: \"ec9feeb0-c748-4e61-828d-f48ee812ad14\") " pod="openshift-dns/dns-default-dfxs5" Jun 11 14:28:53.231378 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:53.231376 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec9feeb0-c748-4e61-828d-f48ee812ad14-metrics-tls\") pod \"dns-default-dfxs5\" (UID: \"ec9feeb0-c748-4e61-828d-f48ee812ad14\") " pod="openshift-dns/dns-default-dfxs5" Jun 11 14:28:53.321016 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:53.320936 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ng4b5" event={"ID":"72644857-34e8-4609-b2f0-6e21db6d182d","Type":"ContainerStarted","Data":"66485abc3b8a36bef341c12b0c5d72eb6628304cd527dc82d2234ec502eaa426"} Jun 11 14:28:53.332363 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:53.332339 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ec9feeb0-c748-4e61-828d-f48ee812ad14-config-volume\") pod \"dns-default-dfxs5\" (UID: \"ec9feeb0-c748-4e61-828d-f48ee812ad14\") " pod="openshift-dns/dns-default-dfxs5" Jun 11 14:28:53.332457 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:53.332380 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec9feeb0-c748-4e61-828d-f48ee812ad14-metrics-tls\") pod \"dns-default-dfxs5\" (UID: \"ec9feeb0-c748-4e61-828d-f48ee812ad14\") " pod="openshift-dns/dns-default-dfxs5" Jun 11 14:28:53.332457 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:53.332400 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec9feeb0-c748-4e61-828d-f48ee812ad14-tmp-dir\") pod \"dns-default-dfxs5\" (UID: \"ec9feeb0-c748-4e61-828d-f48ee812ad14\") " pod="openshift-dns/dns-default-dfxs5" Jun 11 14:28:53.332457 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:53.332414 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d770ac0-988e-46c7-a44c-9d74cd45ad3c-cert\") pod \"ingress-canary-6qt5g\" (UID: \"2d770ac0-988e-46c7-a44c-9d74cd45ad3c\") " pod="openshift-ingress-canary/ingress-canary-6qt5g" Jun 11 14:28:53.332457 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:53.332432 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dcxsd\" (UniqueName: \"kubernetes.io/projected/2d770ac0-988e-46c7-a44c-9d74cd45ad3c-kube-api-access-dcxsd\") pod \"ingress-canary-6qt5g\" (UID: \"2d770ac0-988e-46c7-a44c-9d74cd45ad3c\") " pod="openshift-ingress-canary/ingress-canary-6qt5g" Jun 11 14:28:53.332653 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:53.332567 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:28:53.332653 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:53.332647 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec9feeb0-c748-4e61-828d-f48ee812ad14-metrics-tls podName:ec9feeb0-c748-4e61-828d-f48ee812ad14 nodeName:}" failed. No retries permitted until 2026-06-11 14:28:53.83262673 +0000 UTC m=+41.165204194 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ec9feeb0-c748-4e61-828d-f48ee812ad14-metrics-tls") pod "dns-default-dfxs5" (UID: "ec9feeb0-c748-4e61-828d-f48ee812ad14") : secret "dns-default-metrics-tls" not found Jun 11 14:28:53.332760 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:53.332571 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4g7g\" (UniqueName: \"kubernetes.io/projected/ec9feeb0-c748-4e61-828d-f48ee812ad14-kube-api-access-h4g7g\") pod \"dns-default-dfxs5\" (UID: \"ec9feeb0-c748-4e61-828d-f48ee812ad14\") " pod="openshift-dns/dns-default-dfxs5" Jun 11 14:28:53.332760 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:53.332730 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec9feeb0-c748-4e61-828d-f48ee812ad14-tmp-dir\") pod \"dns-default-dfxs5\" (UID: \"ec9feeb0-c748-4e61-828d-f48ee812ad14\") " pod="openshift-dns/dns-default-dfxs5" Jun 11 14:28:53.332909 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:53.332891 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/ec9feeb0-c748-4e61-828d-f48ee812ad14-config-volume\") pod \"dns-default-dfxs5\" (UID: \"ec9feeb0-c748-4e61-828d-f48ee812ad14\") " pod="openshift-dns/dns-default-dfxs5" Jun 11 14:28:53.336958 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:53.336939 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2d770ac0-988e-46c7-a44c-9d74cd45ad3c-cert\") pod \"ingress-canary-6qt5g\" (UID: \"2d770ac0-988e-46c7-a44c-9d74cd45ad3c\") " pod="openshift-ingress-canary/ingress-canary-6qt5g" Jun 11 14:28:53.340970 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:53.340948 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4g7g\" (UniqueName: \"kubernetes.io/projected/ec9feeb0-c748-4e61-828d-f48ee812ad14-kube-api-access-h4g7g\") pod \"dns-default-dfxs5\" (UID: \"ec9feeb0-c748-4e61-828d-f48ee812ad14\") " pod="openshift-dns/dns-default-dfxs5" Jun 11 14:28:53.341137 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:53.341114 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dcxsd\" (UniqueName: \"kubernetes.io/projected/2d770ac0-988e-46c7-a44c-9d74cd45ad3c-kube-api-access-dcxsd\") pod \"ingress-canary-6qt5g\" (UID: \"2d770ac0-988e-46c7-a44c-9d74cd45ad3c\") " pod="openshift-ingress-canary/ingress-canary-6qt5g" Jun 11 14:28:53.343078 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:53.343023 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ng4b5" podStartSLOduration=9.0965956 podStartE2EDuration="40.343009063s" totalImagesPullingTime="31.246413463s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:28:13 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:28:53.341796003 +0000 UTC m=+40.674373475" watchObservedRunningTime="2026-06-11 14:28:53.343009063 +0000 UTC m=+40.675586538" Jun 11 14:28:53.426086 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:53.426048 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-6qt5g" Jun 11 14:28:53.606375 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:53.606041 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-6qt5g"] Jun 11 14:28:53.610162 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:28:53.610132 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2d770ac0_988e_46c7_a44c_9d74cd45ad3c.slice/crio-788d017d8e9a11c7eeac50070a53cd9f8adcf1d164549ffd51e638d1e6075c76 WatchSource:0}: Error finding container 788d017d8e9a11c7eeac50070a53cd9f8adcf1d164549ffd51e638d1e6075c76: Status 404 returned error can't find the container with id 788d017d8e9a11c7eeac50070a53cd9f8adcf1d164549ffd51e638d1e6075c76 Jun 11 14:28:53.835936 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:53.835904 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec9feeb0-c748-4e61-828d-f48ee812ad14-metrics-tls\") pod \"dns-default-dfxs5\" (UID: \"ec9feeb0-c748-4e61-828d-f48ee812ad14\") " pod="openshift-dns/dns-default-dfxs5" Jun 11 14:28:53.836099 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:53.836063 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:28:53.836142 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:53.836130 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec9feeb0-c748-4e61-828d-f48ee812ad14-metrics-tls podName:ec9feeb0-c748-4e61-828d-f48ee812ad14 nodeName:}" failed. No retries permitted until 2026-06-11 14:28:54.836113084 +0000 UTC m=+42.168690535 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ec9feeb0-c748-4e61-828d-f48ee812ad14-metrics-tls") pod "dns-default-dfxs5" (UID: "ec9feeb0-c748-4e61-828d-f48ee812ad14") : secret "dns-default-metrics-tls" not found Jun 11 14:28:54.107439 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:54.107400 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wxd2" Jun 11 14:28:54.107439 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:54.107443 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9t6ww" Jun 11 14:28:54.107681 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:54.107403 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fddhk" Jun 11 14:28:54.110859 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:54.110835 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 14:28:54.110995 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:54.110868 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 14:28:54.110995 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:54.110938 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 14:28:54.110995 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:54.110838 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zhnzv\"" Jun 11 14:28:54.110995 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:54.110868 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 14:28:54.111201 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:54.110838 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6jqb7\"" Jun 11 14:28:54.324911 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:54.324874 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6qt5g" event={"ID":"2d770ac0-988e-46c7-a44c-9d74cd45ad3c","Type":"ContainerStarted","Data":"788d017d8e9a11c7eeac50070a53cd9f8adcf1d164549ffd51e638d1e6075c76"} Jun 11 14:28:54.843013 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:54.842974 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec9feeb0-c748-4e61-828d-f48ee812ad14-metrics-tls\") pod \"dns-default-dfxs5\" (UID: \"ec9feeb0-c748-4e61-828d-f48ee812ad14\") " pod="openshift-dns/dns-default-dfxs5" Jun 11 14:28:54.843213 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:54.843117 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:28:54.843213 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:54.843200 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec9feeb0-c748-4e61-828d-f48ee812ad14-metrics-tls podName:ec9feeb0-c748-4e61-828d-f48ee812ad14 nodeName:}" failed. No retries permitted until 2026-06-11 14:28:56.843178019 +0000 UTC m=+44.175755484 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ec9feeb0-c748-4e61-828d-f48ee812ad14-metrics-tls") pod "dns-default-dfxs5" (UID: "ec9feeb0-c748-4e61-828d-f48ee812ad14") : secret "dns-default-metrics-tls" not found Jun 11 14:28:56.330240 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:56.330206 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-6qt5g" event={"ID":"2d770ac0-988e-46c7-a44c-9d74cd45ad3c","Type":"ContainerStarted","Data":"77d1287dd7ad04b5d3226f6431ba5b3486497e262d5fd0686dd80bab06e9c9f5"} Jun 11 14:28:56.348209 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:56.348161 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-6qt5g" podStartSLOduration=1.391460192 podStartE2EDuration="3.348147582s" totalImagesPullingTime="1.95668739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:28:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:28:56.347493104 +0000 UTC m=+43.680070576" watchObservedRunningTime="2026-06-11 14:28:56.348147582 +0000 UTC m=+43.680725055" Jun 11 14:28:56.856940 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:28:56.856895 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec9feeb0-c748-4e61-828d-f48ee812ad14-metrics-tls\") pod \"dns-default-dfxs5\" (UID: \"ec9feeb0-c748-4e61-828d-f48ee812ad14\") " pod="openshift-dns/dns-default-dfxs5" Jun 11 14:28:56.857130 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:56.857050 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:28:56.857130 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:28:56.857118 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec9feeb0-c748-4e61-828d-f48ee812ad14-metrics-tls podName:ec9feeb0-c748-4e61-828d-f48ee812ad14 nodeName:}" failed. No retries permitted until 2026-06-11 14:29:00.857101188 +0000 UTC m=+48.189678641 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ec9feeb0-c748-4e61-828d-f48ee812ad14-metrics-tls") pod "dns-default-dfxs5" (UID: "ec9feeb0-c748-4e61-828d-f48ee812ad14") : secret "dns-default-metrics-tls" not found Jun 11 14:29:00.886143 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:29:00.886102 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec9feeb0-c748-4e61-828d-f48ee812ad14-metrics-tls\") pod \"dns-default-dfxs5\" (UID: \"ec9feeb0-c748-4e61-828d-f48ee812ad14\") " pod="openshift-dns/dns-default-dfxs5" Jun 11 14:29:00.886776 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:29:00.886229 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:29:00.886776 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:29:00.886289 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec9feeb0-c748-4e61-828d-f48ee812ad14-metrics-tls podName:ec9feeb0-c748-4e61-828d-f48ee812ad14 nodeName:}" failed. No retries permitted until 2026-06-11 14:29:08.886272414 +0000 UTC m=+56.218849864 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ec9feeb0-c748-4e61-828d-f48ee812ad14-metrics-tls") pod "dns-default-dfxs5" (UID: "ec9feeb0-c748-4e61-828d-f48ee812ad14") : secret "dns-default-metrics-tls" not found Jun 11 14:29:08.945401 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:29:08.945190 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec9feeb0-c748-4e61-828d-f48ee812ad14-metrics-tls\") pod \"dns-default-dfxs5\" (UID: \"ec9feeb0-c748-4e61-828d-f48ee812ad14\") " pod="openshift-dns/dns-default-dfxs5" Jun 11 14:29:08.945401 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:29:08.945386 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:29:08.945854 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:29:08.945467 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec9feeb0-c748-4e61-828d-f48ee812ad14-metrics-tls podName:ec9feeb0-c748-4e61-828d-f48ee812ad14 nodeName:}" failed. No retries permitted until 2026-06-11 14:29:24.945449666 +0000 UTC m=+72.278027119 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ec9feeb0-c748-4e61-828d-f48ee812ad14-metrics-tls") pod "dns-default-dfxs5" (UID: "ec9feeb0-c748-4e61-828d-f48ee812ad14") : secret "dns-default-metrics-tls" not found Jun 11 14:29:13.297146 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:29:13.297117 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-qld5j" Jun 11 14:29:18.816253 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:29:18.816212 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab181ce2-5bb7-4882-8c14-6409a830fb89-metrics-certs\") pod \"network-metrics-daemon-2wxd2\" (UID: \"ab181ce2-5bb7-4882-8c14-6409a830fb89\") " pod="openshift-multus/network-metrics-daemon-2wxd2" Jun 11 14:29:18.816708 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:29:18.816292 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9286b965-a177-4f5c-97b7-b239fb31c9bb-original-pull-secret\") pod \"global-pull-secret-syncer-fddhk\" (UID: \"9286b965-a177-4f5c-97b7-b239fb31c9bb\") " pod="kube-system/global-pull-secret-syncer-fddhk" Jun 11 14:29:18.818900 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:29:18.818876 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 11 14:29:18.819013 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:29:18.818997 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 11 14:29:18.826965 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:29:18.826939 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 14:29:18.827034 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:29:18.827022 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab181ce2-5bb7-4882-8c14-6409a830fb89-metrics-certs podName:ab181ce2-5bb7-4882-8c14-6409a830fb89 nodeName:}" failed. No retries permitted until 2026-06-11 14:30:22.82699727 +0000 UTC m=+130.159574720 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab181ce2-5bb7-4882-8c14-6409a830fb89-metrics-certs") pod "network-metrics-daemon-2wxd2" (UID: "ab181ce2-5bb7-4882-8c14-6409a830fb89") : secret "metrics-daemon-secret" not found Jun 11 14:29:18.830662 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:29:18.830639 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/9286b965-a177-4f5c-97b7-b239fb31c9bb-original-pull-secret\") pod \"global-pull-secret-syncer-fddhk\" (UID: \"9286b965-a177-4f5c-97b7-b239fb31c9bb\") " pod="kube-system/global-pull-secret-syncer-fddhk" Jun 11 14:29:18.916967 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:29:18.916925 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8mfv\" (UniqueName: \"kubernetes.io/projected/aad14df7-79a7-45f8-a84f-5399cf2b54b5-kube-api-access-x8mfv\") pod \"network-check-target-9t6ww\" (UID: \"aad14df7-79a7-45f8-a84f-5399cf2b54b5\") " pod="openshift-network-diagnostics/network-check-target-9t6ww" Jun 11 14:29:18.919618 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:29:18.919599 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 11 14:29:18.929752 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:29:18.929729 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 11 14:29:18.940299 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:29:18.940276 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8mfv\" (UniqueName: \"kubernetes.io/projected/aad14df7-79a7-45f8-a84f-5399cf2b54b5-kube-api-access-x8mfv\") pod \"network-check-target-9t6ww\" (UID: \"aad14df7-79a7-45f8-a84f-5399cf2b54b5\") " pod="openshift-network-diagnostics/network-check-target-9t6ww" Jun 11 14:29:19.030278 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:29:19.030244 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-zhnzv\"" Jun 11 14:29:19.033184 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:29:19.033167 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fddhk" Jun 11 14:29:19.038148 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:29:19.038130 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-9t6ww" Jun 11 14:29:19.194296 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:29:19.194262 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fddhk"] Jun 11 14:29:19.198229 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:29:19.198204 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9286b965_a177_4f5c_97b7_b239fb31c9bb.slice/crio-cdf81fb9a9342668cfcd787e7a74e51c1c28e6117be9caf9b3b558256d32dfa3 WatchSource:0}: Error finding container cdf81fb9a9342668cfcd787e7a74e51c1c28e6117be9caf9b3b558256d32dfa3: Status 404 returned error can't find the container with id cdf81fb9a9342668cfcd787e7a74e51c1c28e6117be9caf9b3b558256d32dfa3 Jun 11 14:29:19.209158 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:29:19.209131 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-9t6ww"] Jun 11 14:29:19.212006 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:29:19.211985 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaad14df7_79a7_45f8_a84f_5399cf2b54b5.slice/crio-8a00cd3d371ce2d3ca7962c8ff4c635f3a9f7049209ce92b1c459f376f452ed0 WatchSource:0}: Error finding container 8a00cd3d371ce2d3ca7962c8ff4c635f3a9f7049209ce92b1c459f376f452ed0: Status 404 returned error can't find the container with id 8a00cd3d371ce2d3ca7962c8ff4c635f3a9f7049209ce92b1c459f376f452ed0 Jun 11 14:29:19.386127 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:29:19.386031 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9t6ww" event={"ID":"aad14df7-79a7-45f8-a84f-5399cf2b54b5","Type":"ContainerStarted","Data":"8a00cd3d371ce2d3ca7962c8ff4c635f3a9f7049209ce92b1c459f376f452ed0"} Jun 11 14:29:19.386992 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:29:19.386971 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fddhk" event={"ID":"9286b965-a177-4f5c-97b7-b239fb31c9bb","Type":"ContainerStarted","Data":"cdf81fb9a9342668cfcd787e7a74e51c1c28e6117be9caf9b3b558256d32dfa3"} Jun 11 14:29:24.402665 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:29:24.402620 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-9t6ww" event={"ID":"aad14df7-79a7-45f8-a84f-5399cf2b54b5","Type":"ContainerStarted","Data":"deab44ea56f687963df8cd50fd99a9e1291729eff3aca1f6d84a6e4c147dfe2f"} Jun 11 14:29:24.403192 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:29:24.402735 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-9t6ww" Jun 11 14:29:24.403974 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:29:24.403945 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fddhk" event={"ID":"9286b965-a177-4f5c-97b7-b239fb31c9bb","Type":"ContainerStarted","Data":"ed826c46754ff855b5b4da555828145f52032198782cbaafcc5ff128517ccbb2"} Jun 11 14:29:24.417609 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:29:24.417566 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-9t6ww" podStartSLOduration=66.823476395 podStartE2EDuration="1m11.417552993s" totalImagesPullingTime="4.594076598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:28:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:29:24.417272525 +0000 UTC m=+71.749849999" watchObservedRunningTime="2026-06-11 14:29:24.417552993 +0000 UTC m=+71.750130465" Jun 11 14:29:24.431522 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:29:24.431478 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fddhk" podStartSLOduration=66.812301879 podStartE2EDuration="1m11.431467293s" totalImagesPullingTime="4.619165414s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:28:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:29:24.431152191 +0000 UTC m=+71.763729693" watchObservedRunningTime="2026-06-11 14:29:24.431467293 +0000 UTC m=+71.764044765" Jun 11 14:29:24.957625 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:29:24.957573 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec9feeb0-c748-4e61-828d-f48ee812ad14-metrics-tls\") pod \"dns-default-dfxs5\" (UID: \"ec9feeb0-c748-4e61-828d-f48ee812ad14\") " pod="openshift-dns/dns-default-dfxs5" Jun 11 14:29:24.957789 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:29:24.957723 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:29:24.957789 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:29:24.957786 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec9feeb0-c748-4e61-828d-f48ee812ad14-metrics-tls podName:ec9feeb0-c748-4e61-828d-f48ee812ad14 nodeName:}" failed. No retries permitted until 2026-06-11 14:29:56.957768925 +0000 UTC m=+104.290346376 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ec9feeb0-c748-4e61-828d-f48ee812ad14-metrics-tls") pod "dns-default-dfxs5" (UID: "ec9feeb0-c748-4e61-828d-f48ee812ad14") : secret "dns-default-metrics-tls" not found Jun 11 14:29:55.409001 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:29:55.408964 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-9t6ww" Jun 11 14:29:56.986272 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:29:56.986233 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec9feeb0-c748-4e61-828d-f48ee812ad14-metrics-tls\") pod \"dns-default-dfxs5\" (UID: \"ec9feeb0-c748-4e61-828d-f48ee812ad14\") " pod="openshift-dns/dns-default-dfxs5" Jun 11 14:29:56.986674 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:29:56.986378 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:29:56.986674 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:29:56.986437 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec9feeb0-c748-4e61-828d-f48ee812ad14-metrics-tls podName:ec9feeb0-c748-4e61-828d-f48ee812ad14 nodeName:}" failed. No retries permitted until 2026-06-11 14:31:00.986422624 +0000 UTC m=+168.319000075 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ec9feeb0-c748-4e61-828d-f48ee812ad14-metrics-tls") pod "dns-default-dfxs5" (UID: "ec9feeb0-c748-4e61-828d-f48ee812ad14") : secret "dns-default-metrics-tls" not found Jun 11 14:30:22.863879 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:30:22.863823 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab181ce2-5bb7-4882-8c14-6409a830fb89-metrics-certs\") pod \"network-metrics-daemon-2wxd2\" (UID: \"ab181ce2-5bb7-4882-8c14-6409a830fb89\") " pod="openshift-multus/network-metrics-daemon-2wxd2" Jun 11 14:30:22.864501 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:30:22.863974 2574 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 11 14:30:22.864501 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:30:22.864052 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ab181ce2-5bb7-4882-8c14-6409a830fb89-metrics-certs podName:ab181ce2-5bb7-4882-8c14-6409a830fb89 nodeName:}" failed. No retries permitted until 2026-06-11 14:32:24.864036702 +0000 UTC m=+252.196614154 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/ab181ce2-5bb7-4882-8c14-6409a830fb89-metrics-certs") pod "network-metrics-daemon-2wxd2" (UID: "ab181ce2-5bb7-4882-8c14-6409a830fb89") : secret "metrics-daemon-secret" not found Jun 11 14:30:56.103988 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:30:56.103927 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dfxs5" podUID="ec9feeb0-c748-4e61-828d-f48ee812ad14" Jun 11 14:30:56.622566 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:30:56.622530 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dfxs5" Jun 11 14:30:57.119640 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:30:57.119603 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2wxd2" podUID="ab181ce2-5bb7-4882-8c14-6409a830fb89" Jun 11 14:31:01.041905 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:01.041818 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec9feeb0-c748-4e61-828d-f48ee812ad14-metrics-tls\") pod \"dns-default-dfxs5\" (UID: \"ec9feeb0-c748-4e61-828d-f48ee812ad14\") " pod="openshift-dns/dns-default-dfxs5" Jun 11 14:31:01.042268 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:31:01.041947 2574 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 11 14:31:01.042268 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:31:01.042019 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec9feeb0-c748-4e61-828d-f48ee812ad14-metrics-tls podName:ec9feeb0-c748-4e61-828d-f48ee812ad14 nodeName:}" failed. No retries permitted until 2026-06-11 14:33:03.042004752 +0000 UTC m=+290.374582203 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/ec9feeb0-c748-4e61-828d-f48ee812ad14-metrics-tls") pod "dns-default-dfxs5" (UID: "ec9feeb0-c748-4e61-828d-f48ee812ad14") : secret "dns-default-metrics-tls" not found Jun 11 14:31:10.107275 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:10.107223 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wxd2" Jun 11 14:31:13.012429 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.012394 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-snjm5"] Jun 11 14:31:13.014120 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.014105 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-snjm5" Jun 11 14:31:13.019704 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.019678 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/69fe43eb-2928-4a64-bbf3-873458af8bcf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-snjm5\" (UID: \"69fe43eb-2928-4a64-bbf3-873458af8bcf\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-snjm5" Jun 11 14:31:13.019853 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.019722 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8x8b\" (UniqueName: \"kubernetes.io/projected/69fe43eb-2928-4a64-bbf3-873458af8bcf-kube-api-access-c8x8b\") pod \"cluster-monitoring-operator-74bbf69bbb-snjm5\" (UID: \"69fe43eb-2928-4a64-bbf3-873458af8bcf\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-snjm5" Jun 11 14:31:13.019853 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.019769 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/69fe43eb-2928-4a64-bbf3-873458af8bcf-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-snjm5\" (UID: \"69fe43eb-2928-4a64-bbf3-873458af8bcf\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-snjm5" Jun 11 14:31:13.021589 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.021567 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jun 11 14:31:13.022396 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.022379 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 11 14:31:13.022443 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.022379 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-r97xs\"" Jun 11 14:31:13.022443 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.022410 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 11 14:31:13.023526 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.023512 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jun 11 14:31:13.048590 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.048557 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-snjm5"] Jun 11 14:31:13.112685 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.112654 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-2tc6n"] Jun 11 14:31:13.114534 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.114517 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-2tc6n" Jun 11 14:31:13.118150 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.118132 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 11 14:31:13.118586 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.118570 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 11 14:31:13.118673 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.118584 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-sjxlj\"" Jun 11 14:31:13.119534 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.119518 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 11 14:31:13.119910 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.119889 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 11 14:31:13.120183 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.120066 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fce79c77-23ab-4a5b-a3a7-3c24efff11b2-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-2tc6n\" (UID: \"fce79c77-23ab-4a5b-a3a7-3c24efff11b2\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-2tc6n" Jun 11 14:31:13.120183 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.120097 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zwvkf\" (UniqueName: \"kubernetes.io/projected/fce79c77-23ab-4a5b-a3a7-3c24efff11b2-kube-api-access-zwvkf\") pod \"service-ca-operator-6bc5ff68f5-2tc6n\" (UID: \"fce79c77-23ab-4a5b-a3a7-3c24efff11b2\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-2tc6n" Jun 11 14:31:13.120183 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.120131 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8x8b\" (UniqueName: \"kubernetes.io/projected/69fe43eb-2928-4a64-bbf3-873458af8bcf-kube-api-access-c8x8b\") pod \"cluster-monitoring-operator-74bbf69bbb-snjm5\" (UID: \"69fe43eb-2928-4a64-bbf3-873458af8bcf\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-snjm5" Jun 11 14:31:13.120183 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.120155 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fce79c77-23ab-4a5b-a3a7-3c24efff11b2-config\") pod \"service-ca-operator-6bc5ff68f5-2tc6n\" (UID: \"fce79c77-23ab-4a5b-a3a7-3c24efff11b2\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-2tc6n" Jun 11 14:31:13.120418 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.120183 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/69fe43eb-2928-4a64-bbf3-873458af8bcf-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-snjm5\" (UID: \"69fe43eb-2928-4a64-bbf3-873458af8bcf\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-snjm5" Jun 11 14:31:13.120418 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.120262 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/69fe43eb-2928-4a64-bbf3-873458af8bcf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-snjm5\" (UID: \"69fe43eb-2928-4a64-bbf3-873458af8bcf\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-snjm5" Jun 11 14:31:13.120530 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:31:13.120443 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 14:31:13.120530 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:31:13.120510 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69fe43eb-2928-4a64-bbf3-873458af8bcf-cluster-monitoring-operator-tls podName:69fe43eb-2928-4a64-bbf3-873458af8bcf nodeName:}" failed. No retries permitted until 2026-06-11 14:31:13.620491852 +0000 UTC m=+180.953069318 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/69fe43eb-2928-4a64-bbf3-873458af8bcf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-snjm5" (UID: "69fe43eb-2928-4a64-bbf3-873458af8bcf") : secret "cluster-monitoring-operator-tls" not found Jun 11 14:31:13.121087 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.121067 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/69fe43eb-2928-4a64-bbf3-873458af8bcf-telemetry-config\") pod \"cluster-monitoring-operator-74bbf69bbb-snjm5\" (UID: \"69fe43eb-2928-4a64-bbf3-873458af8bcf\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-snjm5" Jun 11 14:31:13.127793 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.127772 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-5lpfx"] Jun 11 14:31:13.129672 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.129647 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-97f979f6b-dn7j4"] Jun 11 14:31:13.129792 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.129754 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-5lpfx" Jun 11 14:31:13.131417 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.131400 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-zk897"] Jun 11 14:31:13.131525 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.131498 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" Jun 11 14:31:13.133759 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.133743 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-zk897" Jun 11 14:31:13.163302 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:31:13.163277 2574 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"console-operator-config\" is forbidden: User \"system:node:ip-10-0-135-108.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-console-operator\": no relationship found between node 'ip-10-0-135-108.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" type="*v1.ConfigMap" Jun 11 14:31:13.163615 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.163599 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 11 14:31:13.163725 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.163709 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 11 14:31:13.163934 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.163911 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-hjp7c\"" Jun 11 14:31:13.164156 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.164136 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 11 14:31:13.164213 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.164203 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 11 14:31:13.164295 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.164280 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7zlcj\"" Jun 11 14:31:13.164375 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.164301 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 11 14:31:13.164699 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.164681 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-2tc6n"] Jun 11 14:31:13.165072 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.165061 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-lkxzz\"" Jun 11 14:31:13.165742 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.165728 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 11 14:31:13.166194 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.166177 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8x8b\" (UniqueName: \"kubernetes.io/projected/69fe43eb-2928-4a64-bbf3-873458af8bcf-kube-api-access-c8x8b\") pod \"cluster-monitoring-operator-74bbf69bbb-snjm5\" (UID: \"69fe43eb-2928-4a64-bbf3-873458af8bcf\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-snjm5" Jun 11 14:31:13.185475 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.185448 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-5lpfx"] Jun 11 14:31:13.186285 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.186262 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-97f979f6b-dn7j4"] Jun 11 14:31:13.189067 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.189046 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 11 14:31:13.196594 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.196573 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 11 14:31:13.206067 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.206043 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-zk897"] Jun 11 14:31:13.221245 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.221221 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n92vl\" (UniqueName: \"kubernetes.io/projected/795bdcf7-7613-4244-8f8d-63765372b55a-kube-api-access-n92vl\") pod \"network-check-source-dbd9cf844-zk897\" (UID: \"795bdcf7-7613-4244-8f8d-63765372b55a\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-zk897" Jun 11 14:31:13.221394 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.221255 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5400b75f-e955-4173-87e0-baa03165be20-image-registry-private-configuration\") pod \"image-registry-97f979f6b-dn7j4\" (UID: \"5400b75f-e955-4173-87e0-baa03165be20\") " pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" Jun 11 14:31:13.221394 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.221280 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5400b75f-e955-4173-87e0-baa03165be20-trusted-ca\") pod \"image-registry-97f979f6b-dn7j4\" (UID: \"5400b75f-e955-4173-87e0-baa03165be20\") " pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" Jun 11 14:31:13.221394 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.221341 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c3a99230-0749-4f98-97a8-cd9f586e529e-config\") pod \"console-operator-668fdbf85c-5lpfx\" (UID: \"c3a99230-0749-4f98-97a8-cd9f586e529e\") " pod="openshift-console-operator/console-operator-668fdbf85c-5lpfx" Jun 11 14:31:13.221394 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.221392 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c3a99230-0749-4f98-97a8-cd9f586e529e-serving-cert\") pod \"console-operator-668fdbf85c-5lpfx\" (UID: \"c3a99230-0749-4f98-97a8-cd9f586e529e\") " pod="openshift-console-operator/console-operator-668fdbf85c-5lpfx" Jun 11 14:31:13.221553 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.221408 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj4qg\" (UniqueName: \"kubernetes.io/projected/c3a99230-0749-4f98-97a8-cd9f586e529e-kube-api-access-qj4qg\") pod \"console-operator-668fdbf85c-5lpfx\" (UID: \"c3a99230-0749-4f98-97a8-cd9f586e529e\") " pod="openshift-console-operator/console-operator-668fdbf85c-5lpfx" Jun 11 14:31:13.221553 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.221435 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5400b75f-e955-4173-87e0-baa03165be20-registry-certificates\") pod \"image-registry-97f979f6b-dn7j4\" (UID: \"5400b75f-e955-4173-87e0-baa03165be20\") " pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" Jun 11 14:31:13.221553 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.221453 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5400b75f-e955-4173-87e0-baa03165be20-ca-trust-extracted\") pod \"image-registry-97f979f6b-dn7j4\" (UID: \"5400b75f-e955-4173-87e0-baa03165be20\") " pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" Jun 11 14:31:13.221553 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.221522 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fce79c77-23ab-4a5b-a3a7-3c24efff11b2-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-2tc6n\" (UID: \"fce79c77-23ab-4a5b-a3a7-3c24efff11b2\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-2tc6n" Jun 11 14:31:13.221553 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.221546 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zwvkf\" (UniqueName: \"kubernetes.io/projected/fce79c77-23ab-4a5b-a3a7-3c24efff11b2-kube-api-access-zwvkf\") pod \"service-ca-operator-6bc5ff68f5-2tc6n\" (UID: \"fce79c77-23ab-4a5b-a3a7-3c24efff11b2\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-2tc6n" Jun 11 14:31:13.221711 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.221574 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5400b75f-e955-4173-87e0-baa03165be20-bound-sa-token\") pod \"image-registry-97f979f6b-dn7j4\" (UID: \"5400b75f-e955-4173-87e0-baa03165be20\") " pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" Jun 11 14:31:13.221711 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.221594 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fce79c77-23ab-4a5b-a3a7-3c24efff11b2-config\") pod \"service-ca-operator-6bc5ff68f5-2tc6n\" (UID: \"fce79c77-23ab-4a5b-a3a7-3c24efff11b2\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-2tc6n" Jun 11 14:31:13.221711 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.221610 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5400b75f-e955-4173-87e0-baa03165be20-registry-tls\") pod \"image-registry-97f979f6b-dn7j4\" (UID: \"5400b75f-e955-4173-87e0-baa03165be20\") " pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" Jun 11 14:31:13.221711 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.221649 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5400b75f-e955-4173-87e0-baa03165be20-installation-pull-secrets\") pod \"image-registry-97f979f6b-dn7j4\" (UID: \"5400b75f-e955-4173-87e0-baa03165be20\") " pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" Jun 11 14:31:13.221711 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.221674 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5659\" (UniqueName: \"kubernetes.io/projected/5400b75f-e955-4173-87e0-baa03165be20-kube-api-access-l5659\") pod \"image-registry-97f979f6b-dn7j4\" (UID: \"5400b75f-e955-4173-87e0-baa03165be20\") " pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" Jun 11 14:31:13.221873 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.221711 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c3a99230-0749-4f98-97a8-cd9f586e529e-trusted-ca\") pod \"console-operator-668fdbf85c-5lpfx\" (UID: \"c3a99230-0749-4f98-97a8-cd9f586e529e\") " pod="openshift-console-operator/console-operator-668fdbf85c-5lpfx" Jun 11 14:31:13.222147 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.222131 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/fce79c77-23ab-4a5b-a3a7-3c24efff11b2-config\") pod \"service-ca-operator-6bc5ff68f5-2tc6n\" (UID: \"fce79c77-23ab-4a5b-a3a7-3c24efff11b2\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-2tc6n" Jun 11 14:31:13.223844 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.223818 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/fce79c77-23ab-4a5b-a3a7-3c24efff11b2-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-2tc6n\" (UID: \"fce79c77-23ab-4a5b-a3a7-3c24efff11b2\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-2tc6n" Jun 11 14:31:13.232188 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.232162 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zwvkf\" (UniqueName: \"kubernetes.io/projected/fce79c77-23ab-4a5b-a3a7-3c24efff11b2-kube-api-access-zwvkf\") pod \"service-ca-operator-6bc5ff68f5-2tc6n\" (UID: \"fce79c77-23ab-4a5b-a3a7-3c24efff11b2\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-2tc6n" Jun 11 14:31:13.322345 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.322242 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n92vl\" (UniqueName: \"kubernetes.io/projected/795bdcf7-7613-4244-8f8d-63765372b55a-kube-api-access-n92vl\") pod \"network-check-source-dbd9cf844-zk897\" (UID: \"795bdcf7-7613-4244-8f8d-63765372b55a\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-zk897" Jun 11 14:31:13.322345 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.322274 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5400b75f-e955-4173-87e0-baa03165be20-image-registry-private-configuration\") pod \"image-registry-97f979f6b-dn7j4\" (UID: \"5400b75f-e955-4173-87e0-baa03165be20\") " pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" Jun 11 14:31:13.322345 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.322292 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5400b75f-e955-4173-87e0-baa03165be20-trusted-ca\") pod \"image-registry-97f979f6b-dn7j4\" (UID: \"5400b75f-e955-4173-87e0-baa03165be20\") " pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" Jun 11 14:31:13.322345 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.322308 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c3a99230-0749-4f98-97a8-cd9f586e529e-config\") pod \"console-operator-668fdbf85c-5lpfx\" (UID: \"c3a99230-0749-4f98-97a8-cd9f586e529e\") " pod="openshift-console-operator/console-operator-668fdbf85c-5lpfx" Jun 11 14:31:13.322664 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.322470 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c3a99230-0749-4f98-97a8-cd9f586e529e-serving-cert\") pod \"console-operator-668fdbf85c-5lpfx\" (UID: \"c3a99230-0749-4f98-97a8-cd9f586e529e\") " pod="openshift-console-operator/console-operator-668fdbf85c-5lpfx" Jun 11 14:31:13.322664 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.322502 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj4qg\" (UniqueName: \"kubernetes.io/projected/c3a99230-0749-4f98-97a8-cd9f586e529e-kube-api-access-qj4qg\") pod \"console-operator-668fdbf85c-5lpfx\" (UID: \"c3a99230-0749-4f98-97a8-cd9f586e529e\") " pod="openshift-console-operator/console-operator-668fdbf85c-5lpfx" Jun 11 14:31:13.322664 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.322551 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5400b75f-e955-4173-87e0-baa03165be20-registry-certificates\") pod \"image-registry-97f979f6b-dn7j4\" (UID: \"5400b75f-e955-4173-87e0-baa03165be20\") " pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" Jun 11 14:31:13.322664 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.322579 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5400b75f-e955-4173-87e0-baa03165be20-ca-trust-extracted\") pod \"image-registry-97f979f6b-dn7j4\" (UID: \"5400b75f-e955-4173-87e0-baa03165be20\") " pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" Jun 11 14:31:13.322883 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.322708 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5400b75f-e955-4173-87e0-baa03165be20-bound-sa-token\") pod \"image-registry-97f979f6b-dn7j4\" (UID: \"5400b75f-e955-4173-87e0-baa03165be20\") " pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" Jun 11 14:31:13.322883 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.322752 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5400b75f-e955-4173-87e0-baa03165be20-registry-tls\") pod \"image-registry-97f979f6b-dn7j4\" (UID: \"5400b75f-e955-4173-87e0-baa03165be20\") " pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" Jun 11 14:31:13.322883 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.322808 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5400b75f-e955-4173-87e0-baa03165be20-installation-pull-secrets\") pod \"image-registry-97f979f6b-dn7j4\" (UID: \"5400b75f-e955-4173-87e0-baa03165be20\") " pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" Jun 11 14:31:13.322883 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.322838 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5659\" (UniqueName: \"kubernetes.io/projected/5400b75f-e955-4173-87e0-baa03165be20-kube-api-access-l5659\") pod \"image-registry-97f979f6b-dn7j4\" (UID: \"5400b75f-e955-4173-87e0-baa03165be20\") " pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" Jun 11 14:31:13.323099 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.322902 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c3a99230-0749-4f98-97a8-cd9f586e529e-trusted-ca\") pod \"console-operator-668fdbf85c-5lpfx\" (UID: \"c3a99230-0749-4f98-97a8-cd9f586e529e\") " pod="openshift-console-operator/console-operator-668fdbf85c-5lpfx" Jun 11 14:31:13.323099 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.322947 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5400b75f-e955-4173-87e0-baa03165be20-ca-trust-extracted\") pod \"image-registry-97f979f6b-dn7j4\" (UID: \"5400b75f-e955-4173-87e0-baa03165be20\") " pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" Jun 11 14:31:13.323099 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:31:13.323029 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 14:31:13.323099 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:31:13.323044 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-97f979f6b-dn7j4: secret "image-registry-tls" not found Jun 11 14:31:13.323099 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:31:13.323093 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5400b75f-e955-4173-87e0-baa03165be20-registry-tls podName:5400b75f-e955-4173-87e0-baa03165be20 nodeName:}" failed. No retries permitted until 2026-06-11 14:31:13.823076861 +0000 UTC m=+181.155654320 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5400b75f-e955-4173-87e0-baa03165be20-registry-tls") pod "image-registry-97f979f6b-dn7j4" (UID: "5400b75f-e955-4173-87e0-baa03165be20") : secret "image-registry-tls" not found Jun 11 14:31:13.323570 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.323249 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5400b75f-e955-4173-87e0-baa03165be20-registry-certificates\") pod \"image-registry-97f979f6b-dn7j4\" (UID: \"5400b75f-e955-4173-87e0-baa03165be20\") " pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" Jun 11 14:31:13.323661 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.323637 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5400b75f-e955-4173-87e0-baa03165be20-trusted-ca\") pod \"image-registry-97f979f6b-dn7j4\" (UID: \"5400b75f-e955-4173-87e0-baa03165be20\") " pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" Jun 11 14:31:13.323962 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.323939 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c3a99230-0749-4f98-97a8-cd9f586e529e-trusted-ca\") pod \"console-operator-668fdbf85c-5lpfx\" (UID: \"c3a99230-0749-4f98-97a8-cd9f586e529e\") " pod="openshift-console-operator/console-operator-668fdbf85c-5lpfx" Jun 11 14:31:13.324966 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.324946 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c3a99230-0749-4f98-97a8-cd9f586e529e-serving-cert\") pod \"console-operator-668fdbf85c-5lpfx\" (UID: \"c3a99230-0749-4f98-97a8-cd9f586e529e\") " pod="openshift-console-operator/console-operator-668fdbf85c-5lpfx" Jun 11 14:31:13.325075 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.325037 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5400b75f-e955-4173-87e0-baa03165be20-image-registry-private-configuration\") pod \"image-registry-97f979f6b-dn7j4\" (UID: \"5400b75f-e955-4173-87e0-baa03165be20\") " pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" Jun 11 14:31:13.325219 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.325201 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5400b75f-e955-4173-87e0-baa03165be20-installation-pull-secrets\") pod \"image-registry-97f979f6b-dn7j4\" (UID: \"5400b75f-e955-4173-87e0-baa03165be20\") " pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" Jun 11 14:31:13.331780 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.331754 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n92vl\" (UniqueName: \"kubernetes.io/projected/795bdcf7-7613-4244-8f8d-63765372b55a-kube-api-access-n92vl\") pod \"network-check-source-dbd9cf844-zk897\" (UID: \"795bdcf7-7613-4244-8f8d-63765372b55a\") " pod="openshift-network-diagnostics/network-check-source-dbd9cf844-zk897" Jun 11 14:31:13.332036 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.332017 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj4qg\" (UniqueName: \"kubernetes.io/projected/c3a99230-0749-4f98-97a8-cd9f586e529e-kube-api-access-qj4qg\") pod \"console-operator-668fdbf85c-5lpfx\" (UID: \"c3a99230-0749-4f98-97a8-cd9f586e529e\") " pod="openshift-console-operator/console-operator-668fdbf85c-5lpfx" Jun 11 14:31:13.336081 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.332771 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5400b75f-e955-4173-87e0-baa03165be20-bound-sa-token\") pod \"image-registry-97f979f6b-dn7j4\" (UID: \"5400b75f-e955-4173-87e0-baa03165be20\") " pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" Jun 11 14:31:13.336081 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.332993 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5659\" (UniqueName: \"kubernetes.io/projected/5400b75f-e955-4173-87e0-baa03165be20-kube-api-access-l5659\") pod \"image-registry-97f979f6b-dn7j4\" (UID: \"5400b75f-e955-4173-87e0-baa03165be20\") " pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" Jun 11 14:31:13.422772 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.422725 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-2tc6n" Jun 11 14:31:13.449180 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.449145 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-zk897" Jun 11 14:31:13.558070 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.558041 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-2tc6n"] Jun 11 14:31:13.560572 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:31:13.560539 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfce79c77_23ab_4a5b_a3a7_3c24efff11b2.slice/crio-45c23a8d1e5fb4357a429b7a1f54f189e2f7f01b87985c18a143c7b4eb54aa26 WatchSource:0}: Error finding container 45c23a8d1e5fb4357a429b7a1f54f189e2f7f01b87985c18a143c7b4eb54aa26: Status 404 returned error can't find the container with id 45c23a8d1e5fb4357a429b7a1f54f189e2f7f01b87985c18a143c7b4eb54aa26 Jun 11 14:31:13.581894 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.581871 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-dbd9cf844-zk897"] Jun 11 14:31:13.583978 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:31:13.583954 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod795bdcf7_7613_4244_8f8d_63765372b55a.slice/crio-96647583ecfa92b7819c12d5a6350f581bdbabbbe65e59835edd8cb4d632786f WatchSource:0}: Error finding container 96647583ecfa92b7819c12d5a6350f581bdbabbbe65e59835edd8cb4d632786f: Status 404 returned error can't find the container with id 96647583ecfa92b7819c12d5a6350f581bdbabbbe65e59835edd8cb4d632786f Jun 11 14:31:13.625647 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.625619 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/69fe43eb-2928-4a64-bbf3-873458af8bcf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-snjm5\" (UID: \"69fe43eb-2928-4a64-bbf3-873458af8bcf\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-snjm5" Jun 11 14:31:13.625777 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:31:13.625714 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 14:31:13.625777 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:31:13.625765 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69fe43eb-2928-4a64-bbf3-873458af8bcf-cluster-monitoring-operator-tls podName:69fe43eb-2928-4a64-bbf3-873458af8bcf nodeName:}" failed. No retries permitted until 2026-06-11 14:31:14.625752272 +0000 UTC m=+181.958329722 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/69fe43eb-2928-4a64-bbf3-873458af8bcf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-snjm5" (UID: "69fe43eb-2928-4a64-bbf3-873458af8bcf") : secret "cluster-monitoring-operator-tls" not found Jun 11 14:31:13.663374 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.663320 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-zk897" event={"ID":"795bdcf7-7613-4244-8f8d-63765372b55a","Type":"ContainerStarted","Data":"675f5e439710669b9f9ed8ba62587fede32cd4ce63a875ae85fb04fb4d8d02b8"} Jun 11 14:31:13.663533 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.663404 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-zk897" event={"ID":"795bdcf7-7613-4244-8f8d-63765372b55a","Type":"ContainerStarted","Data":"96647583ecfa92b7819c12d5a6350f581bdbabbbe65e59835edd8cb4d632786f"} Jun 11 14:31:13.664616 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.664578 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-2tc6n" event={"ID":"fce79c77-23ab-4a5b-a3a7-3c24efff11b2","Type":"ContainerStarted","Data":"45c23a8d1e5fb4357a429b7a1f54f189e2f7f01b87985c18a143c7b4eb54aa26"} Jun 11 14:31:13.678027 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.677966 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-dbd9cf844-zk897" podStartSLOduration=0.677950973 podStartE2EDuration="677.950973ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:31:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:31:13.677153781 +0000 UTC m=+181.009731254" watchObservedRunningTime="2026-06-11 14:31:13.677950973 +0000 UTC m=+181.010528471" Jun 11 14:31:13.827113 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:13.827078 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5400b75f-e955-4173-87e0-baa03165be20-registry-tls\") pod \"image-registry-97f979f6b-dn7j4\" (UID: \"5400b75f-e955-4173-87e0-baa03165be20\") " pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" Jun 11 14:31:13.827293 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:31:13.827256 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 14:31:13.827293 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:31:13.827278 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-97f979f6b-dn7j4: secret "image-registry-tls" not found Jun 11 14:31:13.827421 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:31:13.827358 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5400b75f-e955-4173-87e0-baa03165be20-registry-tls podName:5400b75f-e955-4173-87e0-baa03165be20 nodeName:}" failed. No retries permitted until 2026-06-11 14:31:14.82731875 +0000 UTC m=+182.159896200 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5400b75f-e955-4173-87e0-baa03165be20-registry-tls") pod "image-registry-97f979f6b-dn7j4" (UID: "5400b75f-e955-4173-87e0-baa03165be20") : secret "image-registry-tls" not found Jun 11 14:31:14.202229 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:14.202195 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 11 14:31:14.203051 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:14.203016 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c3a99230-0749-4f98-97a8-cd9f586e529e-config\") pod \"console-operator-668fdbf85c-5lpfx\" (UID: \"c3a99230-0749-4f98-97a8-cd9f586e529e\") " pod="openshift-console-operator/console-operator-668fdbf85c-5lpfx" Jun 11 14:31:14.339247 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:14.339207 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-5lpfx" Jun 11 14:31:14.491754 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:14.491700 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-5lpfx"] Jun 11 14:31:14.495144 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:31:14.495110 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3a99230_0749_4f98_97a8_cd9f586e529e.slice/crio-a65749ab8788494f5da7ada0ba4c2e63e0d0b29b9c8c3e51b133a9d2d330f479 WatchSource:0}: Error finding container a65749ab8788494f5da7ada0ba4c2e63e0d0b29b9c8c3e51b133a9d2d330f479: Status 404 returned error can't find the container with id a65749ab8788494f5da7ada0ba4c2e63e0d0b29b9c8c3e51b133a9d2d330f479 Jun 11 14:31:14.635856 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:14.635826 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/69fe43eb-2928-4a64-bbf3-873458af8bcf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-snjm5\" (UID: \"69fe43eb-2928-4a64-bbf3-873458af8bcf\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-snjm5" Jun 11 14:31:14.636032 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:31:14.635952 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 14:31:14.636032 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:31:14.636028 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69fe43eb-2928-4a64-bbf3-873458af8bcf-cluster-monitoring-operator-tls podName:69fe43eb-2928-4a64-bbf3-873458af8bcf nodeName:}" failed. No retries permitted until 2026-06-11 14:31:16.636012799 +0000 UTC m=+183.968590250 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/69fe43eb-2928-4a64-bbf3-873458af8bcf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-snjm5" (UID: "69fe43eb-2928-4a64-bbf3-873458af8bcf") : secret "cluster-monitoring-operator-tls" not found Jun 11 14:31:14.668783 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:14.668745 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-5lpfx" event={"ID":"c3a99230-0749-4f98-97a8-cd9f586e529e","Type":"ContainerStarted","Data":"a65749ab8788494f5da7ada0ba4c2e63e0d0b29b9c8c3e51b133a9d2d330f479"} Jun 11 14:31:14.838106 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:14.838031 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5400b75f-e955-4173-87e0-baa03165be20-registry-tls\") pod \"image-registry-97f979f6b-dn7j4\" (UID: \"5400b75f-e955-4173-87e0-baa03165be20\") " pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" Jun 11 14:31:14.838243 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:31:14.838133 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 14:31:14.838243 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:31:14.838144 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-97f979f6b-dn7j4: secret "image-registry-tls" not found Jun 11 14:31:14.838243 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:31:14.838194 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5400b75f-e955-4173-87e0-baa03165be20-registry-tls podName:5400b75f-e955-4173-87e0-baa03165be20 nodeName:}" failed. No retries permitted until 2026-06-11 14:31:16.83817952 +0000 UTC m=+184.170756972 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5400b75f-e955-4173-87e0-baa03165be20-registry-tls") pod "image-registry-97f979f6b-dn7j4" (UID: "5400b75f-e955-4173-87e0-baa03165be20") : secret "image-registry-tls" not found Jun 11 14:31:16.654188 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:16.654148 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/69fe43eb-2928-4a64-bbf3-873458af8bcf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-snjm5\" (UID: \"69fe43eb-2928-4a64-bbf3-873458af8bcf\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-snjm5" Jun 11 14:31:16.654673 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:31:16.654394 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 14:31:16.654673 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:31:16.654476 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69fe43eb-2928-4a64-bbf3-873458af8bcf-cluster-monitoring-operator-tls podName:69fe43eb-2928-4a64-bbf3-873458af8bcf nodeName:}" failed. No retries permitted until 2026-06-11 14:31:20.654455568 +0000 UTC m=+187.987033042 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/69fe43eb-2928-4a64-bbf3-873458af8bcf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-snjm5" (UID: "69fe43eb-2928-4a64-bbf3-873458af8bcf") : secret "cluster-monitoring-operator-tls" not found Jun 11 14:31:16.677237 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:16.677202 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-2tc6n" event={"ID":"fce79c77-23ab-4a5b-a3a7-3c24efff11b2","Type":"ContainerStarted","Data":"b0f94a7d03313e58fbc9644bfb6f14e3d3d733cd46a6d9381b5789d8b499f523"} Jun 11 14:31:16.693270 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:16.693214 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-2tc6n" podStartSLOduration=1.519948121 podStartE2EDuration="3.693195829s" totalImagesPullingTime="2.173247708s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:31:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:31:16.693169906 +0000 UTC m=+184.025747380" watchObservedRunningTime="2026-06-11 14:31:16.693195829 +0000 UTC m=+184.025773304" Jun 11 14:31:16.856459 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:16.856412 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5400b75f-e955-4173-87e0-baa03165be20-registry-tls\") pod \"image-registry-97f979f6b-dn7j4\" (UID: \"5400b75f-e955-4173-87e0-baa03165be20\") " pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" Jun 11 14:31:16.856635 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:31:16.856598 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 14:31:16.856635 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:31:16.856625 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-97f979f6b-dn7j4: secret "image-registry-tls" not found Jun 11 14:31:16.856730 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:31:16.856693 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5400b75f-e955-4173-87e0-baa03165be20-registry-tls podName:5400b75f-e955-4173-87e0-baa03165be20 nodeName:}" failed. No retries permitted until 2026-06-11 14:31:20.856672826 +0000 UTC m=+188.189250285 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5400b75f-e955-4173-87e0-baa03165be20-registry-tls") pod "image-registry-97f979f6b-dn7j4" (UID: "5400b75f-e955-4173-87e0-baa03165be20") : secret "image-registry-tls" not found Jun 11 14:31:17.687023 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:17.686995 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5lpfx_c3a99230-0749-4f98-97a8-cd9f586e529e/console-operator/0.log" Jun 11 14:31:17.687504 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:17.687033 2574 generic.go:356] "Generic (PLEG): container finished" podID="c3a99230-0749-4f98-97a8-cd9f586e529e" containerID="6be368e003e0a7bd5bc8e5ae8351c904716240edf57e7a72e65c5289244be4c0" exitCode=255 Jun 11 14:31:17.687504 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:17.687068 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-5lpfx" event={"ID":"c3a99230-0749-4f98-97a8-cd9f586e529e","Type":"ContainerDied","Data":"6be368e003e0a7bd5bc8e5ae8351c904716240edf57e7a72e65c5289244be4c0"} Jun 11 14:31:17.687504 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:17.687396 2574 scope.go:117] "RemoveContainer" containerID="6be368e003e0a7bd5bc8e5ae8351c904716240edf57e7a72e65c5289244be4c0" Jun 11 14:31:18.692374 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:18.692346 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5lpfx_c3a99230-0749-4f98-97a8-cd9f586e529e/console-operator/1.log" Jun 11 14:31:18.692809 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:18.692792 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5lpfx_c3a99230-0749-4f98-97a8-cd9f586e529e/console-operator/0.log" Jun 11 14:31:18.692853 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:18.692834 2574 generic.go:356] "Generic (PLEG): container finished" podID="c3a99230-0749-4f98-97a8-cd9f586e529e" containerID="20d12a572e4d9eefd96e96fc10ca1aa643073eab40ba333fce5debeb5c356e91" exitCode=255 Jun 11 14:31:18.692927 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:18.692903 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-5lpfx" event={"ID":"c3a99230-0749-4f98-97a8-cd9f586e529e","Type":"ContainerDied","Data":"20d12a572e4d9eefd96e96fc10ca1aa643073eab40ba333fce5debeb5c356e91"} Jun 11 14:31:18.692985 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:18.692964 2574 scope.go:117] "RemoveContainer" containerID="6be368e003e0a7bd5bc8e5ae8351c904716240edf57e7a72e65c5289244be4c0" Jun 11 14:31:18.693197 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:18.693170 2574 scope.go:117] "RemoveContainer" containerID="20d12a572e4d9eefd96e96fc10ca1aa643073eab40ba333fce5debeb5c356e91" Jun 11 14:31:18.693405 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:31:18.693387 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-5lpfx_openshift-console-operator(c3a99230-0749-4f98-97a8-cd9f586e529e)\"" pod="openshift-console-operator/console-operator-668fdbf85c-5lpfx" podUID="c3a99230-0749-4f98-97a8-cd9f586e529e" Jun 11 14:31:18.728199 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:18.728175 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-74pkt"] Jun 11 14:31:18.730792 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:18.730776 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-74pkt" Jun 11 14:31:18.733509 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:18.733482 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 11 14:31:18.733509 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:18.733487 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 11 14:31:18.733684 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:18.733668 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-fkcdn\"" Jun 11 14:31:18.741973 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:18.741953 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-74pkt"] Jun 11 14:31:18.771245 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:18.771210 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zd9gj\" (UniqueName: \"kubernetes.io/projected/7ed2c89b-c0c8-4aa8-9145-fb8f08e22b38-kube-api-access-zd9gj\") pod \"migrator-955ffdf5f-74pkt\" (UID: \"7ed2c89b-c0c8-4aa8-9145-fb8f08e22b38\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-74pkt" Jun 11 14:31:18.872453 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:18.872404 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zd9gj\" (UniqueName: \"kubernetes.io/projected/7ed2c89b-c0c8-4aa8-9145-fb8f08e22b38-kube-api-access-zd9gj\") pod \"migrator-955ffdf5f-74pkt\" (UID: \"7ed2c89b-c0c8-4aa8-9145-fb8f08e22b38\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-74pkt" Jun 11 14:31:18.880730 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:18.880700 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zd9gj\" (UniqueName: \"kubernetes.io/projected/7ed2c89b-c0c8-4aa8-9145-fb8f08e22b38-kube-api-access-zd9gj\") pod \"migrator-955ffdf5f-74pkt\" (UID: \"7ed2c89b-c0c8-4aa8-9145-fb8f08e22b38\") " pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-74pkt" Jun 11 14:31:19.039246 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:19.039210 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-74pkt" Jun 11 14:31:19.164233 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:19.164202 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-955ffdf5f-74pkt"] Jun 11 14:31:19.167509 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:31:19.167477 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ed2c89b_c0c8_4aa8_9145_fb8f08e22b38.slice/crio-101313dc380137645b782344a645a106d3228c50aad30dcfe4a7830672c1d1e8 WatchSource:0}: Error finding container 101313dc380137645b782344a645a106d3228c50aad30dcfe4a7830672c1d1e8: Status 404 returned error can't find the container with id 101313dc380137645b782344a645a106d3228c50aad30dcfe4a7830672c1d1e8 Jun 11 14:31:19.509668 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:19.509640 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nw644_e2e1c881-454a-4129-b1c4-82db9c5f65ed/dns-node-resolver/0.log" Jun 11 14:31:19.588897 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:19.588861 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-z9gnb"] Jun 11 14:31:19.591424 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:19.591403 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-z9gnb" Jun 11 14:31:19.595406 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:19.595384 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 11 14:31:19.595504 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:19.595442 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 11 14:31:19.596473 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:19.596454 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-7pn2j\"" Jun 11 14:31:19.596569 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:19.596458 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 11 14:31:19.596569 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:19.596494 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 11 14:31:19.609014 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:19.608992 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-z9gnb"] Jun 11 14:31:19.679201 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:19.679168 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qrjn4\" (UniqueName: \"kubernetes.io/projected/19e81b66-e03f-4a70-8dbe-93c33e169304-kube-api-access-qrjn4\") pod \"service-ca-7d74d578b8-z9gnb\" (UID: \"19e81b66-e03f-4a70-8dbe-93c33e169304\") " pod="openshift-service-ca/service-ca-7d74d578b8-z9gnb" Jun 11 14:31:19.679409 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:19.679207 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/19e81b66-e03f-4a70-8dbe-93c33e169304-signing-key\") pod \"service-ca-7d74d578b8-z9gnb\" (UID: \"19e81b66-e03f-4a70-8dbe-93c33e169304\") " pod="openshift-service-ca/service-ca-7d74d578b8-z9gnb" Jun 11 14:31:19.679409 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:19.679224 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/19e81b66-e03f-4a70-8dbe-93c33e169304-signing-cabundle\") pod \"service-ca-7d74d578b8-z9gnb\" (UID: \"19e81b66-e03f-4a70-8dbe-93c33e169304\") " pod="openshift-service-ca/service-ca-7d74d578b8-z9gnb" Jun 11 14:31:19.696721 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:19.696689 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-74pkt" event={"ID":"7ed2c89b-c0c8-4aa8-9145-fb8f08e22b38","Type":"ContainerStarted","Data":"101313dc380137645b782344a645a106d3228c50aad30dcfe4a7830672c1d1e8"} Jun 11 14:31:19.697980 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:19.697964 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5lpfx_c3a99230-0749-4f98-97a8-cd9f586e529e/console-operator/1.log" Jun 11 14:31:19.698284 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:19.698262 2574 scope.go:117] "RemoveContainer" containerID="20d12a572e4d9eefd96e96fc10ca1aa643073eab40ba333fce5debeb5c356e91" Jun 11 14:31:19.698459 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:31:19.698441 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-5lpfx_openshift-console-operator(c3a99230-0749-4f98-97a8-cd9f586e529e)\"" pod="openshift-console-operator/console-operator-668fdbf85c-5lpfx" podUID="c3a99230-0749-4f98-97a8-cd9f586e529e" Jun 11 14:31:19.780259 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:19.780167 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qrjn4\" (UniqueName: \"kubernetes.io/projected/19e81b66-e03f-4a70-8dbe-93c33e169304-kube-api-access-qrjn4\") pod \"service-ca-7d74d578b8-z9gnb\" (UID: \"19e81b66-e03f-4a70-8dbe-93c33e169304\") " pod="openshift-service-ca/service-ca-7d74d578b8-z9gnb" Jun 11 14:31:19.780259 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:19.780208 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/19e81b66-e03f-4a70-8dbe-93c33e169304-signing-key\") pod \"service-ca-7d74d578b8-z9gnb\" (UID: \"19e81b66-e03f-4a70-8dbe-93c33e169304\") " pod="openshift-service-ca/service-ca-7d74d578b8-z9gnb" Jun 11 14:31:19.780259 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:19.780229 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/19e81b66-e03f-4a70-8dbe-93c33e169304-signing-cabundle\") pod \"service-ca-7d74d578b8-z9gnb\" (UID: \"19e81b66-e03f-4a70-8dbe-93c33e169304\") " pod="openshift-service-ca/service-ca-7d74d578b8-z9gnb" Jun 11 14:31:19.780905 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:19.780882 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/19e81b66-e03f-4a70-8dbe-93c33e169304-signing-cabundle\") pod \"service-ca-7d74d578b8-z9gnb\" (UID: \"19e81b66-e03f-4a70-8dbe-93c33e169304\") " pod="openshift-service-ca/service-ca-7d74d578b8-z9gnb" Jun 11 14:31:19.782766 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:19.782743 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/19e81b66-e03f-4a70-8dbe-93c33e169304-signing-key\") pod \"service-ca-7d74d578b8-z9gnb\" (UID: \"19e81b66-e03f-4a70-8dbe-93c33e169304\") " pod="openshift-service-ca/service-ca-7d74d578b8-z9gnb" Jun 11 14:31:19.787906 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:19.787888 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qrjn4\" (UniqueName: \"kubernetes.io/projected/19e81b66-e03f-4a70-8dbe-93c33e169304-kube-api-access-qrjn4\") pod \"service-ca-7d74d578b8-z9gnb\" (UID: \"19e81b66-e03f-4a70-8dbe-93c33e169304\") " pod="openshift-service-ca/service-ca-7d74d578b8-z9gnb" Jun 11 14:31:19.900509 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:19.900471 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-z9gnb" Jun 11 14:31:20.033091 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:20.033004 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-z9gnb"] Jun 11 14:31:20.035886 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:31:20.035855 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19e81b66_e03f_4a70_8dbe_93c33e169304.slice/crio-2ddf9b89115fbb5d7ee0ccb1307b19b4c7826d7684f7ef82c624e58618eb3866 WatchSource:0}: Error finding container 2ddf9b89115fbb5d7ee0ccb1307b19b4c7826d7684f7ef82c624e58618eb3866: Status 404 returned error can't find the container with id 2ddf9b89115fbb5d7ee0ccb1307b19b4c7826d7684f7ef82c624e58618eb3866 Jun 11 14:31:20.296798 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:20.296721 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2vwxx_92c15579-52ac-4218-a656-1981d234cd34/node-ca/0.log" Jun 11 14:31:20.692681 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:20.692596 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/69fe43eb-2928-4a64-bbf3-873458af8bcf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-snjm5\" (UID: \"69fe43eb-2928-4a64-bbf3-873458af8bcf\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-snjm5" Jun 11 14:31:20.692816 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:31:20.692749 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 14:31:20.692860 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:31:20.692817 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69fe43eb-2928-4a64-bbf3-873458af8bcf-cluster-monitoring-operator-tls podName:69fe43eb-2928-4a64-bbf3-873458af8bcf nodeName:}" failed. No retries permitted until 2026-06-11 14:31:28.692802218 +0000 UTC m=+196.025379673 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/69fe43eb-2928-4a64-bbf3-873458af8bcf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-snjm5" (UID: "69fe43eb-2928-4a64-bbf3-873458af8bcf") : secret "cluster-monitoring-operator-tls" not found Jun 11 14:31:20.703284 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:20.703250 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-z9gnb" event={"ID":"19e81b66-e03f-4a70-8dbe-93c33e169304","Type":"ContainerStarted","Data":"6831af20309f30923d85b70bcff223251358d24465983f5e63b14b6034bffcdd"} Jun 11 14:31:20.703687 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:20.703304 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-z9gnb" event={"ID":"19e81b66-e03f-4a70-8dbe-93c33e169304","Type":"ContainerStarted","Data":"2ddf9b89115fbb5d7ee0ccb1307b19b4c7826d7684f7ef82c624e58618eb3866"} Jun 11 14:31:20.723085 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:20.723045 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-z9gnb" podStartSLOduration=1.723031984 podStartE2EDuration="1.723031984s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:31:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:31:20.722426504 +0000 UTC m=+188.055004020" watchObservedRunningTime="2026-06-11 14:31:20.723031984 +0000 UTC m=+188.055609457" Jun 11 14:31:20.894593 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:20.894561 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5400b75f-e955-4173-87e0-baa03165be20-registry-tls\") pod \"image-registry-97f979f6b-dn7j4\" (UID: \"5400b75f-e955-4173-87e0-baa03165be20\") " pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" Jun 11 14:31:20.894732 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:31:20.894676 2574 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 11 14:31:20.894732 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:31:20.894687 2574 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-97f979f6b-dn7j4: secret "image-registry-tls" not found Jun 11 14:31:20.894831 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:31:20.894735 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/5400b75f-e955-4173-87e0-baa03165be20-registry-tls podName:5400b75f-e955-4173-87e0-baa03165be20 nodeName:}" failed. No retries permitted until 2026-06-11 14:31:28.894720179 +0000 UTC m=+196.227297630 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/5400b75f-e955-4173-87e0-baa03165be20-registry-tls") pod "image-registry-97f979f6b-dn7j4" (UID: "5400b75f-e955-4173-87e0-baa03165be20") : secret "image-registry-tls" not found Jun 11 14:31:21.297378 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:21.297354 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6qt5g_2d770ac0-988e-46c7-a44c-9d74cd45ad3c/serve-healthcheck-canary/0.log" Jun 11 14:31:21.708437 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:21.708339 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-74pkt" event={"ID":"7ed2c89b-c0c8-4aa8-9145-fb8f08e22b38","Type":"ContainerStarted","Data":"eb39891d7e8cca37c04862f8a52d9d23a3e179e95731f1df4dbc3da12fb016eb"} Jun 11 14:31:21.708437 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:21.708402 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-74pkt" event={"ID":"7ed2c89b-c0c8-4aa8-9145-fb8f08e22b38","Type":"ContainerStarted","Data":"697b8f75e3e0dbf4a72cb076fa477ae089e3616cbf944f8432e79a4ec0483c0c"} Jun 11 14:31:21.725960 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:21.725888 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-955ffdf5f-74pkt" podStartSLOduration=2.162930541 podStartE2EDuration="3.725874474s" totalImagesPullingTime="1.562943933s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:31:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:31:21.725151626 +0000 UTC m=+189.057729100" watchObservedRunningTime="2026-06-11 14:31:21.725874474 +0000 UTC m=+189.058451946" Jun 11 14:31:24.340031 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:24.340001 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-5lpfx" Jun 11 14:31:24.340386 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:24.340056 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-5lpfx" Jun 11 14:31:24.340445 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:24.340405 2574 scope.go:117] "RemoveContainer" containerID="20d12a572e4d9eefd96e96fc10ca1aa643073eab40ba333fce5debeb5c356e91" Jun 11 14:31:24.340582 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:31:24.340561 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-5lpfx_openshift-console-operator(c3a99230-0749-4f98-97a8-cd9f586e529e)\"" pod="openshift-console-operator/console-operator-668fdbf85c-5lpfx" podUID="c3a99230-0749-4f98-97a8-cd9f586e529e" Jun 11 14:31:28.758236 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:28.758184 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/69fe43eb-2928-4a64-bbf3-873458af8bcf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-snjm5\" (UID: \"69fe43eb-2928-4a64-bbf3-873458af8bcf\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-snjm5" Jun 11 14:31:28.758686 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:31:28.758305 2574 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jun 11 14:31:28.758686 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:31:28.758378 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69fe43eb-2928-4a64-bbf3-873458af8bcf-cluster-monitoring-operator-tls podName:69fe43eb-2928-4a64-bbf3-873458af8bcf nodeName:}" failed. No retries permitted until 2026-06-11 14:31:44.758364717 +0000 UTC m=+212.090942168 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/69fe43eb-2928-4a64-bbf3-873458af8bcf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-74bbf69bbb-snjm5" (UID: "69fe43eb-2928-4a64-bbf3-873458af8bcf") : secret "cluster-monitoring-operator-tls" not found Jun 11 14:31:28.959907 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:28.959854 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5400b75f-e955-4173-87e0-baa03165be20-registry-tls\") pod \"image-registry-97f979f6b-dn7j4\" (UID: \"5400b75f-e955-4173-87e0-baa03165be20\") " pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" Jun 11 14:31:28.962464 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:28.962434 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5400b75f-e955-4173-87e0-baa03165be20-registry-tls\") pod \"image-registry-97f979f6b-dn7j4\" (UID: \"5400b75f-e955-4173-87e0-baa03165be20\") " pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" Jun 11 14:31:29.045348 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:29.045241 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" Jun 11 14:31:29.173674 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:29.173641 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-97f979f6b-dn7j4"] Jun 11 14:31:29.177817 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:31:29.177789 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5400b75f_e955_4173_87e0_baa03165be20.slice/crio-5bb6b98d20a13f989bcbb028a6ad07d786d09874f53fce811168477f3629e9c7 WatchSource:0}: Error finding container 5bb6b98d20a13f989bcbb028a6ad07d786d09874f53fce811168477f3629e9c7: Status 404 returned error can't find the container with id 5bb6b98d20a13f989bcbb028a6ad07d786d09874f53fce811168477f3629e9c7 Jun 11 14:31:29.735085 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:29.735046 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" event={"ID":"5400b75f-e955-4173-87e0-baa03165be20","Type":"ContainerStarted","Data":"cde1ce1f8ee6882cb026658ed7393819aac26705052310b5a3b682a736f76251"} Jun 11 14:31:29.735270 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:29.735102 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" event={"ID":"5400b75f-e955-4173-87e0-baa03165be20","Type":"ContainerStarted","Data":"5bb6b98d20a13f989bcbb028a6ad07d786d09874f53fce811168477f3629e9c7"} Jun 11 14:31:29.735270 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:29.735138 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" Jun 11 14:31:29.757044 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:29.756993 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" podStartSLOduration=16.756974304 podStartE2EDuration="16.756974304s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:31:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:31:29.755898373 +0000 UTC m=+197.088475845" watchObservedRunningTime="2026-06-11 14:31:29.756974304 +0000 UTC m=+197.089551778" Jun 11 14:31:35.106956 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:35.106924 2574 scope.go:117] "RemoveContainer" containerID="20d12a572e4d9eefd96e96fc10ca1aa643073eab40ba333fce5debeb5c356e91" Jun 11 14:31:35.755651 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:35.755621 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5lpfx_c3a99230-0749-4f98-97a8-cd9f586e529e/console-operator/2.log" Jun 11 14:31:35.755999 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:35.755984 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5lpfx_c3a99230-0749-4f98-97a8-cd9f586e529e/console-operator/1.log" Jun 11 14:31:35.756050 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:35.756020 2574 generic.go:356] "Generic (PLEG): container finished" podID="c3a99230-0749-4f98-97a8-cd9f586e529e" containerID="d768060368c2c11a79b806e6fe425da1a9f6a66c3ae75afbb4fa3ef799905625" exitCode=255 Jun 11 14:31:35.756088 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:35.756070 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-5lpfx" event={"ID":"c3a99230-0749-4f98-97a8-cd9f586e529e","Type":"ContainerDied","Data":"d768060368c2c11a79b806e6fe425da1a9f6a66c3ae75afbb4fa3ef799905625"} Jun 11 14:31:35.756166 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:35.756154 2574 scope.go:117] "RemoveContainer" containerID="20d12a572e4d9eefd96e96fc10ca1aa643073eab40ba333fce5debeb5c356e91" Jun 11 14:31:35.756502 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:35.756481 2574 scope.go:117] "RemoveContainer" containerID="d768060368c2c11a79b806e6fe425da1a9f6a66c3ae75afbb4fa3ef799905625" Jun 11 14:31:35.756692 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:31:35.756671 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-5lpfx_openshift-console-operator(c3a99230-0749-4f98-97a8-cd9f586e529e)\"" pod="openshift-console-operator/console-operator-668fdbf85c-5lpfx" podUID="c3a99230-0749-4f98-97a8-cd9f586e529e" Jun 11 14:31:36.760827 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:36.760801 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5lpfx_c3a99230-0749-4f98-97a8-cd9f586e529e/console-operator/2.log" Jun 11 14:31:44.220231 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:44.220185 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-97f979f6b-dn7j4"] Jun 11 14:31:44.224509 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:44.224466 2574 patch_prober.go:28] interesting pod/image-registry-97f979f6b-dn7j4 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 14:31:44.224652 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:44.224526 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" podUID="5400b75f-e955-4173-87e0-baa03165be20" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 14:31:44.272516 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:44.272476 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wgxm6"] Jun 11 14:31:44.277149 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:44.277128 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wgxm6" Jun 11 14:31:44.279960 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:44.279928 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-wgv5n\"" Jun 11 14:31:44.280109 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:44.280081 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 11 14:31:44.280179 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:44.280162 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 11 14:31:44.280409 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:44.280393 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 11 14:31:44.280500 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:44.280413 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 11 14:31:44.297970 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:44.297944 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wgxm6"] Jun 11 14:31:44.340189 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:44.340158 2574 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-5lpfx" Jun 11 14:31:44.340393 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:44.340209 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-5lpfx" Jun 11 14:31:44.340655 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:44.340640 2574 scope.go:117] "RemoveContainer" containerID="d768060368c2c11a79b806e6fe425da1a9f6a66c3ae75afbb4fa3ef799905625" Jun 11 14:31:44.340825 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:31:44.340794 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-668fdbf85c-5lpfx_openshift-console-operator(c3a99230-0749-4f98-97a8-cd9f586e529e)\"" pod="openshift-console-operator/console-operator-668fdbf85c-5lpfx" podUID="c3a99230-0749-4f98-97a8-cd9f586e529e" Jun 11 14:31:44.375476 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:44.375447 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ccc09ef-7e11-4824-8da7-69bea1be972d-data-volume\") pod \"insights-runtime-extractor-wgxm6\" (UID: \"1ccc09ef-7e11-4824-8da7-69bea1be972d\") " pod="openshift-insights/insights-runtime-extractor-wgxm6" Jun 11 14:31:44.375673 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:44.375485 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1ccc09ef-7e11-4824-8da7-69bea1be972d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wgxm6\" (UID: \"1ccc09ef-7e11-4824-8da7-69bea1be972d\") " pod="openshift-insights/insights-runtime-extractor-wgxm6" Jun 11 14:31:44.375673 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:44.375528 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1ccc09ef-7e11-4824-8da7-69bea1be972d-crio-socket\") pod \"insights-runtime-extractor-wgxm6\" (UID: \"1ccc09ef-7e11-4824-8da7-69bea1be972d\") " pod="openshift-insights/insights-runtime-extractor-wgxm6" Jun 11 14:31:44.375673 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:44.375597 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1ccc09ef-7e11-4824-8da7-69bea1be972d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wgxm6\" (UID: \"1ccc09ef-7e11-4824-8da7-69bea1be972d\") " pod="openshift-insights/insights-runtime-extractor-wgxm6" Jun 11 14:31:44.375673 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:44.375647 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sgkx\" (UniqueName: \"kubernetes.io/projected/1ccc09ef-7e11-4824-8da7-69bea1be972d-kube-api-access-8sgkx\") pod \"insights-runtime-extractor-wgxm6\" (UID: \"1ccc09ef-7e11-4824-8da7-69bea1be972d\") " pod="openshift-insights/insights-runtime-extractor-wgxm6" Jun 11 14:31:44.476381 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:44.476262 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1ccc09ef-7e11-4824-8da7-69bea1be972d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wgxm6\" (UID: \"1ccc09ef-7e11-4824-8da7-69bea1be972d\") " pod="openshift-insights/insights-runtime-extractor-wgxm6" Jun 11 14:31:44.476381 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:44.476304 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sgkx\" (UniqueName: \"kubernetes.io/projected/1ccc09ef-7e11-4824-8da7-69bea1be972d-kube-api-access-8sgkx\") pod \"insights-runtime-extractor-wgxm6\" (UID: \"1ccc09ef-7e11-4824-8da7-69bea1be972d\") " pod="openshift-insights/insights-runtime-extractor-wgxm6" Jun 11 14:31:44.476618 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:44.476392 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ccc09ef-7e11-4824-8da7-69bea1be972d-data-volume\") pod \"insights-runtime-extractor-wgxm6\" (UID: \"1ccc09ef-7e11-4824-8da7-69bea1be972d\") " pod="openshift-insights/insights-runtime-extractor-wgxm6" Jun 11 14:31:44.476618 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:44.476419 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1ccc09ef-7e11-4824-8da7-69bea1be972d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wgxm6\" (UID: \"1ccc09ef-7e11-4824-8da7-69bea1be972d\") " pod="openshift-insights/insights-runtime-extractor-wgxm6" Jun 11 14:31:44.476618 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:44.476499 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1ccc09ef-7e11-4824-8da7-69bea1be972d-crio-socket\") pod \"insights-runtime-extractor-wgxm6\" (UID: \"1ccc09ef-7e11-4824-8da7-69bea1be972d\") " pod="openshift-insights/insights-runtime-extractor-wgxm6" Jun 11 14:31:44.476618 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:44.476614 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/1ccc09ef-7e11-4824-8da7-69bea1be972d-crio-socket\") pod \"insights-runtime-extractor-wgxm6\" (UID: \"1ccc09ef-7e11-4824-8da7-69bea1be972d\") " pod="openshift-insights/insights-runtime-extractor-wgxm6" Jun 11 14:31:44.476936 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:44.476912 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/1ccc09ef-7e11-4824-8da7-69bea1be972d-data-volume\") pod \"insights-runtime-extractor-wgxm6\" (UID: \"1ccc09ef-7e11-4824-8da7-69bea1be972d\") " pod="openshift-insights/insights-runtime-extractor-wgxm6" Jun 11 14:31:44.477081 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:44.477063 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/1ccc09ef-7e11-4824-8da7-69bea1be972d-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wgxm6\" (UID: \"1ccc09ef-7e11-4824-8da7-69bea1be972d\") " pod="openshift-insights/insights-runtime-extractor-wgxm6" Jun 11 14:31:44.478865 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:44.478841 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/1ccc09ef-7e11-4824-8da7-69bea1be972d-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wgxm6\" (UID: \"1ccc09ef-7e11-4824-8da7-69bea1be972d\") " pod="openshift-insights/insights-runtime-extractor-wgxm6" Jun 11 14:31:44.486537 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:44.486513 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sgkx\" (UniqueName: \"kubernetes.io/projected/1ccc09ef-7e11-4824-8da7-69bea1be972d-kube-api-access-8sgkx\") pod \"insights-runtime-extractor-wgxm6\" (UID: \"1ccc09ef-7e11-4824-8da7-69bea1be972d\") " pod="openshift-insights/insights-runtime-extractor-wgxm6" Jun 11 14:31:44.585929 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:44.585897 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wgxm6" Jun 11 14:31:44.727093 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:44.727070 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wgxm6"] Jun 11 14:31:44.729115 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:31:44.729089 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ccc09ef_7e11_4824_8da7_69bea1be972d.slice/crio-3b82c5d18262ea2147773c3de5226cc4d7758a0c7c6d623044132905a3b1f824 WatchSource:0}: Error finding container 3b82c5d18262ea2147773c3de5226cc4d7758a0c7c6d623044132905a3b1f824: Status 404 returned error can't find the container with id 3b82c5d18262ea2147773c3de5226cc4d7758a0c7c6d623044132905a3b1f824 Jun 11 14:31:44.779075 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:44.779042 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/69fe43eb-2928-4a64-bbf3-873458af8bcf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-snjm5\" (UID: \"69fe43eb-2928-4a64-bbf3-873458af8bcf\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-snjm5" Jun 11 14:31:44.781509 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:44.781492 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/69fe43eb-2928-4a64-bbf3-873458af8bcf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-74bbf69bbb-snjm5\" (UID: \"69fe43eb-2928-4a64-bbf3-873458af8bcf\") " pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-snjm5" Jun 11 14:31:44.784982 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:44.784947 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wgxm6" event={"ID":"1ccc09ef-7e11-4824-8da7-69bea1be972d","Type":"ContainerStarted","Data":"3b82c5d18262ea2147773c3de5226cc4d7758a0c7c6d623044132905a3b1f824"} Jun 11 14:31:44.822687 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:44.822652 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-snjm5" Jun 11 14:31:44.969035 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:44.968997 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-snjm5"] Jun 11 14:31:44.972161 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:31:44.972135 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69fe43eb_2928_4a64_bbf3_873458af8bcf.slice/crio-96a550b267b95994f2a46b033bfcfcad233db0444aab40583dda7dc435bfd9a9 WatchSource:0}: Error finding container 96a550b267b95994f2a46b033bfcfcad233db0444aab40583dda7dc435bfd9a9: Status 404 returned error can't find the container with id 96a550b267b95994f2a46b033bfcfcad233db0444aab40583dda7dc435bfd9a9 Jun 11 14:31:45.794348 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:45.794290 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wgxm6" event={"ID":"1ccc09ef-7e11-4824-8da7-69bea1be972d","Type":"ContainerStarted","Data":"fd8f7f19e3daf295f5090dc1c84b22c0209e1676d6085b2d92092e0096b46180"} Jun 11 14:31:45.794789 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:45.794402 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wgxm6" event={"ID":"1ccc09ef-7e11-4824-8da7-69bea1be972d","Type":"ContainerStarted","Data":"5a808e3e02d55b6ef77c68eabb6a8a45bbdc9382bdbe64e5dd41fe80383a0a01"} Jun 11 14:31:45.795661 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:45.795635 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-snjm5" event={"ID":"69fe43eb-2928-4a64-bbf3-873458af8bcf","Type":"ContainerStarted","Data":"96a550b267b95994f2a46b033bfcfcad233db0444aab40583dda7dc435bfd9a9"} Jun 11 14:31:47.805793 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:47.805753 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wgxm6" event={"ID":"1ccc09ef-7e11-4824-8da7-69bea1be972d","Type":"ContainerStarted","Data":"95fb886a882e748ba7d9b13a04d0d69069bf608758ff29fed4b1413f9e8e4f86"} Jun 11 14:31:47.807318 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:47.807286 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-snjm5" event={"ID":"69fe43eb-2928-4a64-bbf3-873458af8bcf","Type":"ContainerStarted","Data":"b0a3338f803599d7d3fa6415f01c094a6ff55f3b4d3e8e525ac5ea2d79005861"} Jun 11 14:31:47.851527 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:47.851469 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-74bbf69bbb-snjm5" podStartSLOduration=33.53175531 podStartE2EDuration="35.851450719s" totalImagesPullingTime="2.319695409s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:31:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:31:47.851010643 +0000 UTC m=+215.183588116" watchObservedRunningTime="2026-06-11 14:31:47.851450719 +0000 UTC m=+215.184028195" Jun 11 14:31:47.851812 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:47.851783 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wgxm6" podStartSLOduration=1.482604689 podStartE2EDuration="3.851775945s" totalImagesPullingTime="2.369171256s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 14:31:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:31:47.830099378 +0000 UTC m=+215.162676874" watchObservedRunningTime="2026-06-11 14:31:47.851775945 +0000 UTC m=+215.184353417" Jun 11 14:31:54.225419 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:54.225378 2574 patch_prober.go:28] interesting pod/image-registry-97f979f6b-dn7j4 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 14:31:54.225879 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:54.225447 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" podUID="5400b75f-e955-4173-87e0-baa03165be20" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 14:31:55.276200 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.276158 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-4srdt"] Jun 11 14:31:55.280542 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.280511 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4srdt" Jun 11 14:31:55.283063 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.283037 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 11 14:31:55.283063 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.283058 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-jkz8v\"" Jun 11 14:31:55.283860 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.283835 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 11 14:31:55.283980 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.283846 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 11 14:31:55.292290 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.292221 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-xnnvx"] Jun 11 14:31:55.296272 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.296252 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-4srdt"] Jun 11 14:31:55.296536 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.296522 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xnnvx" Jun 11 14:31:55.300657 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.300256 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-8r42r\"" Jun 11 14:31:55.300657 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.300485 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 11 14:31:55.300657 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.300547 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 11 14:31:55.306001 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.305980 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-s2kv6"] Jun 11 14:31:55.309278 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.309258 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 11 14:31:55.309400 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.309357 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s2kv6" Jun 11 14:31:55.311883 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.311867 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 11 14:31:55.317450 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.317429 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-xdft2\"" Jun 11 14:31:55.318452 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.317699 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 11 14:31:55.318452 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.317898 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 11 14:31:55.325665 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.325646 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-xnnvx"] Jun 11 14:31:55.361878 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.361843 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e77e773-2a6d-4baf-90c4-32f8a286a11f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-4srdt\" (UID: \"3e77e773-2a6d-4baf-90c4-32f8a286a11f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4srdt" Jun 11 14:31:55.362062 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.361896 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ltdt\" (UniqueName: \"kubernetes.io/projected/3e77e773-2a6d-4baf-90c4-32f8a286a11f-kube-api-access-7ltdt\") pod \"openshift-state-metrics-65f78d5c66-4srdt\" (UID: \"3e77e773-2a6d-4baf-90c4-32f8a286a11f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4srdt" Jun 11 14:31:55.362062 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.361998 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e77e773-2a6d-4baf-90c4-32f8a286a11f-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-4srdt\" (UID: \"3e77e773-2a6d-4baf-90c4-32f8a286a11f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4srdt" Jun 11 14:31:55.362062 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.362045 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3e77e773-2a6d-4baf-90c4-32f8a286a11f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-4srdt\" (UID: \"3e77e773-2a6d-4baf-90c4-32f8a286a11f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4srdt" Jun 11 14:31:55.462678 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.462631 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2d73ee8-db46-4345-96b9-b9b1cff0e75e-metrics-client-ca\") pod \"node-exporter-s2kv6\" (UID: \"f2d73ee8-db46-4345-96b9-b9b1cff0e75e\") " pod="openshift-monitoring/node-exporter-s2kv6" Jun 11 14:31:55.462867 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.462699 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f2d73ee8-db46-4345-96b9-b9b1cff0e75e-node-exporter-tls\") pod \"node-exporter-s2kv6\" (UID: \"f2d73ee8-db46-4345-96b9-b9b1cff0e75e\") " pod="openshift-monitoring/node-exporter-s2kv6" Jun 11 14:31:55.462867 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.462738 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4d5491f8-ed80-40b9-b0d9-652471e350ef-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-xnnvx\" (UID: \"4d5491f8-ed80-40b9-b0d9-652471e350ef\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xnnvx" Jun 11 14:31:55.462867 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.462766 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f2d73ee8-db46-4345-96b9-b9b1cff0e75e-node-exporter-wtmp\") pod \"node-exporter-s2kv6\" (UID: \"f2d73ee8-db46-4345-96b9-b9b1cff0e75e\") " pod="openshift-monitoring/node-exporter-s2kv6" Jun 11 14:31:55.462867 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.462795 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e77e773-2a6d-4baf-90c4-32f8a286a11f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-4srdt\" (UID: \"3e77e773-2a6d-4baf-90c4-32f8a286a11f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4srdt" Jun 11 14:31:55.462867 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.462827 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ltdt\" (UniqueName: \"kubernetes.io/projected/3e77e773-2a6d-4baf-90c4-32f8a286a11f-kube-api-access-7ltdt\") pod \"openshift-state-metrics-65f78d5c66-4srdt\" (UID: \"3e77e773-2a6d-4baf-90c4-32f8a286a11f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4srdt" Jun 11 14:31:55.462867 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.462852 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4d5491f8-ed80-40b9-b0d9-652471e350ef-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-xnnvx\" (UID: \"4d5491f8-ed80-40b9-b0d9-652471e350ef\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xnnvx" Jun 11 14:31:55.463162 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.462898 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f2d73ee8-db46-4345-96b9-b9b1cff0e75e-node-exporter-textfile\") pod \"node-exporter-s2kv6\" (UID: \"f2d73ee8-db46-4345-96b9-b9b1cff0e75e\") " pod="openshift-monitoring/node-exporter-s2kv6" Jun 11 14:31:55.463162 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:31:55.462914 2574 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 11 14:31:55.463162 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.462940 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e77e773-2a6d-4baf-90c4-32f8a286a11f-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-4srdt\" (UID: \"3e77e773-2a6d-4baf-90c4-32f8a286a11f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4srdt" Jun 11 14:31:55.463162 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.462961 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f2d73ee8-db46-4345-96b9-b9b1cff0e75e-root\") pod \"node-exporter-s2kv6\" (UID: \"f2d73ee8-db46-4345-96b9-b9b1cff0e75e\") " pod="openshift-monitoring/node-exporter-s2kv6" Jun 11 14:31:55.463162 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:31:55.462991 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3e77e773-2a6d-4baf-90c4-32f8a286a11f-openshift-state-metrics-tls podName:3e77e773-2a6d-4baf-90c4-32f8a286a11f nodeName:}" failed. No retries permitted until 2026-06-11 14:31:55.962969024 +0000 UTC m=+223.295546490 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/3e77e773-2a6d-4baf-90c4-32f8a286a11f-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-4srdt" (UID: "3e77e773-2a6d-4baf-90c4-32f8a286a11f") : secret "openshift-state-metrics-tls" not found Jun 11 14:31:55.463162 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.463051 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3e77e773-2a6d-4baf-90c4-32f8a286a11f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-4srdt\" (UID: \"3e77e773-2a6d-4baf-90c4-32f8a286a11f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4srdt" Jun 11 14:31:55.463162 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.463106 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4d5491f8-ed80-40b9-b0d9-652471e350ef-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-xnnvx\" (UID: \"4d5491f8-ed80-40b9-b0d9-652471e350ef\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xnnvx" Jun 11 14:31:55.463162 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.463133 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2d73ee8-db46-4345-96b9-b9b1cff0e75e-sys\") pod \"node-exporter-s2kv6\" (UID: \"f2d73ee8-db46-4345-96b9-b9b1cff0e75e\") " pod="openshift-monitoring/node-exporter-s2kv6" Jun 11 14:31:55.463589 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.463178 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2d73ee8-db46-4345-96b9-b9b1cff0e75e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s2kv6\" (UID: \"f2d73ee8-db46-4345-96b9-b9b1cff0e75e\") " pod="openshift-monitoring/node-exporter-s2kv6" Jun 11 14:31:55.463589 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.463208 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d5491f8-ed80-40b9-b0d9-652471e350ef-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-xnnvx\" (UID: \"4d5491f8-ed80-40b9-b0d9-652471e350ef\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xnnvx" Jun 11 14:31:55.463589 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.463268 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d5491f8-ed80-40b9-b0d9-652471e350ef-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-xnnvx\" (UID: \"4d5491f8-ed80-40b9-b0d9-652471e350ef\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xnnvx" Jun 11 14:31:55.463589 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.463300 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtkbd\" (UniqueName: \"kubernetes.io/projected/4d5491f8-ed80-40b9-b0d9-652471e350ef-kube-api-access-dtkbd\") pod \"kube-state-metrics-57bbf8bfb5-xnnvx\" (UID: \"4d5491f8-ed80-40b9-b0d9-652471e350ef\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xnnvx" Jun 11 14:31:55.463589 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.463348 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f2d73ee8-db46-4345-96b9-b9b1cff0e75e-node-exporter-accelerators-collector-config\") pod \"node-exporter-s2kv6\" (UID: \"f2d73ee8-db46-4345-96b9-b9b1cff0e75e\") " pod="openshift-monitoring/node-exporter-s2kv6" Jun 11 14:31:55.463589 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.463374 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcdjb\" (UniqueName: \"kubernetes.io/projected/f2d73ee8-db46-4345-96b9-b9b1cff0e75e-kube-api-access-jcdjb\") pod \"node-exporter-s2kv6\" (UID: \"f2d73ee8-db46-4345-96b9-b9b1cff0e75e\") " pod="openshift-monitoring/node-exporter-s2kv6" Jun 11 14:31:55.463791 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.463708 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3e77e773-2a6d-4baf-90c4-32f8a286a11f-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-4srdt\" (UID: \"3e77e773-2a6d-4baf-90c4-32f8a286a11f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4srdt" Jun 11 14:31:55.466084 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.466060 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3e77e773-2a6d-4baf-90c4-32f8a286a11f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-4srdt\" (UID: \"3e77e773-2a6d-4baf-90c4-32f8a286a11f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4srdt" Jun 11 14:31:55.475505 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.475480 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ltdt\" (UniqueName: \"kubernetes.io/projected/3e77e773-2a6d-4baf-90c4-32f8a286a11f-kube-api-access-7ltdt\") pod \"openshift-state-metrics-65f78d5c66-4srdt\" (UID: \"3e77e773-2a6d-4baf-90c4-32f8a286a11f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4srdt" Jun 11 14:31:55.564052 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.563962 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f2d73ee8-db46-4345-96b9-b9b1cff0e75e-root\") pod \"node-exporter-s2kv6\" (UID: \"f2d73ee8-db46-4345-96b9-b9b1cff0e75e\") " pod="openshift-monitoring/node-exporter-s2kv6" Jun 11 14:31:55.564052 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.564001 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4d5491f8-ed80-40b9-b0d9-652471e350ef-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-xnnvx\" (UID: \"4d5491f8-ed80-40b9-b0d9-652471e350ef\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xnnvx" Jun 11 14:31:55.564052 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.564024 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2d73ee8-db46-4345-96b9-b9b1cff0e75e-sys\") pod \"node-exporter-s2kv6\" (UID: \"f2d73ee8-db46-4345-96b9-b9b1cff0e75e\") " pod="openshift-monitoring/node-exporter-s2kv6" Jun 11 14:31:55.564052 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.564045 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2d73ee8-db46-4345-96b9-b9b1cff0e75e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s2kv6\" (UID: \"f2d73ee8-db46-4345-96b9-b9b1cff0e75e\") " pod="openshift-monitoring/node-exporter-s2kv6" Jun 11 14:31:55.564395 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.564069 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d5491f8-ed80-40b9-b0d9-652471e350ef-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-xnnvx\" (UID: \"4d5491f8-ed80-40b9-b0d9-652471e350ef\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xnnvx" Jun 11 14:31:55.564395 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.564079 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/f2d73ee8-db46-4345-96b9-b9b1cff0e75e-root\") pod \"node-exporter-s2kv6\" (UID: \"f2d73ee8-db46-4345-96b9-b9b1cff0e75e\") " pod="openshift-monitoring/node-exporter-s2kv6" Jun 11 14:31:55.564395 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.564107 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f2d73ee8-db46-4345-96b9-b9b1cff0e75e-sys\") pod \"node-exporter-s2kv6\" (UID: \"f2d73ee8-db46-4345-96b9-b9b1cff0e75e\") " pod="openshift-monitoring/node-exporter-s2kv6" Jun 11 14:31:55.564395 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.564131 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d5491f8-ed80-40b9-b0d9-652471e350ef-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-xnnvx\" (UID: \"4d5491f8-ed80-40b9-b0d9-652471e350ef\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xnnvx" Jun 11 14:31:55.564395 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.564162 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtkbd\" (UniqueName: \"kubernetes.io/projected/4d5491f8-ed80-40b9-b0d9-652471e350ef-kube-api-access-dtkbd\") pod \"kube-state-metrics-57bbf8bfb5-xnnvx\" (UID: \"4d5491f8-ed80-40b9-b0d9-652471e350ef\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xnnvx" Jun 11 14:31:55.564395 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.564187 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f2d73ee8-db46-4345-96b9-b9b1cff0e75e-node-exporter-accelerators-collector-config\") pod \"node-exporter-s2kv6\" (UID: \"f2d73ee8-db46-4345-96b9-b9b1cff0e75e\") " pod="openshift-monitoring/node-exporter-s2kv6" Jun 11 14:31:55.564395 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.564211 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcdjb\" (UniqueName: \"kubernetes.io/projected/f2d73ee8-db46-4345-96b9-b9b1cff0e75e-kube-api-access-jcdjb\") pod \"node-exporter-s2kv6\" (UID: \"f2d73ee8-db46-4345-96b9-b9b1cff0e75e\") " pod="openshift-monitoring/node-exporter-s2kv6" Jun 11 14:31:55.564395 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.564251 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2d73ee8-db46-4345-96b9-b9b1cff0e75e-metrics-client-ca\") pod \"node-exporter-s2kv6\" (UID: \"f2d73ee8-db46-4345-96b9-b9b1cff0e75e\") " pod="openshift-monitoring/node-exporter-s2kv6" Jun 11 14:31:55.564395 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.564295 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f2d73ee8-db46-4345-96b9-b9b1cff0e75e-node-exporter-tls\") pod \"node-exporter-s2kv6\" (UID: \"f2d73ee8-db46-4345-96b9-b9b1cff0e75e\") " pod="openshift-monitoring/node-exporter-s2kv6" Jun 11 14:31:55.564395 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.564363 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4d5491f8-ed80-40b9-b0d9-652471e350ef-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-xnnvx\" (UID: \"4d5491f8-ed80-40b9-b0d9-652471e350ef\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xnnvx" Jun 11 14:31:55.564395 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.564389 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f2d73ee8-db46-4345-96b9-b9b1cff0e75e-node-exporter-wtmp\") pod \"node-exporter-s2kv6\" (UID: \"f2d73ee8-db46-4345-96b9-b9b1cff0e75e\") " pod="openshift-monitoring/node-exporter-s2kv6" Jun 11 14:31:55.564985 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.564440 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4d5491f8-ed80-40b9-b0d9-652471e350ef-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-xnnvx\" (UID: \"4d5491f8-ed80-40b9-b0d9-652471e350ef\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xnnvx" Jun 11 14:31:55.564985 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.564484 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f2d73ee8-db46-4345-96b9-b9b1cff0e75e-node-exporter-textfile\") pod \"node-exporter-s2kv6\" (UID: \"f2d73ee8-db46-4345-96b9-b9b1cff0e75e\") " pod="openshift-monitoring/node-exporter-s2kv6" Jun 11 14:31:55.564985 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:31:55.564604 2574 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 11 14:31:55.564985 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.564639 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/f2d73ee8-db46-4345-96b9-b9b1cff0e75e-node-exporter-wtmp\") pod \"node-exporter-s2kv6\" (UID: \"f2d73ee8-db46-4345-96b9-b9b1cff0e75e\") " pod="openshift-monitoring/node-exporter-s2kv6" Jun 11 14:31:55.564985 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:31:55.564665 2574 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f2d73ee8-db46-4345-96b9-b9b1cff0e75e-node-exporter-tls podName:f2d73ee8-db46-4345-96b9-b9b1cff0e75e nodeName:}" failed. No retries permitted until 2026-06-11 14:31:56.064647146 +0000 UTC m=+223.397224602 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/f2d73ee8-db46-4345-96b9-b9b1cff0e75e-node-exporter-tls") pod "node-exporter-s2kv6" (UID: "f2d73ee8-db46-4345-96b9-b9b1cff0e75e") : secret "node-exporter-tls" not found Jun 11 14:31:55.564985 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.564869 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/f2d73ee8-db46-4345-96b9-b9b1cff0e75e-node-exporter-accelerators-collector-config\") pod \"node-exporter-s2kv6\" (UID: \"f2d73ee8-db46-4345-96b9-b9b1cff0e75e\") " pod="openshift-monitoring/node-exporter-s2kv6" Jun 11 14:31:55.565303 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.565042 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4d5491f8-ed80-40b9-b0d9-652471e350ef-metrics-client-ca\") pod \"kube-state-metrics-57bbf8bfb5-xnnvx\" (UID: \"4d5491f8-ed80-40b9-b0d9-652471e350ef\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xnnvx" Jun 11 14:31:55.565303 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.565232 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/4d5491f8-ed80-40b9-b0d9-652471e350ef-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-57bbf8bfb5-xnnvx\" (UID: \"4d5491f8-ed80-40b9-b0d9-652471e350ef\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xnnvx" Jun 11 14:31:55.565428 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.565301 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/f2d73ee8-db46-4345-96b9-b9b1cff0e75e-node-exporter-textfile\") pod \"node-exporter-s2kv6\" (UID: \"f2d73ee8-db46-4345-96b9-b9b1cff0e75e\") " pod="openshift-monitoring/node-exporter-s2kv6" Jun 11 14:31:55.565428 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.565361 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f2d73ee8-db46-4345-96b9-b9b1cff0e75e-metrics-client-ca\") pod \"node-exporter-s2kv6\" (UID: \"f2d73ee8-db46-4345-96b9-b9b1cff0e75e\") " pod="openshift-monitoring/node-exporter-s2kv6" Jun 11 14:31:55.565509 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.565454 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/4d5491f8-ed80-40b9-b0d9-652471e350ef-volume-directive-shadow\") pod \"kube-state-metrics-57bbf8bfb5-xnnvx\" (UID: \"4d5491f8-ed80-40b9-b0d9-652471e350ef\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xnnvx" Jun 11 14:31:55.567180 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.567155 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f2d73ee8-db46-4345-96b9-b9b1cff0e75e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-s2kv6\" (UID: \"f2d73ee8-db46-4345-96b9-b9b1cff0e75e\") " pod="openshift-monitoring/node-exporter-s2kv6" Jun 11 14:31:55.567308 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.567156 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/4d5491f8-ed80-40b9-b0d9-652471e350ef-kube-state-metrics-tls\") pod \"kube-state-metrics-57bbf8bfb5-xnnvx\" (UID: \"4d5491f8-ed80-40b9-b0d9-652471e350ef\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xnnvx" Jun 11 14:31:55.567547 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.567526 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4d5491f8-ed80-40b9-b0d9-652471e350ef-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-57bbf8bfb5-xnnvx\" (UID: \"4d5491f8-ed80-40b9-b0d9-652471e350ef\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xnnvx" Jun 11 14:31:55.574601 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.574577 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcdjb\" (UniqueName: \"kubernetes.io/projected/f2d73ee8-db46-4345-96b9-b9b1cff0e75e-kube-api-access-jcdjb\") pod \"node-exporter-s2kv6\" (UID: \"f2d73ee8-db46-4345-96b9-b9b1cff0e75e\") " pod="openshift-monitoring/node-exporter-s2kv6" Jun 11 14:31:55.575162 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.575144 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtkbd\" (UniqueName: \"kubernetes.io/projected/4d5491f8-ed80-40b9-b0d9-652471e350ef-kube-api-access-dtkbd\") pod \"kube-state-metrics-57bbf8bfb5-xnnvx\" (UID: \"4d5491f8-ed80-40b9-b0d9-652471e350ef\") " pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xnnvx" Jun 11 14:31:55.608181 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.608146 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xnnvx" Jun 11 14:31:55.764226 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.764192 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-57bbf8bfb5-xnnvx"] Jun 11 14:31:55.768636 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:31:55.768606 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4d5491f8_ed80_40b9_b0d9_652471e350ef.slice/crio-64d9a922f3f4e4817c523ad18579336b18325e3757ef0f55562b075253d4df47 WatchSource:0}: Error finding container 64d9a922f3f4e4817c523ad18579336b18325e3757ef0f55562b075253d4df47: Status 404 returned error can't find the container with id 64d9a922f3f4e4817c523ad18579336b18325e3757ef0f55562b075253d4df47 Jun 11 14:31:55.834605 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.834516 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xnnvx" event={"ID":"4d5491f8-ed80-40b9-b0d9-652471e350ef","Type":"ContainerStarted","Data":"64d9a922f3f4e4817c523ad18579336b18325e3757ef0f55562b075253d4df47"} Jun 11 14:31:55.968191 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.968156 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e77e773-2a6d-4baf-90c4-32f8a286a11f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-4srdt\" (UID: \"3e77e773-2a6d-4baf-90c4-32f8a286a11f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4srdt" Jun 11 14:31:55.970659 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:55.970631 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3e77e773-2a6d-4baf-90c4-32f8a286a11f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-4srdt\" (UID: \"3e77e773-2a6d-4baf-90c4-32f8a286a11f\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4srdt" Jun 11 14:31:56.069296 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:56.069259 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f2d73ee8-db46-4345-96b9-b9b1cff0e75e-node-exporter-tls\") pod \"node-exporter-s2kv6\" (UID: \"f2d73ee8-db46-4345-96b9-b9b1cff0e75e\") " pod="openshift-monitoring/node-exporter-s2kv6" Jun 11 14:31:56.071799 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:56.071777 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/f2d73ee8-db46-4345-96b9-b9b1cff0e75e-node-exporter-tls\") pod \"node-exporter-s2kv6\" (UID: \"f2d73ee8-db46-4345-96b9-b9b1cff0e75e\") " pod="openshift-monitoring/node-exporter-s2kv6" Jun 11 14:31:56.107747 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:56.107676 2574 scope.go:117] "RemoveContainer" containerID="d768060368c2c11a79b806e6fe425da1a9f6a66c3ae75afbb4fa3ef799905625" Jun 11 14:31:56.193201 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:56.193169 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4srdt" Jun 11 14:31:56.220191 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:56.220163 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-s2kv6" Jun 11 14:31:56.233429 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:31:56.233399 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2d73ee8_db46_4345_96b9_b9b1cff0e75e.slice/crio-a3d6ac5325e6f7138cde31fc8d5b992e1145870c626a2965a8e9092246403d91 WatchSource:0}: Error finding container a3d6ac5325e6f7138cde31fc8d5b992e1145870c626a2965a8e9092246403d91: Status 404 returned error can't find the container with id a3d6ac5325e6f7138cde31fc8d5b992e1145870c626a2965a8e9092246403d91 Jun 11 14:31:56.337077 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:56.337047 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-4srdt"] Jun 11 14:31:56.340034 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:31:56.340009 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e77e773_2a6d_4baf_90c4_32f8a286a11f.slice/crio-b3007926a989dcc6f34de8b8c91b76dc0ee101a5e59305ed5176f179c23cc0aa WatchSource:0}: Error finding container b3007926a989dcc6f34de8b8c91b76dc0ee101a5e59305ed5176f179c23cc0aa: Status 404 returned error can't find the container with id b3007926a989dcc6f34de8b8c91b76dc0ee101a5e59305ed5176f179c23cc0aa Jun 11 14:31:56.840966 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:56.840937 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5lpfx_c3a99230-0749-4f98-97a8-cd9f586e529e/console-operator/2.log" Jun 11 14:31:56.841133 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:56.841046 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-5lpfx" event={"ID":"c3a99230-0749-4f98-97a8-cd9f586e529e","Type":"ContainerStarted","Data":"eca8fc3d16506b4688ad25715260c8f203470ae61e9a6cf960a1269da2f067d5"} Jun 11 14:31:56.841590 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:56.841567 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-5lpfx" Jun 11 14:31:56.844016 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:56.843712 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s2kv6" event={"ID":"f2d73ee8-db46-4345-96b9-b9b1cff0e75e","Type":"ContainerStarted","Data":"a3d6ac5325e6f7138cde31fc8d5b992e1145870c626a2965a8e9092246403d91"} Jun 11 14:31:56.846050 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:56.846004 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4srdt" event={"ID":"3e77e773-2a6d-4baf-90c4-32f8a286a11f","Type":"ContainerStarted","Data":"fdfd8c0f9ce7f0dfd79bc4f3cb6fb142636cadb5b55290634adaa4f9235e2952"} Jun 11 14:31:56.846173 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:56.846074 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4srdt" event={"ID":"3e77e773-2a6d-4baf-90c4-32f8a286a11f","Type":"ContainerStarted","Data":"025dc38f68cc7b221380cc451ae38840d63e79db76f840cd22e3b09759c2d8e1"} Jun 11 14:31:56.846173 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:56.846102 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4srdt" event={"ID":"3e77e773-2a6d-4baf-90c4-32f8a286a11f","Type":"ContainerStarted","Data":"b3007926a989dcc6f34de8b8c91b76dc0ee101a5e59305ed5176f179c23cc0aa"} Jun 11 14:31:56.873667 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:56.872174 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-5lpfx" podStartSLOduration=41.319121057 podStartE2EDuration="43.872152377s" totalImagesPullingTime="2.55303132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:31:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:31:56.870852457 +0000 UTC m=+224.203429951" watchObservedRunningTime="2026-06-11 14:31:56.872152377 +0000 UTC m=+224.204729850" Jun 11 14:31:57.081651 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.081617 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-5lpfx" Jun 11 14:31:57.294423 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.294395 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-fz7mb"] Jun 11 14:31:57.297874 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.297843 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-fz7mb" Jun 11 14:31:57.300942 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.300921 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-rn5xl\"" Jun 11 14:31:57.301026 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.300930 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 11 14:31:57.303143 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.303122 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 11 14:31:57.320390 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.320358 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-fz7mb"] Jun 11 14:31:57.482235 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.482205 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-68n9l\" (UniqueName: \"kubernetes.io/projected/fc2746e0-1892-498c-ba58-d951cc2f5523-kube-api-access-68n9l\") pod \"downloads-6657875f97-fz7mb\" (UID: \"fc2746e0-1892-498c-ba58-d951cc2f5523\") " pod="openshift-console/downloads-6657875f97-fz7mb" Jun 11 14:31:57.540402 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.540369 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-df965bddb-d8zn9"] Jun 11 14:31:57.544250 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.544207 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-df965bddb-d8zn9" Jun 11 14:31:57.557510 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.557486 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 11 14:31:57.561838 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.561815 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 11 14:31:57.561973 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.561815 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 11 14:31:57.561973 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.561815 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 11 14:31:57.561973 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.561824 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-9z5ph\"" Jun 11 14:31:57.562164 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.562149 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 11 14:31:57.562164 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.562158 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-9v32bvke1b6if\"" Jun 11 14:31:57.583615 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.583394 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-68n9l\" (UniqueName: \"kubernetes.io/projected/fc2746e0-1892-498c-ba58-d951cc2f5523-kube-api-access-68n9l\") pod \"downloads-6657875f97-fz7mb\" (UID: \"fc2746e0-1892-498c-ba58-d951cc2f5523\") " pod="openshift-console/downloads-6657875f97-fz7mb" Jun 11 14:31:57.583890 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.583872 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-df965bddb-d8zn9"] Jun 11 14:31:57.600215 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.600175 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-68n9l\" (UniqueName: \"kubernetes.io/projected/fc2746e0-1892-498c-ba58-d951cc2f5523-kube-api-access-68n9l\") pod \"downloads-6657875f97-fz7mb\" (UID: \"fc2746e0-1892-498c-ba58-d951cc2f5523\") " pod="openshift-console/downloads-6657875f97-fz7mb" Jun 11 14:31:57.657719 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.657686 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-fz7mb" Jun 11 14:31:57.684894 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.684847 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hf4xr\" (UniqueName: \"kubernetes.io/projected/7fdd8e28-341e-45cd-8f61-f08018eb84ae-kube-api-access-hf4xr\") pod \"thanos-querier-df965bddb-d8zn9\" (UID: \"7fdd8e28-341e-45cd-8f61-f08018eb84ae\") " pod="openshift-monitoring/thanos-querier-df965bddb-d8zn9" Jun 11 14:31:57.685054 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.684904 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7fdd8e28-341e-45cd-8f61-f08018eb84ae-secret-thanos-querier-tls\") pod \"thanos-querier-df965bddb-d8zn9\" (UID: \"7fdd8e28-341e-45cd-8f61-f08018eb84ae\") " pod="openshift-monitoring/thanos-querier-df965bddb-d8zn9" Jun 11 14:31:57.685054 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.684988 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7fdd8e28-341e-45cd-8f61-f08018eb84ae-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-df965bddb-d8zn9\" (UID: \"7fdd8e28-341e-45cd-8f61-f08018eb84ae\") " pod="openshift-monitoring/thanos-querier-df965bddb-d8zn9" Jun 11 14:31:57.685161 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.685053 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7fdd8e28-341e-45cd-8f61-f08018eb84ae-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-df965bddb-d8zn9\" (UID: \"7fdd8e28-341e-45cd-8f61-f08018eb84ae\") " pod="openshift-monitoring/thanos-querier-df965bddb-d8zn9" Jun 11 14:31:57.685161 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.685115 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7fdd8e28-341e-45cd-8f61-f08018eb84ae-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-df965bddb-d8zn9\" (UID: \"7fdd8e28-341e-45cd-8f61-f08018eb84ae\") " pod="openshift-monitoring/thanos-querier-df965bddb-d8zn9" Jun 11 14:31:57.685161 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.685133 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7fdd8e28-341e-45cd-8f61-f08018eb84ae-metrics-client-ca\") pod \"thanos-querier-df965bddb-d8zn9\" (UID: \"7fdd8e28-341e-45cd-8f61-f08018eb84ae\") " pod="openshift-monitoring/thanos-querier-df965bddb-d8zn9" Jun 11 14:31:57.685290 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.685191 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7fdd8e28-341e-45cd-8f61-f08018eb84ae-secret-grpc-tls\") pod \"thanos-querier-df965bddb-d8zn9\" (UID: \"7fdd8e28-341e-45cd-8f61-f08018eb84ae\") " pod="openshift-monitoring/thanos-querier-df965bddb-d8zn9" Jun 11 14:31:57.685290 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.685225 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7fdd8e28-341e-45cd-8f61-f08018eb84ae-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-df965bddb-d8zn9\" (UID: \"7fdd8e28-341e-45cd-8f61-f08018eb84ae\") " pod="openshift-monitoring/thanos-querier-df965bddb-d8zn9" Jun 11 14:31:57.786275 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.786188 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7fdd8e28-341e-45cd-8f61-f08018eb84ae-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-df965bddb-d8zn9\" (UID: \"7fdd8e28-341e-45cd-8f61-f08018eb84ae\") " pod="openshift-monitoring/thanos-querier-df965bddb-d8zn9" Jun 11 14:31:57.786275 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.786261 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7fdd8e28-341e-45cd-8f61-f08018eb84ae-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-df965bddb-d8zn9\" (UID: \"7fdd8e28-341e-45cd-8f61-f08018eb84ae\") " pod="openshift-monitoring/thanos-querier-df965bddb-d8zn9" Jun 11 14:31:57.786501 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.786297 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7fdd8e28-341e-45cd-8f61-f08018eb84ae-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-df965bddb-d8zn9\" (UID: \"7fdd8e28-341e-45cd-8f61-f08018eb84ae\") " pod="openshift-monitoring/thanos-querier-df965bddb-d8zn9" Jun 11 14:31:57.786501 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.786344 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7fdd8e28-341e-45cd-8f61-f08018eb84ae-metrics-client-ca\") pod \"thanos-querier-df965bddb-d8zn9\" (UID: \"7fdd8e28-341e-45cd-8f61-f08018eb84ae\") " pod="openshift-monitoring/thanos-querier-df965bddb-d8zn9" Jun 11 14:31:57.786501 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.786404 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7fdd8e28-341e-45cd-8f61-f08018eb84ae-secret-grpc-tls\") pod \"thanos-querier-df965bddb-d8zn9\" (UID: \"7fdd8e28-341e-45cd-8f61-f08018eb84ae\") " pod="openshift-monitoring/thanos-querier-df965bddb-d8zn9" Jun 11 14:31:57.786501 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.786441 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7fdd8e28-341e-45cd-8f61-f08018eb84ae-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-df965bddb-d8zn9\" (UID: \"7fdd8e28-341e-45cd-8f61-f08018eb84ae\") " pod="openshift-monitoring/thanos-querier-df965bddb-d8zn9" Jun 11 14:31:57.786501 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.786495 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hf4xr\" (UniqueName: \"kubernetes.io/projected/7fdd8e28-341e-45cd-8f61-f08018eb84ae-kube-api-access-hf4xr\") pod \"thanos-querier-df965bddb-d8zn9\" (UID: \"7fdd8e28-341e-45cd-8f61-f08018eb84ae\") " pod="openshift-monitoring/thanos-querier-df965bddb-d8zn9" Jun 11 14:31:57.786740 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.786524 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7fdd8e28-341e-45cd-8f61-f08018eb84ae-secret-thanos-querier-tls\") pod \"thanos-querier-df965bddb-d8zn9\" (UID: \"7fdd8e28-341e-45cd-8f61-f08018eb84ae\") " pod="openshift-monitoring/thanos-querier-df965bddb-d8zn9" Jun 11 14:31:57.787425 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.787123 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7fdd8e28-341e-45cd-8f61-f08018eb84ae-metrics-client-ca\") pod \"thanos-querier-df965bddb-d8zn9\" (UID: \"7fdd8e28-341e-45cd-8f61-f08018eb84ae\") " pod="openshift-monitoring/thanos-querier-df965bddb-d8zn9" Jun 11 14:31:57.789435 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.789350 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/7fdd8e28-341e-45cd-8f61-f08018eb84ae-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-df965bddb-d8zn9\" (UID: \"7fdd8e28-341e-45cd-8f61-f08018eb84ae\") " pod="openshift-monitoring/thanos-querier-df965bddb-d8zn9" Jun 11 14:31:57.789676 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.789633 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/7fdd8e28-341e-45cd-8f61-f08018eb84ae-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-df965bddb-d8zn9\" (UID: \"7fdd8e28-341e-45cd-8f61-f08018eb84ae\") " pod="openshift-monitoring/thanos-querier-df965bddb-d8zn9" Jun 11 14:31:57.789782 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.789693 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/7fdd8e28-341e-45cd-8f61-f08018eb84ae-secret-grpc-tls\") pod \"thanos-querier-df965bddb-d8zn9\" (UID: \"7fdd8e28-341e-45cd-8f61-f08018eb84ae\") " pod="openshift-monitoring/thanos-querier-df965bddb-d8zn9" Jun 11 14:31:57.790022 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.789985 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/7fdd8e28-341e-45cd-8f61-f08018eb84ae-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-df965bddb-d8zn9\" (UID: \"7fdd8e28-341e-45cd-8f61-f08018eb84ae\") " pod="openshift-monitoring/thanos-querier-df965bddb-d8zn9" Jun 11 14:31:57.790103 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.790059 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/7fdd8e28-341e-45cd-8f61-f08018eb84ae-secret-thanos-querier-tls\") pod \"thanos-querier-df965bddb-d8zn9\" (UID: \"7fdd8e28-341e-45cd-8f61-f08018eb84ae\") " pod="openshift-monitoring/thanos-querier-df965bddb-d8zn9" Jun 11 14:31:57.791271 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.791241 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/7fdd8e28-341e-45cd-8f61-f08018eb84ae-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-df965bddb-d8zn9\" (UID: \"7fdd8e28-341e-45cd-8f61-f08018eb84ae\") " pod="openshift-monitoring/thanos-querier-df965bddb-d8zn9" Jun 11 14:31:57.798054 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.798029 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hf4xr\" (UniqueName: \"kubernetes.io/projected/7fdd8e28-341e-45cd-8f61-f08018eb84ae-kube-api-access-hf4xr\") pod \"thanos-querier-df965bddb-d8zn9\" (UID: \"7fdd8e28-341e-45cd-8f61-f08018eb84ae\") " pod="openshift-monitoring/thanos-querier-df965bddb-d8zn9" Jun 11 14:31:57.851884 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.851840 2574 generic.go:356] "Generic (PLEG): container finished" podID="f2d73ee8-db46-4345-96b9-b9b1cff0e75e" containerID="625c017eabd85d942203135ad0fba6b9c121a43387973617a4108d78bf689f00" exitCode=0 Jun 11 14:31:57.852066 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.851926 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s2kv6" event={"ID":"f2d73ee8-db46-4345-96b9-b9b1cff0e75e","Type":"ContainerDied","Data":"625c017eabd85d942203135ad0fba6b9c121a43387973617a4108d78bf689f00"} Jun 11 14:31:57.853834 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:57.853814 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-df965bddb-d8zn9" Jun 11 14:31:58.405525 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:58.405432 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-fz7mb"] Jun 11 14:31:58.412384 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:31:58.411941 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc2746e0_1892_498c_ba58_d951cc2f5523.slice/crio-c84241b8263d0f82048df90bb39005e60a4848af498048a0f9ba9268b83c1e03 WatchSource:0}: Error finding container c84241b8263d0f82048df90bb39005e60a4848af498048a0f9ba9268b83c1e03: Status 404 returned error can't find the container with id c84241b8263d0f82048df90bb39005e60a4848af498048a0f9ba9268b83c1e03 Jun 11 14:31:58.427948 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:58.422426 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-df965bddb-d8zn9"] Jun 11 14:31:58.437578 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:31:58.437536 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7fdd8e28_341e_45cd_8f61_f08018eb84ae.slice/crio-4640c8a2d76b5019b6a88a12234b1b0e4df3b8c0874d67a19503621c09bf95bb WatchSource:0}: Error finding container 4640c8a2d76b5019b6a88a12234b1b0e4df3b8c0874d67a19503621c09bf95bb: Status 404 returned error can't find the container with id 4640c8a2d76b5019b6a88a12234b1b0e4df3b8c0874d67a19503621c09bf95bb Jun 11 14:31:58.861475 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:58.861367 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-fz7mb" event={"ID":"fc2746e0-1892-498c-ba58-d951cc2f5523","Type":"ContainerStarted","Data":"c84241b8263d0f82048df90bb39005e60a4848af498048a0f9ba9268b83c1e03"} Jun 11 14:31:58.863509 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:58.863483 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xnnvx" event={"ID":"4d5491f8-ed80-40b9-b0d9-652471e350ef","Type":"ContainerStarted","Data":"7cac728fb8a0f19cb46b4ec18b7ad427c20d5b8e781902c12f023c4922195022"} Jun 11 14:31:58.863636 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:58.863532 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xnnvx" event={"ID":"4d5491f8-ed80-40b9-b0d9-652471e350ef","Type":"ContainerStarted","Data":"216541e9cdccde4ed8c5afb9eb281233c747243a939c4da69d322b6680dff90b"} Jun 11 14:31:58.863636 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:58.863557 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xnnvx" event={"ID":"4d5491f8-ed80-40b9-b0d9-652471e350ef","Type":"ContainerStarted","Data":"d0d7c34a69e865511a052e5387f14c471f889a57dae7e8766ace8f764f6fdaca"} Jun 11 14:31:58.868650 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:58.868617 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s2kv6" event={"ID":"f2d73ee8-db46-4345-96b9-b9b1cff0e75e","Type":"ContainerStarted","Data":"5c59f05185226f43fe05a49f4648f96f79e9f5ee796124bc9034b9ab22c01d01"} Jun 11 14:31:58.868790 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:58.868674 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-s2kv6" event={"ID":"f2d73ee8-db46-4345-96b9-b9b1cff0e75e","Type":"ContainerStarted","Data":"6549d70e3575c8c4c4fb827d92fbe34d3a11acf8e3084be1de6528673c7bd800"} Jun 11 14:31:58.870776 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:58.870752 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4srdt" event={"ID":"3e77e773-2a6d-4baf-90c4-32f8a286a11f","Type":"ContainerStarted","Data":"5a595391c0d2d51b63ce140aa72b01e599d0ed70782b9febfc7b7917730196e1"} Jun 11 14:31:58.871840 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:58.871818 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-df965bddb-d8zn9" event={"ID":"7fdd8e28-341e-45cd-8f61-f08018eb84ae","Type":"ContainerStarted","Data":"4640c8a2d76b5019b6a88a12234b1b0e4df3b8c0874d67a19503621c09bf95bb"} Jun 11 14:31:58.890117 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:58.890071 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-57bbf8bfb5-xnnvx" podStartSLOduration=1.444335581 podStartE2EDuration="3.890057331s" totalImagesPullingTime="2.44572175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:31:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:31:58.888806173 +0000 UTC m=+226.221383669" watchObservedRunningTime="2026-06-11 14:31:58.890057331 +0000 UTC m=+226.222634834" Jun 11 14:31:58.920653 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:58.920587 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-s2kv6" podStartSLOduration=2.944452678 podStartE2EDuration="3.920567014s" totalImagesPullingTime="883.886781ms" totalInitContainerRuntime="92.227555ms" isStatefulPod=true podCreationTimestamp="2026-06-11 14:31:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:31:58.919604012 +0000 UTC m=+226.252181483" watchObservedRunningTime="2026-06-11 14:31:58.920567014 +0000 UTC m=+226.253144488" Jun 11 14:31:58.953314 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:31:58.953257 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-4srdt" podStartSLOduration=2.229666951 podStartE2EDuration="3.953235274s" totalImagesPullingTime="1.723568323s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:31:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:31:58.953018369 +0000 UTC m=+226.285595841" watchObservedRunningTime="2026-06-11 14:31:58.953235274 +0000 UTC m=+226.285812771" Jun 11 14:32:00.881053 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:00.881027 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-df965bddb-d8zn9" event={"ID":"7fdd8e28-341e-45cd-8f61-f08018eb84ae","Type":"ContainerStarted","Data":"cc77c7d6f8b0c8824bd4109c73245df8a6327646dc281c353708c7e39683e7ae"} Jun 11 14:32:00.881512 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:00.881095 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-df965bddb-d8zn9" event={"ID":"7fdd8e28-341e-45cd-8f61-f08018eb84ae","Type":"ContainerStarted","Data":"145ea821408df9b65572ee728a5988d6e91bec92c02a878e08d26e20e4a9b8d2"} Jun 11 14:32:01.846178 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.846146 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 14:32:01.851713 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.851692 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:01.854810 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.854717 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 14:32:01.857136 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.857081 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 14:32:01.857274 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.857148 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 14:32:01.857690 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.857492 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 14:32:01.857690 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.857535 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 14:32:01.857690 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.857553 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 14:32:01.857878 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.857866 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 14:32:01.857931 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.857870 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 14:32:01.857997 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.857982 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-z27f6\"" Jun 11 14:32:01.860643 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.860623 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-54jssqjs6vm3q\"" Jun 11 14:32:01.860741 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.860709 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 14:32:01.860872 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.860852 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 14:32:01.860946 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.860893 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 14:32:01.863026 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.863003 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 14:32:01.863633 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.863609 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 14:32:01.870776 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.870755 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 14:32:01.872289 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.872260 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 14:32:01.889216 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.889108 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-df965bddb-d8zn9" event={"ID":"7fdd8e28-341e-45cd-8f61-f08018eb84ae","Type":"ContainerStarted","Data":"7058ed879792a61090fcb604e0861ca559641837fdda9c90350eebea6668162b"} Jun 11 14:32:01.889584 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.889230 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-df965bddb-d8zn9" event={"ID":"7fdd8e28-341e-45cd-8f61-f08018eb84ae","Type":"ContainerStarted","Data":"234644b13e1f40b7e01857ae138808cfd818f0622fa872463b176cd29bb909e7"} Jun 11 14:32:01.896035 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.895952 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 14:32:01.934879 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.934810 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9caab7bf-81b4-4dbe-825f-c861e51eccf4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:01.934879 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.934858 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:01.934879 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.934888 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:01.935198 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.934920 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:01.935198 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.934945 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:01.935198 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.935024 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgd77\" (UniqueName: \"kubernetes.io/projected/9caab7bf-81b4-4dbe-825f-c861e51eccf4-kube-api-access-fgd77\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:01.935198 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.935052 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:01.935198 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.935077 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:01.935198 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.935104 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:01.935198 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.935131 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-config\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:01.935198 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.935168 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:01.935616 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.935209 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:01.935616 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.935244 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:01.935616 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.935277 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9caab7bf-81b4-4dbe-825f-c861e51eccf4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:01.935616 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.935311 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:01.935616 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.935356 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:01.935616 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.935400 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9caab7bf-81b4-4dbe-825f-c861e51eccf4-config-out\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:01.935616 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.935425 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:01.935616 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.935448 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-web-config\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:01.935616 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:01.935472 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.036352 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.036250 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.036352 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.036294 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.036352 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.036318 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.036637 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.036376 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9caab7bf-81b4-4dbe-825f-c861e51eccf4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.036637 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.036404 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.036637 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.036422 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.036637 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.036462 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9caab7bf-81b4-4dbe-825f-c861e51eccf4-config-out\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.036637 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.036486 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.036637 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.036506 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-web-config\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.036637 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.036531 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.036637 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.036568 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9caab7bf-81b4-4dbe-825f-c861e51eccf4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.036637 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.036605 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.036637 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.036635 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.037117 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.036671 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.037117 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.036705 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.037117 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.036731 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgd77\" (UniqueName: \"kubernetes.io/projected/9caab7bf-81b4-4dbe-825f-c861e51eccf4-kube-api-access-fgd77\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.037117 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.036759 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.037117 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.036789 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.037117 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.036814 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.037117 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.036842 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-config\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.037831 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.037800 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.037948 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.037815 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.038450 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.038425 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.038594 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.038570 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.039305 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.038913 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9caab7bf-81b4-4dbe-825f-c861e51eccf4-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.039548 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.039524 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.040730 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.040205 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.040730 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.040435 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9caab7bf-81b4-4dbe-825f-c861e51eccf4-config-out\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.040730 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.040497 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.040923 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.040805 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-config\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.041236 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.041207 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.041347 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.041214 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-web-config\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.041545 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.041525 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9caab7bf-81b4-4dbe-825f-c861e51eccf4-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.042427 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.042404 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.043240 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.043217 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.043589 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.043542 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.044148 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.044123 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.044613 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.044590 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.045054 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.045030 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.049777 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.049737 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgd77\" (UniqueName: \"kubernetes.io/projected/9caab7bf-81b4-4dbe-825f-c861e51eccf4-kube-api-access-fgd77\") pod \"prometheus-k8s-0\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.177159 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.177121 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:02.340358 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.340188 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 14:32:02.343464 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:32:02.343435 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9caab7bf_81b4_4dbe_825f_c861e51eccf4.slice/crio-09847db600e23e96e63d9bdac6f05fb4f6128cb50eceb6d705ccad2ad316e262 WatchSource:0}: Error finding container 09847db600e23e96e63d9bdac6f05fb4f6128cb50eceb6d705ccad2ad316e262: Status 404 returned error can't find the container with id 09847db600e23e96e63d9bdac6f05fb4f6128cb50eceb6d705ccad2ad316e262 Jun 11 14:32:02.897382 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.897320 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-df965bddb-d8zn9" event={"ID":"7fdd8e28-341e-45cd-8f61-f08018eb84ae","Type":"ContainerStarted","Data":"9b89fc93674d71012a10833b06aab25441cb6fa865567b8131d61564998c94c1"} Jun 11 14:32:02.897798 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.897428 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-df965bddb-d8zn9" event={"ID":"7fdd8e28-341e-45cd-8f61-f08018eb84ae","Type":"ContainerStarted","Data":"2dbcdb15a1080c440ea41f61d39b4d1128adf643d5dc0b0172228e61b4525a72"} Jun 11 14:32:02.897798 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.897594 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-df965bddb-d8zn9" Jun 11 14:32:02.899375 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.899345 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9caab7bf-81b4-4dbe-825f-c861e51eccf4","Type":"ContainerStarted","Data":"09847db600e23e96e63d9bdac6f05fb4f6128cb50eceb6d705ccad2ad316e262"} Jun 11 14:32:02.923804 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:02.923742 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-df965bddb-d8zn9" podStartSLOduration=2.868325047 podStartE2EDuration="5.923719969s" totalImagesPullingTime="3.055394922s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:31:57 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:32:02.92245572 +0000 UTC m=+230.255033196" watchObservedRunningTime="2026-06-11 14:32:02.923719969 +0000 UTC m=+230.256297444" Jun 11 14:32:03.906312 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:03.906272 2574 generic.go:356] "Generic (PLEG): container finished" podID="9caab7bf-81b4-4dbe-825f-c861e51eccf4" containerID="3601076a744208ec308c9acf5098844614bad47b54157ce422db4c55e222a465" exitCode=0 Jun 11 14:32:03.906799 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:03.906358 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9caab7bf-81b4-4dbe-825f-c861e51eccf4","Type":"ContainerDied","Data":"3601076a744208ec308c9acf5098844614bad47b54157ce422db4c55e222a465"} Jun 11 14:32:04.225445 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:04.225407 2574 patch_prober.go:28] interesting pod/image-registry-97f979f6b-dn7j4 container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 11 14:32:04.225612 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:04.225471 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" podUID="5400b75f-e955-4173-87e0-baa03165be20" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 14:32:07.928734 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:07.928631 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9caab7bf-81b4-4dbe-825f-c861e51eccf4","Type":"ContainerStarted","Data":"7e05e2347b957b27c1770f600e62914164e6090e31aced1887210e6acfedfb01"} Jun 11 14:32:07.929112 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:07.928756 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9caab7bf-81b4-4dbe-825f-c861e51eccf4","Type":"ContainerStarted","Data":"13b498cd21b430973a0a94825f4f234fe20f1fc9af7a9e12168a689e9b9c5918"} Jun 11 14:32:07.929112 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:07.928800 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9caab7bf-81b4-4dbe-825f-c861e51eccf4","Type":"ContainerStarted","Data":"482dc826ff13bd191ac9355ff4ad49053760ae446e66cf0a2fc34d389fcb80d7"} Jun 11 14:32:07.929112 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:07.928840 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9caab7bf-81b4-4dbe-825f-c861e51eccf4","Type":"ContainerStarted","Data":"222f7d93979d9b560a53d1e710784b8f372ba6bfb0c53aa797111123911d4cd1"} Jun 11 14:32:07.929112 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:07.928877 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9caab7bf-81b4-4dbe-825f-c861e51eccf4","Type":"ContainerStarted","Data":"f52938f22d50770c60f128dd8705992cc305f841c825eede4a9f571173ebeaee"} Jun 11 14:32:07.929112 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:07.928915 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9caab7bf-81b4-4dbe-825f-c861e51eccf4","Type":"ContainerStarted","Data":"32ee9f36ccd77204b1e203d9c5ddf81b58a43d46c12c582511294db098a337c2"} Jun 11 14:32:07.962575 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:07.962366 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.559795932 podStartE2EDuration="6.962318291s" totalImagesPullingTime="4.381193301s" totalInitContainerRuntime="21.329058ms" isStatefulPod=false podCreationTimestamp="2026-06-11 14:32:01 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:32:07.960897908 +0000 UTC m=+235.293475403" watchObservedRunningTime="2026-06-11 14:32:07.962318291 +0000 UTC m=+235.294895776" Jun 11 14:32:08.913855 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:08.913822 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-df965bddb-d8zn9" Jun 11 14:32:09.240299 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:09.240259 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" podUID="5400b75f-e955-4173-87e0-baa03165be20" containerName="registry" containerID="cri-o://cde1ce1f8ee6882cb026658ed7393819aac26705052310b5a3b682a736f76251" gracePeriod=30 Jun 11 14:32:09.502726 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:09.502641 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" Jun 11 14:32:09.606855 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:09.606812 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5400b75f-e955-4173-87e0-baa03165be20-installation-pull-secrets\") pod \"5400b75f-e955-4173-87e0-baa03165be20\" (UID: \"5400b75f-e955-4173-87e0-baa03165be20\") " Jun 11 14:32:09.607056 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:09.606881 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5400b75f-e955-4173-87e0-baa03165be20-bound-sa-token\") pod \"5400b75f-e955-4173-87e0-baa03165be20\" (UID: \"5400b75f-e955-4173-87e0-baa03165be20\") " Jun 11 14:32:09.607056 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:09.606955 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5400b75f-e955-4173-87e0-baa03165be20-ca-trust-extracted\") pod \"5400b75f-e955-4173-87e0-baa03165be20\" (UID: \"5400b75f-e955-4173-87e0-baa03165be20\") " Jun 11 14:32:09.607056 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:09.606996 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5400b75f-e955-4173-87e0-baa03165be20-registry-certificates\") pod \"5400b75f-e955-4173-87e0-baa03165be20\" (UID: \"5400b75f-e955-4173-87e0-baa03165be20\") " Jun 11 14:32:09.607222 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:09.607061 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5659\" (UniqueName: \"kubernetes.io/projected/5400b75f-e955-4173-87e0-baa03165be20-kube-api-access-l5659\") pod \"5400b75f-e955-4173-87e0-baa03165be20\" (UID: \"5400b75f-e955-4173-87e0-baa03165be20\") " Jun 11 14:32:09.607222 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:09.607095 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5400b75f-e955-4173-87e0-baa03165be20-image-registry-private-configuration\") pod \"5400b75f-e955-4173-87e0-baa03165be20\" (UID: \"5400b75f-e955-4173-87e0-baa03165be20\") " Jun 11 14:32:09.607222 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:09.607137 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5400b75f-e955-4173-87e0-baa03165be20-registry-tls\") pod \"5400b75f-e955-4173-87e0-baa03165be20\" (UID: \"5400b75f-e955-4173-87e0-baa03165be20\") " Jun 11 14:32:09.607222 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:09.607167 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5400b75f-e955-4173-87e0-baa03165be20-trusted-ca\") pod \"5400b75f-e955-4173-87e0-baa03165be20\" (UID: \"5400b75f-e955-4173-87e0-baa03165be20\") " Jun 11 14:32:09.608486 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:09.608427 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5400b75f-e955-4173-87e0-baa03165be20-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "5400b75f-e955-4173-87e0-baa03165be20" (UID: "5400b75f-e955-4173-87e0-baa03165be20"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 14:32:09.609134 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:09.609096 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5400b75f-e955-4173-87e0-baa03165be20-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "5400b75f-e955-4173-87e0-baa03165be20" (UID: "5400b75f-e955-4173-87e0-baa03165be20"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 14:32:09.610656 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:09.610633 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5400b75f-e955-4173-87e0-baa03165be20-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "5400b75f-e955-4173-87e0-baa03165be20" (UID: "5400b75f-e955-4173-87e0-baa03165be20"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:32:09.610759 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:09.610652 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5400b75f-e955-4173-87e0-baa03165be20-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "5400b75f-e955-4173-87e0-baa03165be20" (UID: "5400b75f-e955-4173-87e0-baa03165be20"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 14:32:09.610759 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:09.610661 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5400b75f-e955-4173-87e0-baa03165be20-kube-api-access-l5659" (OuterVolumeSpecName: "kube-api-access-l5659") pod "5400b75f-e955-4173-87e0-baa03165be20" (UID: "5400b75f-e955-4173-87e0-baa03165be20"). InnerVolumeSpecName "kube-api-access-l5659". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:32:09.610759 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:09.610709 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5400b75f-e955-4173-87e0-baa03165be20-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "5400b75f-e955-4173-87e0-baa03165be20" (UID: "5400b75f-e955-4173-87e0-baa03165be20"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:32:09.610880 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:09.610782 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5400b75f-e955-4173-87e0-baa03165be20-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "5400b75f-e955-4173-87e0-baa03165be20" (UID: "5400b75f-e955-4173-87e0-baa03165be20"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 14:32:09.617485 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:09.617452 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5400b75f-e955-4173-87e0-baa03165be20-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "5400b75f-e955-4173-87e0-baa03165be20" (UID: "5400b75f-e955-4173-87e0-baa03165be20"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:32:09.708750 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:09.708709 2574 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/5400b75f-e955-4173-87e0-baa03165be20-installation-pull-secrets\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:32:09.708750 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:09.708739 2574 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/5400b75f-e955-4173-87e0-baa03165be20-bound-sa-token\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:32:09.708750 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:09.708748 2574 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/5400b75f-e955-4173-87e0-baa03165be20-ca-trust-extracted\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:32:09.708750 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:09.708757 2574 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/5400b75f-e955-4173-87e0-baa03165be20-registry-certificates\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:32:09.708997 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:09.708766 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5659\" (UniqueName: \"kubernetes.io/projected/5400b75f-e955-4173-87e0-baa03165be20-kube-api-access-l5659\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:32:09.708997 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:09.708776 2574 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/5400b75f-e955-4173-87e0-baa03165be20-image-registry-private-configuration\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:32:09.708997 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:09.708794 2574 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/5400b75f-e955-4173-87e0-baa03165be20-registry-tls\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:32:09.708997 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:09.708802 2574 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/5400b75f-e955-4173-87e0-baa03165be20-trusted-ca\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:32:09.938506 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:09.938420 2574 generic.go:356] "Generic (PLEG): container finished" podID="5400b75f-e955-4173-87e0-baa03165be20" containerID="cde1ce1f8ee6882cb026658ed7393819aac26705052310b5a3b682a736f76251" exitCode=0 Jun 11 14:32:09.938506 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:09.938464 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" Jun 11 14:32:09.938681 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:09.938505 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" event={"ID":"5400b75f-e955-4173-87e0-baa03165be20","Type":"ContainerDied","Data":"cde1ce1f8ee6882cb026658ed7393819aac26705052310b5a3b682a736f76251"} Jun 11 14:32:09.938681 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:09.938561 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-97f979f6b-dn7j4" event={"ID":"5400b75f-e955-4173-87e0-baa03165be20","Type":"ContainerDied","Data":"5bb6b98d20a13f989bcbb028a6ad07d786d09874f53fce811168477f3629e9c7"} Jun 11 14:32:09.938681 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:09.938583 2574 scope.go:117] "RemoveContainer" containerID="cde1ce1f8ee6882cb026658ed7393819aac26705052310b5a3b682a736f76251" Jun 11 14:32:09.950726 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:09.950699 2574 scope.go:117] "RemoveContainer" containerID="cde1ce1f8ee6882cb026658ed7393819aac26705052310b5a3b682a736f76251" Jun 11 14:32:09.951095 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:32:09.951074 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cde1ce1f8ee6882cb026658ed7393819aac26705052310b5a3b682a736f76251\": container with ID starting with cde1ce1f8ee6882cb026658ed7393819aac26705052310b5a3b682a736f76251 not found: ID does not exist" containerID="cde1ce1f8ee6882cb026658ed7393819aac26705052310b5a3b682a736f76251" Jun 11 14:32:09.951174 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:09.951105 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cde1ce1f8ee6882cb026658ed7393819aac26705052310b5a3b682a736f76251"} err="failed to get container status \"cde1ce1f8ee6882cb026658ed7393819aac26705052310b5a3b682a736f76251\": rpc error: code = NotFound desc = could not find container \"cde1ce1f8ee6882cb026658ed7393819aac26705052310b5a3b682a736f76251\": container with ID starting with cde1ce1f8ee6882cb026658ed7393819aac26705052310b5a3b682a736f76251 not found: ID does not exist" Jun 11 14:32:09.961852 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:09.961808 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-97f979f6b-dn7j4"] Jun 11 14:32:09.965944 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:09.965917 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-97f979f6b-dn7j4"] Jun 11 14:32:11.114656 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:11.114619 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5400b75f-e955-4173-87e0-baa03165be20" path="/var/lib/kubelet/pods/5400b75f-e955-4173-87e0-baa03165be20/volumes" Jun 11 14:32:12.177472 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:12.177431 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:32:17.978209 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:17.978168 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-fz7mb" event={"ID":"fc2746e0-1892-498c-ba58-d951cc2f5523","Type":"ContainerStarted","Data":"4b8a87e9ddea32484b8bc216d1c618f5866e83326cdf35959fca49c7edb30404"} Jun 11 14:32:17.978641 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:17.978361 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-fz7mb" Jun 11 14:32:17.979902 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:17.979874 2574 patch_prober.go:28] interesting pod/downloads-6657875f97-fz7mb container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.134.0.18:8080/\": dial tcp 10.134.0.18:8080: connect: connection refused" start-of-body= Jun 11 14:32:17.980031 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:17.979930 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-6657875f97-fz7mb" podUID="fc2746e0-1892-498c-ba58-d951cc2f5523" containerName="download-server" probeResult="failure" output="Get \"http://10.134.0.18:8080/\": dial tcp 10.134.0.18:8080: connect: connection refused" Jun 11 14:32:17.998954 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:17.998897 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-fz7mb" podStartSLOduration=1.644934313 podStartE2EDuration="20.99888124s" totalImagesPullingTime="19.353946927s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:31:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:32:17.997634139 +0000 UTC m=+245.330211636" watchObservedRunningTime="2026-06-11 14:32:17.99888124 +0000 UTC m=+245.331458712" Jun 11 14:32:18.996907 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:18.996871 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-fz7mb" Jun 11 14:32:24.961761 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:24.961711 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab181ce2-5bb7-4882-8c14-6409a830fb89-metrics-certs\") pod \"network-metrics-daemon-2wxd2\" (UID: \"ab181ce2-5bb7-4882-8c14-6409a830fb89\") " pod="openshift-multus/network-metrics-daemon-2wxd2" Jun 11 14:32:24.964591 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:24.964562 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/ab181ce2-5bb7-4882-8c14-6409a830fb89-metrics-certs\") pod \"network-metrics-daemon-2wxd2\" (UID: \"ab181ce2-5bb7-4882-8c14-6409a830fb89\") " pod="openshift-multus/network-metrics-daemon-2wxd2" Jun 11 14:32:25.114873 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:25.114838 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-6jqb7\"" Jun 11 14:32:25.118941 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:25.118918 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2wxd2" Jun 11 14:32:25.332044 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:25.331951 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2wxd2"] Jun 11 14:32:25.334135 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:32:25.334066 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab181ce2_5bb7_4882_8c14_6409a830fb89.slice/crio-4e3f3ba4da87ce9a6f8c0fa22fbc8658db4ec50b6c64d90ede17aff189c5be4a WatchSource:0}: Error finding container 4e3f3ba4da87ce9a6f8c0fa22fbc8658db4ec50b6c64d90ede17aff189c5be4a: Status 404 returned error can't find the container with id 4e3f3ba4da87ce9a6f8c0fa22fbc8658db4ec50b6c64d90ede17aff189c5be4a Jun 11 14:32:26.015891 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:26.015805 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2wxd2" event={"ID":"ab181ce2-5bb7-4882-8c14-6409a830fb89","Type":"ContainerStarted","Data":"4e3f3ba4da87ce9a6f8c0fa22fbc8658db4ec50b6c64d90ede17aff189c5be4a"} Jun 11 14:32:27.022573 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:27.022544 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2wxd2" event={"ID":"ab181ce2-5bb7-4882-8c14-6409a830fb89","Type":"ContainerStarted","Data":"84a1916a3837e3ba1eabd64032212c537695047c40b5a19bf87f892d08ac3907"} Jun 11 14:32:28.027854 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:28.027821 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2wxd2" event={"ID":"ab181ce2-5bb7-4882-8c14-6409a830fb89","Type":"ContainerStarted","Data":"bcb7d2fc2be2aad366b6c526307eb55c8f720deda16bf7916831963c268c274c"} Jun 11 14:32:28.047261 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:28.047209 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2wxd2" podStartSLOduration=253.532781005 podStartE2EDuration="4m15.047190043s" totalImagesPullingTime="1.514409038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:28:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:32:28.046361124 +0000 UTC m=+255.378938594" watchObservedRunningTime="2026-06-11 14:32:28.047190043 +0000 UTC m=+255.379767517" Jun 11 14:32:42.092074 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:42.092042 2574 generic.go:356] "Generic (PLEG): container finished" podID="fce79c77-23ab-4a5b-a3a7-3c24efff11b2" containerID="b0f94a7d03313e58fbc9644bfb6f14e3d3d733cd46a6d9381b5789d8b499f523" exitCode=0 Jun 11 14:32:42.092521 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:42.092124 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-2tc6n" event={"ID":"fce79c77-23ab-4a5b-a3a7-3c24efff11b2","Type":"ContainerDied","Data":"b0f94a7d03313e58fbc9644bfb6f14e3d3d733cd46a6d9381b5789d8b499f523"} Jun 11 14:32:42.092521 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:42.092465 2574 scope.go:117] "RemoveContainer" containerID="b0f94a7d03313e58fbc9644bfb6f14e3d3d733cd46a6d9381b5789d8b499f523" Jun 11 14:32:43.100124 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:43.100087 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-2tc6n" event={"ID":"fce79c77-23ab-4a5b-a3a7-3c24efff11b2","Type":"ContainerStarted","Data":"24666af6cacc68ecc7efc6ecd34477dbf802f0608ff2b4e9917846d2b3d9c247"} Jun 11 14:32:46.795265 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:46.795239 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-snjm5_69fe43eb-2928-4a64-bbf3-873458af8bcf/cluster-monitoring-operator/0.log" Jun 11 14:32:47.009551 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:47.009525 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-xnnvx_4d5491f8-ed80-40b9-b0d9-652471e350ef/kube-state-metrics/0.log" Jun 11 14:32:47.195828 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:47.195757 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-xnnvx_4d5491f8-ed80-40b9-b0d9-652471e350ef/kube-rbac-proxy-main/0.log" Jun 11 14:32:47.395493 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:47.395461 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-xnnvx_4d5491f8-ed80-40b9-b0d9-652471e350ef/kube-rbac-proxy-self/0.log" Jun 11 14:32:48.593419 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:48.593394 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s2kv6_f2d73ee8-db46-4345-96b9-b9b1cff0e75e/init-textfile/0.log" Jun 11 14:32:48.794115 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:48.794088 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s2kv6_f2d73ee8-db46-4345-96b9-b9b1cff0e75e/node-exporter/0.log" Jun 11 14:32:48.993565 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:48.993535 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s2kv6_f2d73ee8-db46-4345-96b9-b9b1cff0e75e/kube-rbac-proxy/0.log" Jun 11 14:32:49.793228 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:49.793197 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-4srdt_3e77e773-2a6d-4baf-90c4-32f8a286a11f/kube-rbac-proxy-main/0.log" Jun 11 14:32:49.993650 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:49.993625 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-4srdt_3e77e773-2a6d-4baf-90c4-32f8a286a11f/kube-rbac-proxy-self/0.log" Jun 11 14:32:50.193379 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:50.193288 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-4srdt_3e77e773-2a6d-4baf-90c4-32f8a286a11f/openshift-state-metrics/0.log" Jun 11 14:32:50.393878 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:50.393850 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9caab7bf-81b4-4dbe-825f-c861e51eccf4/init-config-reloader/0.log" Jun 11 14:32:50.595071 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:50.595047 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9caab7bf-81b4-4dbe-825f-c861e51eccf4/prometheus/0.log" Jun 11 14:32:50.792844 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:50.792815 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9caab7bf-81b4-4dbe-825f-c861e51eccf4/config-reloader/0.log" Jun 11 14:32:50.995184 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:50.995161 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9caab7bf-81b4-4dbe-825f-c861e51eccf4/thanos-sidecar/0.log" Jun 11 14:32:51.193483 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:51.193440 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9caab7bf-81b4-4dbe-825f-c861e51eccf4/kube-rbac-proxy-web/0.log" Jun 11 14:32:51.393127 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:51.393052 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9caab7bf-81b4-4dbe-825f-c861e51eccf4/kube-rbac-proxy/0.log" Jun 11 14:32:51.592929 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:51.592899 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_9caab7bf-81b4-4dbe-825f-c861e51eccf4/kube-rbac-proxy-thanos/0.log" Jun 11 14:32:52.401528 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:52.401498 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-df965bddb-d8zn9_7fdd8e28-341e-45cd-8f61-f08018eb84ae/thanos-query/0.log" Jun 11 14:32:52.606990 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:52.606965 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-df965bddb-d8zn9_7fdd8e28-341e-45cd-8f61-f08018eb84ae/kube-rbac-proxy-web/0.log" Jun 11 14:32:52.800474 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:52.800443 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-df965bddb-d8zn9_7fdd8e28-341e-45cd-8f61-f08018eb84ae/kube-rbac-proxy/0.log" Jun 11 14:32:52.998040 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:52.998012 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-df965bddb-d8zn9_7fdd8e28-341e-45cd-8f61-f08018eb84ae/prom-label-proxy/0.log" Jun 11 14:32:53.197987 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:53.197896 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-df965bddb-d8zn9_7fdd8e28-341e-45cd-8f61-f08018eb84ae/kube-rbac-proxy-rules/0.log" Jun 11 14:32:53.400565 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:53.400531 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-df965bddb-d8zn9_7fdd8e28-341e-45cd-8f61-f08018eb84ae/kube-rbac-proxy-metrics/0.log" Jun 11 14:32:53.793090 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:53.793063 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5lpfx_c3a99230-0749-4f98-97a8-cd9f586e529e/console-operator/2.log" Jun 11 14:32:54.002414 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:54.002385 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5lpfx_c3a99230-0749-4f98-97a8-cd9f586e529e/console-operator/3.log" Jun 11 14:32:54.597204 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:54.597173 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-fz7mb_fc2746e0-1892-498c-ba58-d951cc2f5523/download-server/0.log" Jun 11 14:32:56.193548 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:56.193511 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nw644_e2e1c881-454a-4129-b1c4-82db9c5f65ed/dns-node-resolver/0.log" Jun 11 14:32:56.994259 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:56.994229 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2vwxx_92c15579-52ac-4218-a656-1981d234cd34/node-ca/0.log" Jun 11 14:32:57.993579 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:32:57.993533 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6qt5g_2d770ac0-988e-46c7-a44c-9d74cd45ad3c/serve-healthcheck-canary/0.log" Jun 11 14:32:59.623697 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:32:59.623656 2574 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-dfxs5" podUID="ec9feeb0-c748-4e61-828d-f48ee812ad14" Jun 11 14:33:00.166602 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:00.166572 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dfxs5" Jun 11 14:33:02.178302 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:02.177974 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:02.237806 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:02.237778 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:03.094965 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:03.094927 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec9feeb0-c748-4e61-828d-f48ee812ad14-metrics-tls\") pod \"dns-default-dfxs5\" (UID: \"ec9feeb0-c748-4e61-828d-f48ee812ad14\") " pod="openshift-dns/dns-default-dfxs5" Jun 11 14:33:03.097362 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:03.097340 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/ec9feeb0-c748-4e61-828d-f48ee812ad14-metrics-tls\") pod \"dns-default-dfxs5\" (UID: \"ec9feeb0-c748-4e61-828d-f48ee812ad14\") " pod="openshift-dns/dns-default-dfxs5" Jun 11 14:33:03.170019 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:03.169989 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-lsmch\"" Jun 11 14:33:03.178406 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:03.178382 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-dfxs5" Jun 11 14:33:03.197242 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:03.197220 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:03.328981 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:03.328950 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-dfxs5"] Jun 11 14:33:03.330535 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:33:03.330508 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec9feeb0_c748_4e61_828d_f48ee812ad14.slice/crio-070080c4310b0ea2fde2aadba9f72e0af55c96e734071c9253ac39234f0694a7 WatchSource:0}: Error finding container 070080c4310b0ea2fde2aadba9f72e0af55c96e734071c9253ac39234f0694a7: Status 404 returned error can't find the container with id 070080c4310b0ea2fde2aadba9f72e0af55c96e734071c9253ac39234f0694a7 Jun 11 14:33:04.185390 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:04.185346 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dfxs5" event={"ID":"ec9feeb0-c748-4e61-828d-f48ee812ad14","Type":"ContainerStarted","Data":"070080c4310b0ea2fde2aadba9f72e0af55c96e734071c9253ac39234f0694a7"} Jun 11 14:33:06.195319 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:06.195283 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dfxs5" event={"ID":"ec9feeb0-c748-4e61-828d-f48ee812ad14","Type":"ContainerStarted","Data":"5318500fc9c62cb09a0fe5570cc541346582910fbf8e99a1165f8cbf6c29458d"} Jun 11 14:33:06.195747 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:06.195373 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-dfxs5" event={"ID":"ec9feeb0-c748-4e61-828d-f48ee812ad14","Type":"ContainerStarted","Data":"b6d33747d66c95a45ee5ad03501cbe4b7be73c9a20f0b65df20b7aaab5657336"} Jun 11 14:33:06.195747 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:06.195450 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-dfxs5" Jun 11 14:33:06.243062 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:06.243011 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-dfxs5" podStartSLOduration=251.396935892 podStartE2EDuration="4m13.242989061s" totalImagesPullingTime="1.846053169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:28:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:33:06.241405804 +0000 UTC m=+293.573983296" watchObservedRunningTime="2026-06-11 14:33:06.242989061 +0000 UTC m=+293.575566550" Jun 11 14:33:13.047277 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:13.047250 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5lpfx_c3a99230-0749-4f98-97a8-cd9f586e529e/console-operator/2.log" Jun 11 14:33:13.049138 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:13.049117 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5lpfx_c3a99230-0749-4f98-97a8-cd9f586e529e/console-operator/2.log" Jun 11 14:33:13.051669 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:13.051647 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qld5j_37cb9247-f8d1-4b39-a031-89f74f7a8e1b/ovn-acl-logging/0.log" Jun 11 14:33:13.053168 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:13.053149 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qld5j_37cb9247-f8d1-4b39-a031-89f74f7a8e1b/ovn-acl-logging/0.log" Jun 11 14:33:13.059143 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:13.059127 2574 kubelet.go:1648] "Image garbage collection succeeded" Jun 11 14:33:16.206799 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:16.206775 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-dfxs5" Jun 11 14:33:20.240903 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:20.240868 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 14:33:20.241410 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:20.241225 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9caab7bf-81b4-4dbe-825f-c861e51eccf4" containerName="prometheus" containerID="cri-o://32ee9f36ccd77204b1e203d9c5ddf81b58a43d46c12c582511294db098a337c2" gracePeriod=600 Jun 11 14:33:20.241410 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:20.241288 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9caab7bf-81b4-4dbe-825f-c861e51eccf4" containerName="kube-rbac-proxy-thanos" containerID="cri-o://7e05e2347b957b27c1770f600e62914164e6090e31aced1887210e6acfedfb01" gracePeriod=600 Jun 11 14:33:20.241410 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:20.241348 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9caab7bf-81b4-4dbe-825f-c861e51eccf4" containerName="kube-rbac-proxy" containerID="cri-o://13b498cd21b430973a0a94825f4f234fe20f1fc9af7a9e12168a689e9b9c5918" gracePeriod=600 Jun 11 14:33:20.241410 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:20.241385 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9caab7bf-81b4-4dbe-825f-c861e51eccf4" containerName="config-reloader" containerID="cri-o://f52938f22d50770c60f128dd8705992cc305f841c825eede4a9f571173ebeaee" gracePeriod=600 Jun 11 14:33:20.241589 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:20.241348 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9caab7bf-81b4-4dbe-825f-c861e51eccf4" containerName="kube-rbac-proxy-web" containerID="cri-o://482dc826ff13bd191ac9355ff4ad49053760ae446e66cf0a2fc34d389fcb80d7" gracePeriod=600 Jun 11 14:33:20.241589 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:20.241385 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="9caab7bf-81b4-4dbe-825f-c861e51eccf4" containerName="thanos-sidecar" containerID="cri-o://222f7d93979d9b560a53d1e710784b8f372ba6bfb0c53aa797111123911d4cd1" gracePeriod=600 Jun 11 14:33:21.261258 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.261223 2574 generic.go:356] "Generic (PLEG): container finished" podID="9caab7bf-81b4-4dbe-825f-c861e51eccf4" containerID="7e05e2347b957b27c1770f600e62914164e6090e31aced1887210e6acfedfb01" exitCode=0 Jun 11 14:33:21.261258 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.261249 2574 generic.go:356] "Generic (PLEG): container finished" podID="9caab7bf-81b4-4dbe-825f-c861e51eccf4" containerID="13b498cd21b430973a0a94825f4f234fe20f1fc9af7a9e12168a689e9b9c5918" exitCode=0 Jun 11 14:33:21.261258 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.261256 2574 generic.go:356] "Generic (PLEG): container finished" podID="9caab7bf-81b4-4dbe-825f-c861e51eccf4" containerID="222f7d93979d9b560a53d1e710784b8f372ba6bfb0c53aa797111123911d4cd1" exitCode=0 Jun 11 14:33:21.261258 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.261262 2574 generic.go:356] "Generic (PLEG): container finished" podID="9caab7bf-81b4-4dbe-825f-c861e51eccf4" containerID="f52938f22d50770c60f128dd8705992cc305f841c825eede4a9f571173ebeaee" exitCode=0 Jun 11 14:33:21.261258 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.261269 2574 generic.go:356] "Generic (PLEG): container finished" podID="9caab7bf-81b4-4dbe-825f-c861e51eccf4" containerID="32ee9f36ccd77204b1e203d9c5ddf81b58a43d46c12c582511294db098a337c2" exitCode=0 Jun 11 14:33:21.261842 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.261294 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9caab7bf-81b4-4dbe-825f-c861e51eccf4","Type":"ContainerDied","Data":"7e05e2347b957b27c1770f600e62914164e6090e31aced1887210e6acfedfb01"} Jun 11 14:33:21.261842 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.261396 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9caab7bf-81b4-4dbe-825f-c861e51eccf4","Type":"ContainerDied","Data":"13b498cd21b430973a0a94825f4f234fe20f1fc9af7a9e12168a689e9b9c5918"} Jun 11 14:33:21.261842 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.261443 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9caab7bf-81b4-4dbe-825f-c861e51eccf4","Type":"ContainerDied","Data":"222f7d93979d9b560a53d1e710784b8f372ba6bfb0c53aa797111123911d4cd1"} Jun 11 14:33:21.261842 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.261479 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9caab7bf-81b4-4dbe-825f-c861e51eccf4","Type":"ContainerDied","Data":"f52938f22d50770c60f128dd8705992cc305f841c825eede4a9f571173ebeaee"} Jun 11 14:33:21.261842 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.261518 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9caab7bf-81b4-4dbe-825f-c861e51eccf4","Type":"ContainerDied","Data":"32ee9f36ccd77204b1e203d9c5ddf81b58a43d46c12c582511294db098a337c2"} Jun 11 14:33:21.499370 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.499320 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:21.658735 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.658642 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-web-config\") pod \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " Jun 11 14:33:21.658735 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.658684 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9caab7bf-81b4-4dbe-825f-c861e51eccf4-config-out\") pod \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " Jun 11 14:33:21.658735 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.658717 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-prometheus-trusted-ca-bundle\") pod \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " Jun 11 14:33:21.659090 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.658759 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " Jun 11 14:33:21.659090 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.658789 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-secret-prometheus-k8s-tls\") pod \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " Jun 11 14:33:21.659090 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.658816 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-configmap-kubelet-serving-ca-bundle\") pod \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " Jun 11 14:33:21.659090 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.658851 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9caab7bf-81b4-4dbe-825f-c861e51eccf4-tls-assets\") pod \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " Jun 11 14:33:21.659090 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.658880 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-secret-metrics-client-certs\") pod \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " Jun 11 14:33:21.659090 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.658910 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-config\") pod \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " Jun 11 14:33:21.659090 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.658937 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-secret-grpc-tls\") pod \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " Jun 11 14:33:21.659090 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.658968 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-prometheus-k8s-rulefiles-2\") pod \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " Jun 11 14:33:21.659090 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.659037 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " Jun 11 14:33:21.659090 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.659087 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-prometheus-k8s-rulefiles-1\") pod \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " Jun 11 14:33:21.659854 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.659111 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fgd77\" (UniqueName: \"kubernetes.io/projected/9caab7bf-81b4-4dbe-825f-c861e51eccf4-kube-api-access-fgd77\") pod \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " Jun 11 14:33:21.659854 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.659139 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9caab7bf-81b4-4dbe-825f-c861e51eccf4-prometheus-k8s-db\") pod \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " Jun 11 14:33:21.659854 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.659164 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-thanos-prometheus-http-client-file\") pod \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " Jun 11 14:33:21.659854 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.659156 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "9caab7bf-81b4-4dbe-825f-c861e51eccf4" (UID: "9caab7bf-81b4-4dbe-825f-c861e51eccf4"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 14:33:21.659854 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.659199 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "9caab7bf-81b4-4dbe-825f-c861e51eccf4" (UID: "9caab7bf-81b4-4dbe-825f-c861e51eccf4"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 14:33:21.659854 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.659207 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-secret-kube-rbac-proxy\") pod \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " Jun 11 14:33:21.659854 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.659246 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-configmap-serving-certs-ca-bundle\") pod \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " Jun 11 14:33:21.659854 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.659269 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-configmap-metrics-client-ca\") pod \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " Jun 11 14:33:21.659854 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.659296 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-prometheus-k8s-rulefiles-0\") pod \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\" (UID: \"9caab7bf-81b4-4dbe-825f-c861e51eccf4\") " Jun 11 14:33:21.659854 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.659436 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "9caab7bf-81b4-4dbe-825f-c861e51eccf4" (UID: "9caab7bf-81b4-4dbe-825f-c861e51eccf4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 14:33:21.659854 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.659733 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:33:21.659854 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.659752 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:33:21.659854 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.659768 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-prometheus-trusted-ca-bundle\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:33:21.661043 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.661012 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9caab7bf-81b4-4dbe-825f-c861e51eccf4-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "9caab7bf-81b4-4dbe-825f-c861e51eccf4" (UID: "9caab7bf-81b4-4dbe-825f-c861e51eccf4"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:33:21.661155 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.661139 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "9caab7bf-81b4-4dbe-825f-c861e51eccf4" (UID: "9caab7bf-81b4-4dbe-825f-c861e51eccf4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 14:33:21.661602 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.661579 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "9caab7bf-81b4-4dbe-825f-c861e51eccf4" (UID: "9caab7bf-81b4-4dbe-825f-c861e51eccf4"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 14:33:21.661711 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.661640 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "9caab7bf-81b4-4dbe-825f-c861e51eccf4" (UID: "9caab7bf-81b4-4dbe-825f-c861e51eccf4"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 14:33:21.661986 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.661961 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "9caab7bf-81b4-4dbe-825f-c861e51eccf4" (UID: "9caab7bf-81b4-4dbe-825f-c861e51eccf4"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 11 14:33:21.662486 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.662451 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9caab7bf-81b4-4dbe-825f-c861e51eccf4-kube-api-access-fgd77" (OuterVolumeSpecName: "kube-api-access-fgd77") pod "9caab7bf-81b4-4dbe-825f-c861e51eccf4" (UID: "9caab7bf-81b4-4dbe-825f-c861e51eccf4"). InnerVolumeSpecName "kube-api-access-fgd77". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:33:21.663401 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.663373 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9caab7bf-81b4-4dbe-825f-c861e51eccf4-config-out" (OuterVolumeSpecName: "config-out") pod "9caab7bf-81b4-4dbe-825f-c861e51eccf4" (UID: "9caab7bf-81b4-4dbe-825f-c861e51eccf4"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:33:21.663501 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.663394 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "9caab7bf-81b4-4dbe-825f-c861e51eccf4" (UID: "9caab7bf-81b4-4dbe-825f-c861e51eccf4"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 14:33:21.663712 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.663669 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "9caab7bf-81b4-4dbe-825f-c861e51eccf4" (UID: "9caab7bf-81b4-4dbe-825f-c861e51eccf4"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 14:33:21.663792 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.663710 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "9caab7bf-81b4-4dbe-825f-c861e51eccf4" (UID: "9caab7bf-81b4-4dbe-825f-c861e51eccf4"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 14:33:21.663966 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.663933 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9caab7bf-81b4-4dbe-825f-c861e51eccf4-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "9caab7bf-81b4-4dbe-825f-c861e51eccf4" (UID: "9caab7bf-81b4-4dbe-825f-c861e51eccf4"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:33:21.664145 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.664124 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "9caab7bf-81b4-4dbe-825f-c861e51eccf4" (UID: "9caab7bf-81b4-4dbe-825f-c861e51eccf4"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 14:33:21.664395 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.664376 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "9caab7bf-81b4-4dbe-825f-c861e51eccf4" (UID: "9caab7bf-81b4-4dbe-825f-c861e51eccf4"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 14:33:21.664709 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.664689 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-config" (OuterVolumeSpecName: "config") pod "9caab7bf-81b4-4dbe-825f-c861e51eccf4" (UID: "9caab7bf-81b4-4dbe-825f-c861e51eccf4"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 14:33:21.665044 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.665023 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "9caab7bf-81b4-4dbe-825f-c861e51eccf4" (UID: "9caab7bf-81b4-4dbe-825f-c861e51eccf4"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 14:33:21.665611 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.665444 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "9caab7bf-81b4-4dbe-825f-c861e51eccf4" (UID: "9caab7bf-81b4-4dbe-825f-c861e51eccf4"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 14:33:21.673679 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.673657 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-web-config" (OuterVolumeSpecName: "web-config") pod "9caab7bf-81b4-4dbe-825f-c861e51eccf4" (UID: "9caab7bf-81b4-4dbe-825f-c861e51eccf4"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 14:33:21.760646 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.760616 2574 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9caab7bf-81b4-4dbe-825f-c861e51eccf4-tls-assets\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:33:21.760646 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.760639 2574 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-secret-metrics-client-certs\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:33:21.760646 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.760650 2574 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-config\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:33:21.760882 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.760678 2574 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-secret-grpc-tls\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:33:21.760882 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.760689 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:33:21.760882 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.760697 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:33:21.760882 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.760705 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fgd77\" (UniqueName: \"kubernetes.io/projected/9caab7bf-81b4-4dbe-825f-c861e51eccf4-kube-api-access-fgd77\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:33:21.760882 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.760716 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/9caab7bf-81b4-4dbe-825f-c861e51eccf4-prometheus-k8s-db\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:33:21.760882 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.760724 2574 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-thanos-prometheus-http-client-file\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:33:21.760882 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.760734 2574 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-secret-kube-rbac-proxy\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:33:21.760882 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.760742 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:33:21.760882 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.760750 2574 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-configmap-metrics-client-ca\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:33:21.760882 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.760758 2574 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/9caab7bf-81b4-4dbe-825f-c861e51eccf4-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:33:21.760882 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.760765 2574 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-web-config\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:33:21.760882 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.760773 2574 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9caab7bf-81b4-4dbe-825f-c861e51eccf4-config-out\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:33:21.760882 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.760780 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:33:21.760882 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:21.760788 2574 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/9caab7bf-81b4-4dbe-825f-c861e51eccf4-secret-prometheus-k8s-tls\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:33:22.268561 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.268526 2574 generic.go:356] "Generic (PLEG): container finished" podID="9caab7bf-81b4-4dbe-825f-c861e51eccf4" containerID="482dc826ff13bd191ac9355ff4ad49053760ae446e66cf0a2fc34d389fcb80d7" exitCode=0 Jun 11 14:33:22.268972 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.268603 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9caab7bf-81b4-4dbe-825f-c861e51eccf4","Type":"ContainerDied","Data":"482dc826ff13bd191ac9355ff4ad49053760ae446e66cf0a2fc34d389fcb80d7"} Jun 11 14:33:22.268972 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.268667 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"9caab7bf-81b4-4dbe-825f-c861e51eccf4","Type":"ContainerDied","Data":"09847db600e23e96e63d9bdac6f05fb4f6128cb50eceb6d705ccad2ad316e262"} Jun 11 14:33:22.268972 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.268607 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.268972 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.268712 2574 scope.go:117] "RemoveContainer" containerID="7e05e2347b957b27c1770f600e62914164e6090e31aced1887210e6acfedfb01" Jun 11 14:33:22.276845 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.276709 2574 scope.go:117] "RemoveContainer" containerID="13b498cd21b430973a0a94825f4f234fe20f1fc9af7a9e12168a689e9b9c5918" Jun 11 14:33:22.284341 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.284305 2574 scope.go:117] "RemoveContainer" containerID="482dc826ff13bd191ac9355ff4ad49053760ae446e66cf0a2fc34d389fcb80d7" Jun 11 14:33:22.291421 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.291314 2574 scope.go:117] "RemoveContainer" containerID="222f7d93979d9b560a53d1e710784b8f372ba6bfb0c53aa797111123911d4cd1" Jun 11 14:33:22.295107 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.295083 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 14:33:22.299279 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.299256 2574 scope.go:117] "RemoveContainer" containerID="f52938f22d50770c60f128dd8705992cc305f841c825eede4a9f571173ebeaee" Jun 11 14:33:22.301356 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.301315 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 14:33:22.307521 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.307504 2574 scope.go:117] "RemoveContainer" containerID="32ee9f36ccd77204b1e203d9c5ddf81b58a43d46c12c582511294db098a337c2" Jun 11 14:33:22.315006 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.314983 2574 scope.go:117] "RemoveContainer" containerID="3601076a744208ec308c9acf5098844614bad47b54157ce422db4c55e222a465" Jun 11 14:33:22.321927 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.321902 2574 scope.go:117] "RemoveContainer" containerID="7e05e2347b957b27c1770f600e62914164e6090e31aced1887210e6acfedfb01" Jun 11 14:33:22.322166 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:33:22.322146 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e05e2347b957b27c1770f600e62914164e6090e31aced1887210e6acfedfb01\": container with ID starting with 7e05e2347b957b27c1770f600e62914164e6090e31aced1887210e6acfedfb01 not found: ID does not exist" containerID="7e05e2347b957b27c1770f600e62914164e6090e31aced1887210e6acfedfb01" Jun 11 14:33:22.322214 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.322176 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e05e2347b957b27c1770f600e62914164e6090e31aced1887210e6acfedfb01"} err="failed to get container status \"7e05e2347b957b27c1770f600e62914164e6090e31aced1887210e6acfedfb01\": rpc error: code = NotFound desc = could not find container \"7e05e2347b957b27c1770f600e62914164e6090e31aced1887210e6acfedfb01\": container with ID starting with 7e05e2347b957b27c1770f600e62914164e6090e31aced1887210e6acfedfb01 not found: ID does not exist" Jun 11 14:33:22.322214 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.322197 2574 scope.go:117] "RemoveContainer" containerID="13b498cd21b430973a0a94825f4f234fe20f1fc9af7a9e12168a689e9b9c5918" Jun 11 14:33:22.322468 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:33:22.322450 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13b498cd21b430973a0a94825f4f234fe20f1fc9af7a9e12168a689e9b9c5918\": container with ID starting with 13b498cd21b430973a0a94825f4f234fe20f1fc9af7a9e12168a689e9b9c5918 not found: ID does not exist" containerID="13b498cd21b430973a0a94825f4f234fe20f1fc9af7a9e12168a689e9b9c5918" Jun 11 14:33:22.322528 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.322472 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13b498cd21b430973a0a94825f4f234fe20f1fc9af7a9e12168a689e9b9c5918"} err="failed to get container status \"13b498cd21b430973a0a94825f4f234fe20f1fc9af7a9e12168a689e9b9c5918\": rpc error: code = NotFound desc = could not find container \"13b498cd21b430973a0a94825f4f234fe20f1fc9af7a9e12168a689e9b9c5918\": container with ID starting with 13b498cd21b430973a0a94825f4f234fe20f1fc9af7a9e12168a689e9b9c5918 not found: ID does not exist" Jun 11 14:33:22.322528 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.322488 2574 scope.go:117] "RemoveContainer" containerID="482dc826ff13bd191ac9355ff4ad49053760ae446e66cf0a2fc34d389fcb80d7" Jun 11 14:33:22.322690 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:33:22.322671 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"482dc826ff13bd191ac9355ff4ad49053760ae446e66cf0a2fc34d389fcb80d7\": container with ID starting with 482dc826ff13bd191ac9355ff4ad49053760ae446e66cf0a2fc34d389fcb80d7 not found: ID does not exist" containerID="482dc826ff13bd191ac9355ff4ad49053760ae446e66cf0a2fc34d389fcb80d7" Jun 11 14:33:22.322728 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.322695 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"482dc826ff13bd191ac9355ff4ad49053760ae446e66cf0a2fc34d389fcb80d7"} err="failed to get container status \"482dc826ff13bd191ac9355ff4ad49053760ae446e66cf0a2fc34d389fcb80d7\": rpc error: code = NotFound desc = could not find container \"482dc826ff13bd191ac9355ff4ad49053760ae446e66cf0a2fc34d389fcb80d7\": container with ID starting with 482dc826ff13bd191ac9355ff4ad49053760ae446e66cf0a2fc34d389fcb80d7 not found: ID does not exist" Jun 11 14:33:22.322728 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.322708 2574 scope.go:117] "RemoveContainer" containerID="222f7d93979d9b560a53d1e710784b8f372ba6bfb0c53aa797111123911d4cd1" Jun 11 14:33:22.322917 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:33:22.322903 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"222f7d93979d9b560a53d1e710784b8f372ba6bfb0c53aa797111123911d4cd1\": container with ID starting with 222f7d93979d9b560a53d1e710784b8f372ba6bfb0c53aa797111123911d4cd1 not found: ID does not exist" containerID="222f7d93979d9b560a53d1e710784b8f372ba6bfb0c53aa797111123911d4cd1" Jun 11 14:33:22.322957 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.322923 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"222f7d93979d9b560a53d1e710784b8f372ba6bfb0c53aa797111123911d4cd1"} err="failed to get container status \"222f7d93979d9b560a53d1e710784b8f372ba6bfb0c53aa797111123911d4cd1\": rpc error: code = NotFound desc = could not find container \"222f7d93979d9b560a53d1e710784b8f372ba6bfb0c53aa797111123911d4cd1\": container with ID starting with 222f7d93979d9b560a53d1e710784b8f372ba6bfb0c53aa797111123911d4cd1 not found: ID does not exist" Jun 11 14:33:22.322957 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.322938 2574 scope.go:117] "RemoveContainer" containerID="f52938f22d50770c60f128dd8705992cc305f841c825eede4a9f571173ebeaee" Jun 11 14:33:22.323140 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:33:22.323123 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f52938f22d50770c60f128dd8705992cc305f841c825eede4a9f571173ebeaee\": container with ID starting with f52938f22d50770c60f128dd8705992cc305f841c825eede4a9f571173ebeaee not found: ID does not exist" containerID="f52938f22d50770c60f128dd8705992cc305f841c825eede4a9f571173ebeaee" Jun 11 14:33:22.323179 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.323145 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f52938f22d50770c60f128dd8705992cc305f841c825eede4a9f571173ebeaee"} err="failed to get container status \"f52938f22d50770c60f128dd8705992cc305f841c825eede4a9f571173ebeaee\": rpc error: code = NotFound desc = could not find container \"f52938f22d50770c60f128dd8705992cc305f841c825eede4a9f571173ebeaee\": container with ID starting with f52938f22d50770c60f128dd8705992cc305f841c825eede4a9f571173ebeaee not found: ID does not exist" Jun 11 14:33:22.323179 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.323160 2574 scope.go:117] "RemoveContainer" containerID="32ee9f36ccd77204b1e203d9c5ddf81b58a43d46c12c582511294db098a337c2" Jun 11 14:33:22.323376 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:33:22.323360 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"32ee9f36ccd77204b1e203d9c5ddf81b58a43d46c12c582511294db098a337c2\": container with ID starting with 32ee9f36ccd77204b1e203d9c5ddf81b58a43d46c12c582511294db098a337c2 not found: ID does not exist" containerID="32ee9f36ccd77204b1e203d9c5ddf81b58a43d46c12c582511294db098a337c2" Jun 11 14:33:22.323442 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.323377 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"32ee9f36ccd77204b1e203d9c5ddf81b58a43d46c12c582511294db098a337c2"} err="failed to get container status \"32ee9f36ccd77204b1e203d9c5ddf81b58a43d46c12c582511294db098a337c2\": rpc error: code = NotFound desc = could not find container \"32ee9f36ccd77204b1e203d9c5ddf81b58a43d46c12c582511294db098a337c2\": container with ID starting with 32ee9f36ccd77204b1e203d9c5ddf81b58a43d46c12c582511294db098a337c2 not found: ID does not exist" Jun 11 14:33:22.323442 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.323396 2574 scope.go:117] "RemoveContainer" containerID="3601076a744208ec308c9acf5098844614bad47b54157ce422db4c55e222a465" Jun 11 14:33:22.323656 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:33:22.323639 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3601076a744208ec308c9acf5098844614bad47b54157ce422db4c55e222a465\": container with ID starting with 3601076a744208ec308c9acf5098844614bad47b54157ce422db4c55e222a465 not found: ID does not exist" containerID="3601076a744208ec308c9acf5098844614bad47b54157ce422db4c55e222a465" Jun 11 14:33:22.323710 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.323661 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3601076a744208ec308c9acf5098844614bad47b54157ce422db4c55e222a465"} err="failed to get container status \"3601076a744208ec308c9acf5098844614bad47b54157ce422db4c55e222a465\": rpc error: code = NotFound desc = could not find container \"3601076a744208ec308c9acf5098844614bad47b54157ce422db4c55e222a465\": container with ID starting with 3601076a744208ec308c9acf5098844614bad47b54157ce422db4c55e222a465 not found: ID does not exist" Jun 11 14:33:22.330283 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.330264 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 14:33:22.330563 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.330551 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9caab7bf-81b4-4dbe-825f-c861e51eccf4" containerName="config-reloader" Jun 11 14:33:22.330605 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.330565 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9caab7bf-81b4-4dbe-825f-c861e51eccf4" containerName="config-reloader" Jun 11 14:33:22.330605 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.330575 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5400b75f-e955-4173-87e0-baa03165be20" containerName="registry" Jun 11 14:33:22.330605 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.330581 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="5400b75f-e955-4173-87e0-baa03165be20" containerName="registry" Jun 11 14:33:22.330605 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.330588 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9caab7bf-81b4-4dbe-825f-c861e51eccf4" containerName="thanos-sidecar" Jun 11 14:33:22.330605 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.330593 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9caab7bf-81b4-4dbe-825f-c861e51eccf4" containerName="thanos-sidecar" Jun 11 14:33:22.330757 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.330607 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9caab7bf-81b4-4dbe-825f-c861e51eccf4" containerName="kube-rbac-proxy-web" Jun 11 14:33:22.330757 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.330612 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9caab7bf-81b4-4dbe-825f-c861e51eccf4" containerName="kube-rbac-proxy-web" Jun 11 14:33:22.330757 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.330620 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9caab7bf-81b4-4dbe-825f-c861e51eccf4" containerName="prometheus" Jun 11 14:33:22.330757 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.330625 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9caab7bf-81b4-4dbe-825f-c861e51eccf4" containerName="prometheus" Jun 11 14:33:22.330757 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.330633 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9caab7bf-81b4-4dbe-825f-c861e51eccf4" containerName="init-config-reloader" Jun 11 14:33:22.330757 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.330638 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9caab7bf-81b4-4dbe-825f-c861e51eccf4" containerName="init-config-reloader" Jun 11 14:33:22.330757 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.330649 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9caab7bf-81b4-4dbe-825f-c861e51eccf4" containerName="kube-rbac-proxy" Jun 11 14:33:22.330757 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.330653 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9caab7bf-81b4-4dbe-825f-c861e51eccf4" containerName="kube-rbac-proxy" Jun 11 14:33:22.330757 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.330660 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9caab7bf-81b4-4dbe-825f-c861e51eccf4" containerName="kube-rbac-proxy-thanos" Jun 11 14:33:22.330757 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.330665 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="9caab7bf-81b4-4dbe-825f-c861e51eccf4" containerName="kube-rbac-proxy-thanos" Jun 11 14:33:22.330757 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.330709 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9caab7bf-81b4-4dbe-825f-c861e51eccf4" containerName="kube-rbac-proxy-web" Jun 11 14:33:22.330757 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.330717 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9caab7bf-81b4-4dbe-825f-c861e51eccf4" containerName="kube-rbac-proxy" Jun 11 14:33:22.330757 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.330724 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9caab7bf-81b4-4dbe-825f-c861e51eccf4" containerName="prometheus" Jun 11 14:33:22.330757 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.330730 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9caab7bf-81b4-4dbe-825f-c861e51eccf4" containerName="thanos-sidecar" Jun 11 14:33:22.330757 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.330735 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9caab7bf-81b4-4dbe-825f-c861e51eccf4" containerName="kube-rbac-proxy-thanos" Jun 11 14:33:22.330757 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.330740 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="5400b75f-e955-4173-87e0-baa03165be20" containerName="registry" Jun 11 14:33:22.330757 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.330745 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="9caab7bf-81b4-4dbe-825f-c861e51eccf4" containerName="config-reloader" Jun 11 14:33:22.334357 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.334340 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.337132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.337110 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 11 14:33:22.337132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.337119 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 11 14:33:22.337132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.337120 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 11 14:33:22.337442 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.337229 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-z27f6\"" Jun 11 14:33:22.337442 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.337141 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 11 14:33:22.337442 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.337155 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 11 14:33:22.337442 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.337406 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 11 14:33:22.337442 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.337427 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 11 14:33:22.337442 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.337434 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 11 14:33:22.337731 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.337619 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 11 14:33:22.337731 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.337642 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 11 14:33:22.337731 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.337670 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 11 14:33:22.337922 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.337907 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 11 14:33:22.338177 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.338161 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-54jssqjs6vm3q\"" Jun 11 14:33:22.339423 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.339408 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 11 14:33:22.340990 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.340971 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 11 14:33:22.343516 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.343495 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 11 14:33:22.355298 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.355276 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 14:33:22.466615 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.466581 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/51cbaffe-25db-4a70-8131-4e1a53551528-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.466615 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.466620 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/51cbaffe-25db-4a70-8131-4e1a53551528-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.466808 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.466637 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/51cbaffe-25db-4a70-8131-4e1a53551528-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.466808 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.466663 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51cbaffe-25db-4a70-8131-4e1a53551528-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.466808 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.466698 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/51cbaffe-25db-4a70-8131-4e1a53551528-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.466808 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.466750 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/51cbaffe-25db-4a70-8131-4e1a53551528-config-out\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.466808 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.466765 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51cbaffe-25db-4a70-8131-4e1a53551528-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.466808 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.466786 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/51cbaffe-25db-4a70-8131-4e1a53551528-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.466808 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.466801 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xxrb9\" (UniqueName: \"kubernetes.io/projected/51cbaffe-25db-4a70-8131-4e1a53551528-kube-api-access-xxrb9\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.467007 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.466873 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/51cbaffe-25db-4a70-8131-4e1a53551528-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.467007 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.466903 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/51cbaffe-25db-4a70-8131-4e1a53551528-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.467007 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.466922 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/51cbaffe-25db-4a70-8131-4e1a53551528-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.467007 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.466937 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51cbaffe-25db-4a70-8131-4e1a53551528-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.467007 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.466959 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/51cbaffe-25db-4a70-8131-4e1a53551528-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.467007 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.466975 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/51cbaffe-25db-4a70-8131-4e1a53551528-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.467007 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.467003 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/51cbaffe-25db-4a70-8131-4e1a53551528-config\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.467203 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.467022 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/51cbaffe-25db-4a70-8131-4e1a53551528-web-config\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.467203 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.467041 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/51cbaffe-25db-4a70-8131-4e1a53551528-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.467203 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.467056 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51cbaffe-25db-4a70-8131-4e1a53551528-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.467203 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.467077 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/51cbaffe-25db-4a70-8131-4e1a53551528-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.568155 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.568073 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/51cbaffe-25db-4a70-8131-4e1a53551528-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.568155 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.568109 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/51cbaffe-25db-4a70-8131-4e1a53551528-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.568155 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.568129 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51cbaffe-25db-4a70-8131-4e1a53551528-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.568155 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.568150 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/51cbaffe-25db-4a70-8131-4e1a53551528-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.568473 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.568187 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/51cbaffe-25db-4a70-8131-4e1a53551528-config-out\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.568473 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.568210 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51cbaffe-25db-4a70-8131-4e1a53551528-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.568473 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.568241 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/51cbaffe-25db-4a70-8131-4e1a53551528-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.568473 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.568265 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xxrb9\" (UniqueName: \"kubernetes.io/projected/51cbaffe-25db-4a70-8131-4e1a53551528-kube-api-access-xxrb9\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.568473 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.568320 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/51cbaffe-25db-4a70-8131-4e1a53551528-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.568473 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.568372 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/51cbaffe-25db-4a70-8131-4e1a53551528-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.568473 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.568396 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/51cbaffe-25db-4a70-8131-4e1a53551528-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.568473 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.568420 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51cbaffe-25db-4a70-8131-4e1a53551528-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.568473 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.568454 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/51cbaffe-25db-4a70-8131-4e1a53551528-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.568900 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.568480 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/51cbaffe-25db-4a70-8131-4e1a53551528-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.568900 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.568512 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/51cbaffe-25db-4a70-8131-4e1a53551528-config\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.568900 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.568539 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/51cbaffe-25db-4a70-8131-4e1a53551528-web-config\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.568900 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.568568 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/51cbaffe-25db-4a70-8131-4e1a53551528-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.568900 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.568593 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51cbaffe-25db-4a70-8131-4e1a53551528-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.568900 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.568606 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/51cbaffe-25db-4a70-8131-4e1a53551528-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.568900 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.568617 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/51cbaffe-25db-4a70-8131-4e1a53551528-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.568900 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.568661 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/51cbaffe-25db-4a70-8131-4e1a53551528-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.569498 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.569031 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51cbaffe-25db-4a70-8131-4e1a53551528-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.569498 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.569163 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/51cbaffe-25db-4a70-8131-4e1a53551528-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.569498 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.569265 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/51cbaffe-25db-4a70-8131-4e1a53551528-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.569498 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.569457 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/51cbaffe-25db-4a70-8131-4e1a53551528-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.570508 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.570480 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51cbaffe-25db-4a70-8131-4e1a53551528-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.571232 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.571205 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/51cbaffe-25db-4a70-8131-4e1a53551528-config-out\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.572504 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.571897 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/51cbaffe-25db-4a70-8131-4e1a53551528-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.572504 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.572164 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/51cbaffe-25db-4a70-8131-4e1a53551528-web-config\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.572504 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.572417 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/51cbaffe-25db-4a70-8131-4e1a53551528-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.572504 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.572468 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/51cbaffe-25db-4a70-8131-4e1a53551528-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.572504 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.572486 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/51cbaffe-25db-4a70-8131-4e1a53551528-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.572874 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.572850 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/51cbaffe-25db-4a70-8131-4e1a53551528-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.572993 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.572969 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/51cbaffe-25db-4a70-8131-4e1a53551528-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.573343 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.573288 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/51cbaffe-25db-4a70-8131-4e1a53551528-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.574604 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.574577 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/51cbaffe-25db-4a70-8131-4e1a53551528-config\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.574679 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.574623 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/51cbaffe-25db-4a70-8131-4e1a53551528-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.574979 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.574958 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/51cbaffe-25db-4a70-8131-4e1a53551528-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.575080 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.575065 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/51cbaffe-25db-4a70-8131-4e1a53551528-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.581176 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.581155 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xxrb9\" (UniqueName: \"kubernetes.io/projected/51cbaffe-25db-4a70-8131-4e1a53551528-kube-api-access-xxrb9\") pod \"prometheus-k8s-0\" (UID: \"51cbaffe-25db-4a70-8131-4e1a53551528\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.644178 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.644151 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:33:22.794138 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:22.794076 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 11 14:33:22.798235 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:33:22.798206 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51cbaffe_25db_4a70_8131_4e1a53551528.slice/crio-1b307905d43ccd51605458b8c3a3ca657d0c2c2529cdc53f70ee13dc99fb74ba WatchSource:0}: Error finding container 1b307905d43ccd51605458b8c3a3ca657d0c2c2529cdc53f70ee13dc99fb74ba: Status 404 returned error can't find the container with id 1b307905d43ccd51605458b8c3a3ca657d0c2c2529cdc53f70ee13dc99fb74ba Jun 11 14:33:23.116271 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:23.116190 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9caab7bf-81b4-4dbe-825f-c861e51eccf4" path="/var/lib/kubelet/pods/9caab7bf-81b4-4dbe-825f-c861e51eccf4/volumes" Jun 11 14:33:23.274143 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:23.274106 2574 generic.go:356] "Generic (PLEG): container finished" podID="51cbaffe-25db-4a70-8131-4e1a53551528" containerID="beb9d734908027fd506cc1c7607e4971c776a7ca3efbde1aa2b833a9f7bc986c" exitCode=0 Jun 11 14:33:23.274582 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:23.274192 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51cbaffe-25db-4a70-8131-4e1a53551528","Type":"ContainerDied","Data":"beb9d734908027fd506cc1c7607e4971c776a7ca3efbde1aa2b833a9f7bc986c"} Jun 11 14:33:23.274582 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:23.274261 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51cbaffe-25db-4a70-8131-4e1a53551528","Type":"ContainerStarted","Data":"1b307905d43ccd51605458b8c3a3ca657d0c2c2529cdc53f70ee13dc99fb74ba"} Jun 11 14:33:24.282720 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:24.282683 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51cbaffe-25db-4a70-8131-4e1a53551528","Type":"ContainerStarted","Data":"64b7a9efda92fe22453597a01a4ebbb905827342af8a79b46f776776576972a3"} Jun 11 14:33:24.283065 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:24.282765 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51cbaffe-25db-4a70-8131-4e1a53551528","Type":"ContainerStarted","Data":"7c8c5062084734ae2f175252215d04cb7ccc55b794f198bd481f53bb56fd23d3"} Jun 11 14:33:24.283065 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:24.282804 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51cbaffe-25db-4a70-8131-4e1a53551528","Type":"ContainerStarted","Data":"6dcfab5d301cf05d87722412193281dbe1fa99e8fa3b58454ce08eeb3843b393"} Jun 11 14:33:24.283065 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:24.282844 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51cbaffe-25db-4a70-8131-4e1a53551528","Type":"ContainerStarted","Data":"28c7dc9a16fc64f4879bbb5fd0d8fdcc4399d2ed633ba1f37ef507fec59b7c7e"} Jun 11 14:33:24.283065 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:24.282881 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51cbaffe-25db-4a70-8131-4e1a53551528","Type":"ContainerStarted","Data":"ad7846ac5a4e4a91338193a1bd68382f6c9a63bb167977e94ef6e384270800b3"} Jun 11 14:33:24.283065 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:24.282914 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"51cbaffe-25db-4a70-8131-4e1a53551528","Type":"ContainerStarted","Data":"c25d29887d647e4c69c5431466c9d1771518157e0ebd3cc4cbe51a6a7c48a824"} Jun 11 14:33:24.313284 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:24.313225 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.288969494 podStartE2EDuration="2.313204177s" totalImagesPullingTime="0s" totalInitContainerRuntime="24.234683ms" isStatefulPod=false podCreationTimestamp="2026-06-11 14:33:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:33:24.312230846 +0000 UTC m=+311.644808336" watchObservedRunningTime="2026-06-11 14:33:24.313204177 +0000 UTC m=+311.645781650" Jun 11 14:33:27.644348 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:33:27.644294 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:34:22.644937 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:34:22.644892 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:34:22.660767 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:34:22.660742 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:34:23.534069 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:34:23.534039 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 11 14:35:51.533007 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:35:51.532926 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-mrxch"] Jun 11 14:35:51.536077 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:35:51.536057 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-mrxch" Jun 11 14:35:51.538580 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:35:51.538562 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 11 14:35:51.539727 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:35:51.539709 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 11 14:35:51.539814 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:35:51.539745 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-vpj2d\"" Jun 11 14:35:51.547015 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:35:51.546995 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-mrxch"] Jun 11 14:35:51.622343 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:35:51.622302 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74eec215-35fa-471d-a115-add6966dfba3-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-mrxch\" (UID: \"74eec215-35fa-471d-a115-add6966dfba3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-mrxch" Jun 11 14:35:51.622517 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:35:51.622456 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7nrk\" (UniqueName: \"kubernetes.io/projected/74eec215-35fa-471d-a115-add6966dfba3-kube-api-access-m7nrk\") pod \"cert-manager-webhook-7dc76cbb94-mrxch\" (UID: \"74eec215-35fa-471d-a115-add6966dfba3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-mrxch" Jun 11 14:35:51.723234 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:35:51.723192 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74eec215-35fa-471d-a115-add6966dfba3-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-mrxch\" (UID: \"74eec215-35fa-471d-a115-add6966dfba3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-mrxch" Jun 11 14:35:51.723434 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:35:51.723280 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7nrk\" (UniqueName: \"kubernetes.io/projected/74eec215-35fa-471d-a115-add6966dfba3-kube-api-access-m7nrk\") pod \"cert-manager-webhook-7dc76cbb94-mrxch\" (UID: \"74eec215-35fa-471d-a115-add6966dfba3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-mrxch" Jun 11 14:35:51.734299 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:35:51.734269 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/74eec215-35fa-471d-a115-add6966dfba3-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-mrxch\" (UID: \"74eec215-35fa-471d-a115-add6966dfba3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-mrxch" Jun 11 14:35:51.734507 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:35:51.734487 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7nrk\" (UniqueName: \"kubernetes.io/projected/74eec215-35fa-471d-a115-add6966dfba3-kube-api-access-m7nrk\") pod \"cert-manager-webhook-7dc76cbb94-mrxch\" (UID: \"74eec215-35fa-471d-a115-add6966dfba3\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-mrxch" Jun 11 14:35:51.863120 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:35:51.863040 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-mrxch" Jun 11 14:35:51.995433 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:35:51.995395 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-mrxch"] Jun 11 14:35:51.998334 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:35:51.998296 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod74eec215_35fa_471d_a115_add6966dfba3.slice/crio-7ebebd1ee1c9b8c41e0bfdfade0b51c57afdc2db99b60b1f314eebc94e2aea7e WatchSource:0}: Error finding container 7ebebd1ee1c9b8c41e0bfdfade0b51c57afdc2db99b60b1f314eebc94e2aea7e: Status 404 returned error can't find the container with id 7ebebd1ee1c9b8c41e0bfdfade0b51c57afdc2db99b60b1f314eebc94e2aea7e Jun 11 14:35:52.000457 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:35:52.000437 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 14:35:52.858785 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:35:52.858723 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-mrxch" event={"ID":"74eec215-35fa-471d-a115-add6966dfba3","Type":"ContainerStarted","Data":"7ebebd1ee1c9b8c41e0bfdfade0b51c57afdc2db99b60b1f314eebc94e2aea7e"} Jun 11 14:35:55.874189 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:35:55.874154 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-mrxch" event={"ID":"74eec215-35fa-471d-a115-add6966dfba3","Type":"ContainerStarted","Data":"17922dedd2dbd6ca96143306db04bbcc18d74c33ababfaceaa8b9f4bd8f6591b"} Jun 11 14:35:55.874648 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:35:55.874292 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-mrxch" Jun 11 14:35:55.893739 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:35:55.893680 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-mrxch" podStartSLOduration=1.727172549 podStartE2EDuration="4.893664447s" totalImagesPullingTime="3.166491898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:35:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:35:55.892438299 +0000 UTC m=+463.225015794" watchObservedRunningTime="2026-06-11 14:35:55.893664447 +0000 UTC m=+463.226241920" Jun 11 14:36:01.880833 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:01.880804 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-mrxch" Jun 11 14:36:02.700248 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:02.700212 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gh6mv"] Jun 11 14:36:02.703511 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:02.703493 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gh6mv" Jun 11 14:36:02.706023 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:02.706003 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 11 14:36:02.706138 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:02.706081 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 11 14:36:02.706138 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:02.706097 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-6kxsw\"" Jun 11 14:36:02.713975 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:02.713951 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gh6mv"] Jun 11 14:36:02.820701 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:02.820649 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f5225c7-966f-4f9f-addf-7a90ff254868-tmp\") pod \"openshift-lws-operator-fd8ccff4c-gh6mv\" (UID: \"7f5225c7-966f-4f9f-addf-7a90ff254868\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gh6mv" Jun 11 14:36:02.820899 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:02.820719 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dgc8d\" (UniqueName: \"kubernetes.io/projected/7f5225c7-966f-4f9f-addf-7a90ff254868-kube-api-access-dgc8d\") pod \"openshift-lws-operator-fd8ccff4c-gh6mv\" (UID: \"7f5225c7-966f-4f9f-addf-7a90ff254868\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gh6mv" Jun 11 14:36:02.921568 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:02.921531 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dgc8d\" (UniqueName: \"kubernetes.io/projected/7f5225c7-966f-4f9f-addf-7a90ff254868-kube-api-access-dgc8d\") pod \"openshift-lws-operator-fd8ccff4c-gh6mv\" (UID: \"7f5225c7-966f-4f9f-addf-7a90ff254868\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gh6mv" Jun 11 14:36:02.921944 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:02.921598 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f5225c7-966f-4f9f-addf-7a90ff254868-tmp\") pod \"openshift-lws-operator-fd8ccff4c-gh6mv\" (UID: \"7f5225c7-966f-4f9f-addf-7a90ff254868\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gh6mv" Jun 11 14:36:02.921944 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:02.921925 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7f5225c7-966f-4f9f-addf-7a90ff254868-tmp\") pod \"openshift-lws-operator-fd8ccff4c-gh6mv\" (UID: \"7f5225c7-966f-4f9f-addf-7a90ff254868\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gh6mv" Jun 11 14:36:02.930215 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:02.930189 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dgc8d\" (UniqueName: \"kubernetes.io/projected/7f5225c7-966f-4f9f-addf-7a90ff254868-kube-api-access-dgc8d\") pod \"openshift-lws-operator-fd8ccff4c-gh6mv\" (UID: \"7f5225c7-966f-4f9f-addf-7a90ff254868\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gh6mv" Jun 11 14:36:03.012523 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:03.012466 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gh6mv" Jun 11 14:36:03.157016 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:03.156989 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gh6mv"] Jun 11 14:36:03.159612 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:36:03.159583 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7f5225c7_966f_4f9f_addf_7a90ff254868.slice/crio-dafccdef1d2f04b1834610a49be36cdf549bac9bc5cb65556e7c3c3ac9bd4951 WatchSource:0}: Error finding container dafccdef1d2f04b1834610a49be36cdf549bac9bc5cb65556e7c3c3ac9bd4951: Status 404 returned error can't find the container with id dafccdef1d2f04b1834610a49be36cdf549bac9bc5cb65556e7c3c3ac9bd4951 Jun 11 14:36:03.906781 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:03.906746 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gh6mv" event={"ID":"7f5225c7-966f-4f9f-addf-7a90ff254868","Type":"ContainerStarted","Data":"dafccdef1d2f04b1834610a49be36cdf549bac9bc5cb65556e7c3c3ac9bd4951"} Jun 11 14:36:06.921799 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:06.921704 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gh6mv" event={"ID":"7f5225c7-966f-4f9f-addf-7a90ff254868","Type":"ContainerStarted","Data":"b3f3d81ed2d0f7e73d3ef7bc3e0dcee544e224ee9d42509ff8dd21e431130165"} Jun 11 14:36:06.939032 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:06.938981 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-gh6mv" podStartSLOduration=1.472927304 podStartE2EDuration="4.938966929s" totalImagesPullingTime="3.466039625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:36:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:36:06.937999876 +0000 UTC m=+474.270577351" watchObservedRunningTime="2026-06-11 14:36:06.938966929 +0000 UTC m=+474.271544403" Jun 11 14:36:25.957049 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:25.957016 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7cbcf64465-kn5w4"] Jun 11 14:36:25.963108 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:25.963081 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-kn5w4" Jun 11 14:36:25.965823 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:25.965801 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 11 14:36:25.965921 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:25.965898 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 11 14:36:25.966215 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:25.966195 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 11 14:36:25.966215 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:25.966214 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 11 14:36:25.966389 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:25.966195 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-24gwh\"" Jun 11 14:36:25.982764 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:25.982743 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7cbcf64465-kn5w4"] Jun 11 14:36:26.113883 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:26.113841 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/45e801ef-ad77-4cf2-aec4-118d95ca05f6-manifests\") pod \"opendatahub-operator-controller-manager-7cbcf64465-kn5w4\" (UID: \"45e801ef-ad77-4cf2-aec4-118d95ca05f6\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-kn5w4" Jun 11 14:36:26.114071 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:26.113897 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/45e801ef-ad77-4cf2-aec4-118d95ca05f6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7cbcf64465-kn5w4\" (UID: \"45e801ef-ad77-4cf2-aec4-118d95ca05f6\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-kn5w4" Jun 11 14:36:26.114071 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:26.113930 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sll5\" (UniqueName: \"kubernetes.io/projected/45e801ef-ad77-4cf2-aec4-118d95ca05f6-kube-api-access-4sll5\") pod \"opendatahub-operator-controller-manager-7cbcf64465-kn5w4\" (UID: \"45e801ef-ad77-4cf2-aec4-118d95ca05f6\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-kn5w4" Jun 11 14:36:26.114071 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:26.113955 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/45e801ef-ad77-4cf2-aec4-118d95ca05f6-webhook-cert\") pod \"opendatahub-operator-controller-manager-7cbcf64465-kn5w4\" (UID: \"45e801ef-ad77-4cf2-aec4-118d95ca05f6\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-kn5w4" Jun 11 14:36:26.114071 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:26.114047 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45e801ef-ad77-4cf2-aec4-118d95ca05f6-tmp\") pod \"opendatahub-operator-controller-manager-7cbcf64465-kn5w4\" (UID: \"45e801ef-ad77-4cf2-aec4-118d95ca05f6\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-kn5w4" Jun 11 14:36:26.215356 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:26.215295 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/45e801ef-ad77-4cf2-aec4-118d95ca05f6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7cbcf64465-kn5w4\" (UID: \"45e801ef-ad77-4cf2-aec4-118d95ca05f6\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-kn5w4" Jun 11 14:36:26.215535 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:26.215374 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sll5\" (UniqueName: \"kubernetes.io/projected/45e801ef-ad77-4cf2-aec4-118d95ca05f6-kube-api-access-4sll5\") pod \"opendatahub-operator-controller-manager-7cbcf64465-kn5w4\" (UID: \"45e801ef-ad77-4cf2-aec4-118d95ca05f6\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-kn5w4" Jun 11 14:36:26.215535 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:26.215400 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/45e801ef-ad77-4cf2-aec4-118d95ca05f6-webhook-cert\") pod \"opendatahub-operator-controller-manager-7cbcf64465-kn5w4\" (UID: \"45e801ef-ad77-4cf2-aec4-118d95ca05f6\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-kn5w4" Jun 11 14:36:26.215535 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:26.215455 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45e801ef-ad77-4cf2-aec4-118d95ca05f6-tmp\") pod \"opendatahub-operator-controller-manager-7cbcf64465-kn5w4\" (UID: \"45e801ef-ad77-4cf2-aec4-118d95ca05f6\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-kn5w4" Jun 11 14:36:26.215535 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:26.215514 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/45e801ef-ad77-4cf2-aec4-118d95ca05f6-manifests\") pod \"opendatahub-operator-controller-manager-7cbcf64465-kn5w4\" (UID: \"45e801ef-ad77-4cf2-aec4-118d95ca05f6\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-kn5w4" Jun 11 14:36:26.215883 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:26.215863 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/45e801ef-ad77-4cf2-aec4-118d95ca05f6-manifests\") pod \"opendatahub-operator-controller-manager-7cbcf64465-kn5w4\" (UID: \"45e801ef-ad77-4cf2-aec4-118d95ca05f6\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-kn5w4" Jun 11 14:36:26.217888 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:26.217868 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/45e801ef-ad77-4cf2-aec4-118d95ca05f6-tmp\") pod \"opendatahub-operator-controller-manager-7cbcf64465-kn5w4\" (UID: \"45e801ef-ad77-4cf2-aec4-118d95ca05f6\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-kn5w4" Jun 11 14:36:26.218015 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:26.217999 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/45e801ef-ad77-4cf2-aec4-118d95ca05f6-apiservice-cert\") pod \"opendatahub-operator-controller-manager-7cbcf64465-kn5w4\" (UID: \"45e801ef-ad77-4cf2-aec4-118d95ca05f6\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-kn5w4" Jun 11 14:36:26.218196 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:26.218175 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/45e801ef-ad77-4cf2-aec4-118d95ca05f6-webhook-cert\") pod \"opendatahub-operator-controller-manager-7cbcf64465-kn5w4\" (UID: \"45e801ef-ad77-4cf2-aec4-118d95ca05f6\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-kn5w4" Jun 11 14:36:26.223783 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:26.223762 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sll5\" (UniqueName: \"kubernetes.io/projected/45e801ef-ad77-4cf2-aec4-118d95ca05f6-kube-api-access-4sll5\") pod \"opendatahub-operator-controller-manager-7cbcf64465-kn5w4\" (UID: \"45e801ef-ad77-4cf2-aec4-118d95ca05f6\") " pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-kn5w4" Jun 11 14:36:26.273608 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:26.273576 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-kn5w4" Jun 11 14:36:26.446135 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:26.446102 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-7cbcf64465-kn5w4"] Jun 11 14:36:26.450624 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:36:26.450600 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod45e801ef_ad77_4cf2_aec4_118d95ca05f6.slice/crio-ce1fef849cb62de644a89fa3280d7144733cf753c2f2a7243b5284e1e66e4302 WatchSource:0}: Error finding container ce1fef849cb62de644a89fa3280d7144733cf753c2f2a7243b5284e1e66e4302: Status 404 returned error can't find the container with id ce1fef849cb62de644a89fa3280d7144733cf753c2f2a7243b5284e1e66e4302 Jun 11 14:36:27.007865 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:27.007829 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-kn5w4" event={"ID":"45e801ef-ad77-4cf2-aec4-118d95ca05f6","Type":"ContainerStarted","Data":"ce1fef849cb62de644a89fa3280d7144733cf753c2f2a7243b5284e1e66e4302"} Jun 11 14:36:30.025632 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:30.025162 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-kn5w4" event={"ID":"45e801ef-ad77-4cf2-aec4-118d95ca05f6","Type":"ContainerStarted","Data":"08508b30654c4a2a8a1396ba3ab6c21d776710927f0d366eb196f42342ac4118"} Jun 11 14:36:32.035151 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:32.035117 2574 generic.go:356] "Generic (PLEG): container finished" podID="45e801ef-ad77-4cf2-aec4-118d95ca05f6" containerID="08508b30654c4a2a8a1396ba3ab6c21d776710927f0d366eb196f42342ac4118" exitCode=0 Jun 11 14:36:32.035151 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:32.035156 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-kn5w4" event={"ID":"45e801ef-ad77-4cf2-aec4-118d95ca05f6","Type":"ContainerDied","Data":"08508b30654c4a2a8a1396ba3ab6c21d776710927f0d366eb196f42342ac4118"} Jun 11 14:36:33.041914 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:33.041883 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-kn5w4" event={"ID":"45e801ef-ad77-4cf2-aec4-118d95ca05f6","Type":"ContainerStarted","Data":"11711248f90f9c25223719da25ceca133f05cb1f66909d13c3052dc0415bfc87"} Jun 11 14:36:33.042281 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:33.042096 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-kn5w4" Jun 11 14:36:33.073416 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:33.073364 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-kn5w4" podStartSLOduration=3.137363093 podStartE2EDuration="8.073320776s" totalImagesPullingTime="3.890214863s" totalInitContainerRuntime="1.04574282s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:36:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:36:33.071074763 +0000 UTC m=+500.403652236" watchObservedRunningTime="2026-06-11 14:36:33.073320776 +0000 UTC m=+500.405898311" Jun 11 14:36:44.049158 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:44.049126 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-7cbcf64465-kn5w4" Jun 11 14:36:55.278933 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:55.278896 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-868d864f-znsfk"] Jun 11 14:36:55.283976 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:55.283945 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-868d864f-znsfk" Jun 11 14:36:55.287378 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:55.287354 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-5rfx4\"" Jun 11 14:36:55.287500 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:55.287359 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 11 14:36:55.287500 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:55.287419 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 11 14:36:55.287500 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:55.287422 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 11 14:36:55.294995 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:55.294969 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-868d864f-znsfk"] Jun 11 14:36:55.354522 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:55.354488 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4141f22-2c05-4f75-908a-fc9fd7f2faef-cert\") pod \"lws-controller-manager-868d864f-znsfk\" (UID: \"f4141f22-2c05-4f75-908a-fc9fd7f2faef\") " pod="openshift-lws-operator/lws-controller-manager-868d864f-znsfk" Jun 11 14:36:55.354693 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:55.354529 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrfzg\" (UniqueName: \"kubernetes.io/projected/f4141f22-2c05-4f75-908a-fc9fd7f2faef-kube-api-access-xrfzg\") pod \"lws-controller-manager-868d864f-znsfk\" (UID: \"f4141f22-2c05-4f75-908a-fc9fd7f2faef\") " pod="openshift-lws-operator/lws-controller-manager-868d864f-znsfk" Jun 11 14:36:55.354693 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:55.354602 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f4141f22-2c05-4f75-908a-fc9fd7f2faef-metrics-cert\") pod \"lws-controller-manager-868d864f-znsfk\" (UID: \"f4141f22-2c05-4f75-908a-fc9fd7f2faef\") " pod="openshift-lws-operator/lws-controller-manager-868d864f-znsfk" Jun 11 14:36:55.354693 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:55.354644 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f4141f22-2c05-4f75-908a-fc9fd7f2faef-manager-config\") pod \"lws-controller-manager-868d864f-znsfk\" (UID: \"f4141f22-2c05-4f75-908a-fc9fd7f2faef\") " pod="openshift-lws-operator/lws-controller-manager-868d864f-znsfk" Jun 11 14:36:55.455436 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:55.455398 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f4141f22-2c05-4f75-908a-fc9fd7f2faef-metrics-cert\") pod \"lws-controller-manager-868d864f-znsfk\" (UID: \"f4141f22-2c05-4f75-908a-fc9fd7f2faef\") " pod="openshift-lws-operator/lws-controller-manager-868d864f-znsfk" Jun 11 14:36:55.455624 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:55.455475 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f4141f22-2c05-4f75-908a-fc9fd7f2faef-manager-config\") pod \"lws-controller-manager-868d864f-znsfk\" (UID: \"f4141f22-2c05-4f75-908a-fc9fd7f2faef\") " pod="openshift-lws-operator/lws-controller-manager-868d864f-znsfk" Jun 11 14:36:55.455624 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:55.455521 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4141f22-2c05-4f75-908a-fc9fd7f2faef-cert\") pod \"lws-controller-manager-868d864f-znsfk\" (UID: \"f4141f22-2c05-4f75-908a-fc9fd7f2faef\") " pod="openshift-lws-operator/lws-controller-manager-868d864f-znsfk" Jun 11 14:36:55.455624 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:55.455558 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrfzg\" (UniqueName: \"kubernetes.io/projected/f4141f22-2c05-4f75-908a-fc9fd7f2faef-kube-api-access-xrfzg\") pod \"lws-controller-manager-868d864f-znsfk\" (UID: \"f4141f22-2c05-4f75-908a-fc9fd7f2faef\") " pod="openshift-lws-operator/lws-controller-manager-868d864f-znsfk" Jun 11 14:36:55.456393 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:55.456362 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f4141f22-2c05-4f75-908a-fc9fd7f2faef-manager-config\") pod \"lws-controller-manager-868d864f-znsfk\" (UID: \"f4141f22-2c05-4f75-908a-fc9fd7f2faef\") " pod="openshift-lws-operator/lws-controller-manager-868d864f-znsfk" Jun 11 14:36:55.458411 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:55.458390 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f4141f22-2c05-4f75-908a-fc9fd7f2faef-metrics-cert\") pod \"lws-controller-manager-868d864f-znsfk\" (UID: \"f4141f22-2c05-4f75-908a-fc9fd7f2faef\") " pod="openshift-lws-operator/lws-controller-manager-868d864f-znsfk" Jun 11 14:36:55.458411 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:55.458404 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f4141f22-2c05-4f75-908a-fc9fd7f2faef-cert\") pod \"lws-controller-manager-868d864f-znsfk\" (UID: \"f4141f22-2c05-4f75-908a-fc9fd7f2faef\") " pod="openshift-lws-operator/lws-controller-manager-868d864f-znsfk" Jun 11 14:36:55.467758 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:55.467731 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrfzg\" (UniqueName: \"kubernetes.io/projected/f4141f22-2c05-4f75-908a-fc9fd7f2faef-kube-api-access-xrfzg\") pod \"lws-controller-manager-868d864f-znsfk\" (UID: \"f4141f22-2c05-4f75-908a-fc9fd7f2faef\") " pod="openshift-lws-operator/lws-controller-manager-868d864f-znsfk" Jun 11 14:36:55.594144 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:55.594046 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-868d864f-znsfk" Jun 11 14:36:55.734501 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:55.734475 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-868d864f-znsfk"] Jun 11 14:36:55.736226 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:36:55.736202 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4141f22_2c05_4f75_908a_fc9fd7f2faef.slice/crio-70275dbb1a4b95362ac024c7eea85e36630c8a67329f4242d207d7b6a59610ce WatchSource:0}: Error finding container 70275dbb1a4b95362ac024c7eea85e36630c8a67329f4242d207d7b6a59610ce: Status 404 returned error can't find the container with id 70275dbb1a4b95362ac024c7eea85e36630c8a67329f4242d207d7b6a59610ce Jun 11 14:36:56.143885 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:56.143848 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-868d864f-znsfk" event={"ID":"f4141f22-2c05-4f75-908a-fc9fd7f2faef","Type":"ContainerStarted","Data":"70275dbb1a4b95362ac024c7eea85e36630c8a67329f4242d207d7b6a59610ce"} Jun 11 14:36:58.156481 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:58.156444 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-868d864f-znsfk" event={"ID":"f4141f22-2c05-4f75-908a-fc9fd7f2faef","Type":"ContainerStarted","Data":"2c59bc9a3e1e47526b7bfcce16968212f2a85a764c0602fc31ea48dad405b804"} Jun 11 14:36:58.157018 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:58.156593 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-868d864f-znsfk" Jun 11 14:36:58.310114 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:36:58.310051 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-868d864f-znsfk" podStartSLOduration=1.523599336 podStartE2EDuration="3.310034556s" totalImagesPullingTime="1.78643522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:36:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:36:58.309166659 +0000 UTC m=+525.641744134" watchObservedRunningTime="2026-06-11 14:36:58.310034556 +0000 UTC m=+525.642612029" Jun 11 14:37:09.167102 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:09.167014 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-868d864f-znsfk" Jun 11 14:37:21.218438 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:21.218400 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k95ws"] Jun 11 14:37:21.225725 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:21.225693 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k95ws" Jun 11 14:37:21.228515 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:21.228492 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 11 14:37:21.228642 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:21.228598 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jun 11 14:37:21.228642 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:21.228612 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-pjmlx\"" Jun 11 14:37:21.228755 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:21.228742 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 11 14:37:21.247207 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:21.247182 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k95ws"] Jun 11 14:37:21.381729 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:21.381696 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0be5a05a-19fa-406d-a49e-fa0d3a356fdd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k95ws\" (UID: \"0be5a05a-19fa-406d-a49e-fa0d3a356fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k95ws" Jun 11 14:37:21.381915 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:21.381746 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0be5a05a-19fa-406d-a49e-fa0d3a356fdd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k95ws\" (UID: \"0be5a05a-19fa-406d-a49e-fa0d3a356fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k95ws" Jun 11 14:37:21.381915 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:21.381815 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0be5a05a-19fa-406d-a49e-fa0d3a356fdd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k95ws\" (UID: \"0be5a05a-19fa-406d-a49e-fa0d3a356fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k95ws" Jun 11 14:37:21.381915 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:21.381858 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ps8d\" (UniqueName: \"kubernetes.io/projected/0be5a05a-19fa-406d-a49e-fa0d3a356fdd-kube-api-access-5ps8d\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k95ws\" (UID: \"0be5a05a-19fa-406d-a49e-fa0d3a356fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k95ws" Jun 11 14:37:21.381915 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:21.381876 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0be5a05a-19fa-406d-a49e-fa0d3a356fdd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k95ws\" (UID: \"0be5a05a-19fa-406d-a49e-fa0d3a356fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k95ws" Jun 11 14:37:21.381915 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:21.381894 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0be5a05a-19fa-406d-a49e-fa0d3a356fdd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k95ws\" (UID: \"0be5a05a-19fa-406d-a49e-fa0d3a356fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k95ws" Jun 11 14:37:21.381915 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:21.381909 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0be5a05a-19fa-406d-a49e-fa0d3a356fdd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k95ws\" (UID: \"0be5a05a-19fa-406d-a49e-fa0d3a356fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k95ws" Jun 11 14:37:21.382140 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:21.381925 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0be5a05a-19fa-406d-a49e-fa0d3a356fdd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k95ws\" (UID: \"0be5a05a-19fa-406d-a49e-fa0d3a356fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k95ws" Jun 11 14:37:21.382140 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:21.381968 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0be5a05a-19fa-406d-a49e-fa0d3a356fdd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k95ws\" (UID: \"0be5a05a-19fa-406d-a49e-fa0d3a356fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k95ws" Jun 11 14:37:21.483135 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:21.483048 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0be5a05a-19fa-406d-a49e-fa0d3a356fdd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k95ws\" (UID: \"0be5a05a-19fa-406d-a49e-fa0d3a356fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k95ws" Jun 11 14:37:21.483135 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:21.483097 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0be5a05a-19fa-406d-a49e-fa0d3a356fdd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k95ws\" (UID: \"0be5a05a-19fa-406d-a49e-fa0d3a356fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k95ws" Jun 11 14:37:21.483386 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:21.483289 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0be5a05a-19fa-406d-a49e-fa0d3a356fdd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k95ws\" (UID: \"0be5a05a-19fa-406d-a49e-fa0d3a356fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k95ws" Jun 11 14:37:21.483460 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:21.483415 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ps8d\" (UniqueName: \"kubernetes.io/projected/0be5a05a-19fa-406d-a49e-fa0d3a356fdd-kube-api-access-5ps8d\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k95ws\" (UID: \"0be5a05a-19fa-406d-a49e-fa0d3a356fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k95ws" Jun 11 14:37:21.483460 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:21.483450 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0be5a05a-19fa-406d-a49e-fa0d3a356fdd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k95ws\" (UID: \"0be5a05a-19fa-406d-a49e-fa0d3a356fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k95ws" Jun 11 14:37:21.483574 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:21.483462 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0be5a05a-19fa-406d-a49e-fa0d3a356fdd-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k95ws\" (UID: \"0be5a05a-19fa-406d-a49e-fa0d3a356fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k95ws" Jun 11 14:37:21.483574 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:21.483500 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0be5a05a-19fa-406d-a49e-fa0d3a356fdd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k95ws\" (UID: \"0be5a05a-19fa-406d-a49e-fa0d3a356fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k95ws" Jun 11 14:37:21.483574 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:21.483524 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0be5a05a-19fa-406d-a49e-fa0d3a356fdd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k95ws\" (UID: \"0be5a05a-19fa-406d-a49e-fa0d3a356fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k95ws" Jun 11 14:37:21.483574 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:21.483541 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0be5a05a-19fa-406d-a49e-fa0d3a356fdd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k95ws\" (UID: \"0be5a05a-19fa-406d-a49e-fa0d3a356fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k95ws" Jun 11 14:37:21.483574 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:21.483567 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0be5a05a-19fa-406d-a49e-fa0d3a356fdd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k95ws\" (UID: \"0be5a05a-19fa-406d-a49e-fa0d3a356fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k95ws" Jun 11 14:37:21.483830 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:21.483580 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0be5a05a-19fa-406d-a49e-fa0d3a356fdd-istio-data\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k95ws\" (UID: \"0be5a05a-19fa-406d-a49e-fa0d3a356fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k95ws" Jun 11 14:37:21.483830 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:21.483768 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0be5a05a-19fa-406d-a49e-fa0d3a356fdd-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k95ws\" (UID: \"0be5a05a-19fa-406d-a49e-fa0d3a356fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k95ws" Jun 11 14:37:21.483942 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:21.483924 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0be5a05a-19fa-406d-a49e-fa0d3a356fdd-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k95ws\" (UID: \"0be5a05a-19fa-406d-a49e-fa0d3a356fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k95ws" Jun 11 14:37:21.484218 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:21.484170 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0be5a05a-19fa-406d-a49e-fa0d3a356fdd-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k95ws\" (UID: \"0be5a05a-19fa-406d-a49e-fa0d3a356fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k95ws" Jun 11 14:37:21.485697 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:21.485675 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0be5a05a-19fa-406d-a49e-fa0d3a356fdd-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k95ws\" (UID: \"0be5a05a-19fa-406d-a49e-fa0d3a356fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k95ws" Jun 11 14:37:21.485783 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:21.485726 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0be5a05a-19fa-406d-a49e-fa0d3a356fdd-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k95ws\" (UID: \"0be5a05a-19fa-406d-a49e-fa0d3a356fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k95ws" Jun 11 14:37:21.498103 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:21.498069 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0be5a05a-19fa-406d-a49e-fa0d3a356fdd-istio-token\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k95ws\" (UID: \"0be5a05a-19fa-406d-a49e-fa0d3a356fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k95ws" Jun 11 14:37:21.498297 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:21.498279 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ps8d\" (UniqueName: \"kubernetes.io/projected/0be5a05a-19fa-406d-a49e-fa0d3a356fdd-kube-api-access-5ps8d\") pod \"data-science-gateway-data-science-gateway-class-74759f9795k95ws\" (UID: \"0be5a05a-19fa-406d-a49e-fa0d3a356fdd\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k95ws" Jun 11 14:37:21.536655 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:21.536626 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k95ws" Jun 11 14:37:21.676157 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:21.676130 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k95ws"] Jun 11 14:37:21.677939 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:37:21.677913 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0be5a05a_19fa_406d_a49e_fa0d3a356fdd.slice/crio-8f2ac6c227fb9a05e7bb0d24a71f7a6939cd4c2bcda2ea23fc8cb6c73e257f9b WatchSource:0}: Error finding container 8f2ac6c227fb9a05e7bb0d24a71f7a6939cd4c2bcda2ea23fc8cb6c73e257f9b: Status 404 returned error can't find the container with id 8f2ac6c227fb9a05e7bb0d24a71f7a6939cd4c2bcda2ea23fc8cb6c73e257f9b Jun 11 14:37:22.268708 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:22.268674 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k95ws" event={"ID":"0be5a05a-19fa-406d-a49e-fa0d3a356fdd","Type":"ContainerStarted","Data":"8f2ac6c227fb9a05e7bb0d24a71f7a6939cd4c2bcda2ea23fc8cb6c73e257f9b"} Jun 11 14:37:25.599244 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:25.599201 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 11 14:37:25.599528 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:25.599284 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 11 14:37:25.599528 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:25.599312 2574 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892160Ki","pods":"250"} Jun 11 14:37:26.289280 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:26.289246 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k95ws" event={"ID":"0be5a05a-19fa-406d-a49e-fa0d3a356fdd","Type":"ContainerStarted","Data":"cda9de5c5eb2fcd7f442e701c5ef1bd5cedec848e9883ca64183abadafa22120"} Jun 11 14:37:26.310735 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:26.310678 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k95ws" podStartSLOduration=1.3917525689999999 podStartE2EDuration="5.310660366s" totalImagesPullingTime="3.918907797s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:37:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:37:26.308910432 +0000 UTC m=+553.641487927" watchObservedRunningTime="2026-06-11 14:37:26.310660366 +0000 UTC m=+553.643237839" Jun 11 14:37:26.537316 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:26.537273 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k95ws" Jun 11 14:37:26.541836 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:26.541774 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k95ws" Jun 11 14:37:26.755742 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:26.755699 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/dashboard-redirect-67cd5f7d45-7gdld"] Jun 11 14:37:26.758900 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:26.758880 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-67cd5f7d45-7gdld" Jun 11 14:37:26.761299 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:26.761281 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-vdb6f\"" Jun 11 14:37:26.761435 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:26.761338 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"dashboard-redirect-config\"" Jun 11 14:37:26.768786 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:26.768763 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-67cd5f7d45-7gdld"] Jun 11 14:37:26.828962 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:26.828867 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/8393a887-f8f9-452b-98bb-e68bac2248b1-redirect-config\") pod \"dashboard-redirect-67cd5f7d45-7gdld\" (UID: \"8393a887-f8f9-452b-98bb-e68bac2248b1\") " pod="opendatahub/dashboard-redirect-67cd5f7d45-7gdld" Jun 11 14:37:26.829125 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:26.828982 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bv7c4\" (UniqueName: \"kubernetes.io/projected/8393a887-f8f9-452b-98bb-e68bac2248b1-kube-api-access-bv7c4\") pod \"dashboard-redirect-67cd5f7d45-7gdld\" (UID: \"8393a887-f8f9-452b-98bb-e68bac2248b1\") " pod="opendatahub/dashboard-redirect-67cd5f7d45-7gdld" Jun 11 14:37:26.930360 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:26.930293 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bv7c4\" (UniqueName: \"kubernetes.io/projected/8393a887-f8f9-452b-98bb-e68bac2248b1-kube-api-access-bv7c4\") pod \"dashboard-redirect-67cd5f7d45-7gdld\" (UID: \"8393a887-f8f9-452b-98bb-e68bac2248b1\") " pod="opendatahub/dashboard-redirect-67cd5f7d45-7gdld" Jun 11 14:37:26.930534 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:26.930376 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/8393a887-f8f9-452b-98bb-e68bac2248b1-redirect-config\") pod \"dashboard-redirect-67cd5f7d45-7gdld\" (UID: \"8393a887-f8f9-452b-98bb-e68bac2248b1\") " pod="opendatahub/dashboard-redirect-67cd5f7d45-7gdld" Jun 11 14:37:26.931080 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:26.931061 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"redirect-config\" (UniqueName: \"kubernetes.io/configmap/8393a887-f8f9-452b-98bb-e68bac2248b1-redirect-config\") pod \"dashboard-redirect-67cd5f7d45-7gdld\" (UID: \"8393a887-f8f9-452b-98bb-e68bac2248b1\") " pod="opendatahub/dashboard-redirect-67cd5f7d45-7gdld" Jun 11 14:37:26.939412 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:26.939378 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bv7c4\" (UniqueName: \"kubernetes.io/projected/8393a887-f8f9-452b-98bb-e68bac2248b1-kube-api-access-bv7c4\") pod \"dashboard-redirect-67cd5f7d45-7gdld\" (UID: \"8393a887-f8f9-452b-98bb-e68bac2248b1\") " pod="opendatahub/dashboard-redirect-67cd5f7d45-7gdld" Jun 11 14:37:27.071460 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:27.071422 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/dashboard-redirect-67cd5f7d45-7gdld" Jun 11 14:37:27.201616 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:27.201578 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/dashboard-redirect-67cd5f7d45-7gdld"] Jun 11 14:37:27.204587 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:37:27.204558 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8393a887_f8f9_452b_98bb_e68bac2248b1.slice/crio-f643837d3d38861c61cd077027e6c3cd2ef4f3e25a7582f642a2d06508b5791b WatchSource:0}: Error finding container f643837d3d38861c61cd077027e6c3cd2ef4f3e25a7582f642a2d06508b5791b: Status 404 returned error can't find the container with id f643837d3d38861c61cd077027e6c3cd2ef4f3e25a7582f642a2d06508b5791b Jun 11 14:37:27.295129 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:27.295098 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-67cd5f7d45-7gdld" event={"ID":"8393a887-f8f9-452b-98bb-e68bac2248b1","Type":"ContainerStarted","Data":"f643837d3d38861c61cd077027e6c3cd2ef4f3e25a7582f642a2d06508b5791b"} Jun 11 14:37:27.295308 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:27.295299 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k95ws" Jun 11 14:37:27.296229 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:27.296205 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-74759f9795k95ws" Jun 11 14:37:32.321751 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:32.321714 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/dashboard-redirect-67cd5f7d45-7gdld" event={"ID":"8393a887-f8f9-452b-98bb-e68bac2248b1","Type":"ContainerStarted","Data":"2c2d71bbc5ff64a37e2e204f6f2ce1f522f38e481ba9aa1909fe3bb58eb2461f"} Jun 11 14:37:32.338115 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:32.338059 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/dashboard-redirect-67cd5f7d45-7gdld" podStartSLOduration=1.6108552029999998 podStartE2EDuration="6.338043955s" totalImagesPullingTime="4.727188752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:37:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:37:32.33716219 +0000 UTC m=+559.669739662" watchObservedRunningTime="2026-06-11 14:37:32.338043955 +0000 UTC m=+559.670621428" Jun 11 14:37:47.524100 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:47.524066 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5j48k"] Jun 11 14:37:47.528623 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:47.528607 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5j48k" Jun 11 14:37:47.534936 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:47.534911 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 11 14:37:47.535115 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:47.534911 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 11 14:37:47.535186 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:47.534975 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-g6fbf\"" Jun 11 14:37:47.548412 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:47.548383 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5j48k"] Jun 11 14:37:47.619641 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:47.619597 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wb8jk\" (UniqueName: \"kubernetes.io/projected/f6a3bb53-d9ca-42df-bbe7-7e4177a746c0-kube-api-access-wb8jk\") pod \"kuadrant-operator-catalog-5j48k\" (UID: \"f6a3bb53-d9ca-42df-bbe7-7e4177a746c0\") " pod="kuadrant-system/kuadrant-operator-catalog-5j48k" Jun 11 14:37:47.720195 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:47.720160 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wb8jk\" (UniqueName: \"kubernetes.io/projected/f6a3bb53-d9ca-42df-bbe7-7e4177a746c0-kube-api-access-wb8jk\") pod \"kuadrant-operator-catalog-5j48k\" (UID: \"f6a3bb53-d9ca-42df-bbe7-7e4177a746c0\") " pod="kuadrant-system/kuadrant-operator-catalog-5j48k" Jun 11 14:37:47.732584 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:47.732556 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wb8jk\" (UniqueName: \"kubernetes.io/projected/f6a3bb53-d9ca-42df-bbe7-7e4177a746c0-kube-api-access-wb8jk\") pod \"kuadrant-operator-catalog-5j48k\" (UID: \"f6a3bb53-d9ca-42df-bbe7-7e4177a746c0\") " pod="kuadrant-system/kuadrant-operator-catalog-5j48k" Jun 11 14:37:47.815166 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:47.815064 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5j48k"] Jun 11 14:37:47.815448 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:47.815420 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5j48k" Jun 11 14:37:47.951702 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:47.951676 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5j48k"] Jun 11 14:37:47.953637 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:37:47.953608 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6a3bb53_d9ca_42df_bbe7_7e4177a746c0.slice/crio-3b096aabfe3fd2c049b34a015087e9882002ec450e91ef3cb2bd5e91dff18637 WatchSource:0}: Error finding container 3b096aabfe3fd2c049b34a015087e9882002ec450e91ef3cb2bd5e91dff18637: Status 404 returned error can't find the container with id 3b096aabfe3fd2c049b34a015087e9882002ec450e91ef3cb2bd5e91dff18637 Jun 11 14:37:48.038839 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:48.038806 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z5gkq"] Jun 11 14:37:48.043428 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:48.043410 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-z5gkq" Jun 11 14:37:48.059112 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:48.059082 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z5gkq"] Jun 11 14:37:48.123764 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:48.123667 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8zjj\" (UniqueName: \"kubernetes.io/projected/58e1e6cd-7577-424d-adc6-5e6261e6e48a-kube-api-access-v8zjj\") pod \"kuadrant-operator-catalog-z5gkq\" (UID: \"58e1e6cd-7577-424d-adc6-5e6261e6e48a\") " pod="kuadrant-system/kuadrant-operator-catalog-z5gkq" Jun 11 14:37:48.224971 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:48.224938 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8zjj\" (UniqueName: \"kubernetes.io/projected/58e1e6cd-7577-424d-adc6-5e6261e6e48a-kube-api-access-v8zjj\") pod \"kuadrant-operator-catalog-z5gkq\" (UID: \"58e1e6cd-7577-424d-adc6-5e6261e6e48a\") " pod="kuadrant-system/kuadrant-operator-catalog-z5gkq" Jun 11 14:37:48.233396 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:48.233368 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8zjj\" (UniqueName: \"kubernetes.io/projected/58e1e6cd-7577-424d-adc6-5e6261e6e48a-kube-api-access-v8zjj\") pod \"kuadrant-operator-catalog-z5gkq\" (UID: \"58e1e6cd-7577-424d-adc6-5e6261e6e48a\") " pod="kuadrant-system/kuadrant-operator-catalog-z5gkq" Jun 11 14:37:48.353220 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:48.353184 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-z5gkq" Jun 11 14:37:48.392418 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:48.392321 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5j48k" event={"ID":"f6a3bb53-d9ca-42df-bbe7-7e4177a746c0","Type":"ContainerStarted","Data":"3b096aabfe3fd2c049b34a015087e9882002ec450e91ef3cb2bd5e91dff18637"} Jun 11 14:37:48.486725 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:48.486690 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-z5gkq"] Jun 11 14:37:48.488830 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:37:48.488800 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58e1e6cd_7577_424d_adc6_5e6261e6e48a.slice/crio-9788e7c5b6902464e6ff2b3dba7be3de76aa31b6a297f91cbf2acb8e9f7c3b43 WatchSource:0}: Error finding container 9788e7c5b6902464e6ff2b3dba7be3de76aa31b6a297f91cbf2acb8e9f7c3b43: Status 404 returned error can't find the container with id 9788e7c5b6902464e6ff2b3dba7be3de76aa31b6a297f91cbf2acb8e9f7c3b43 Jun 11 14:37:49.399816 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:49.399775 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-z5gkq" event={"ID":"58e1e6cd-7577-424d-adc6-5e6261e6e48a","Type":"ContainerStarted","Data":"9788e7c5b6902464e6ff2b3dba7be3de76aa31b6a297f91cbf2acb8e9f7c3b43"} Jun 11 14:37:51.410025 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:51.409984 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5j48k" event={"ID":"f6a3bb53-d9ca-42df-bbe7-7e4177a746c0","Type":"ContainerStarted","Data":"0410ed6baf385c4a241227989765ec64f7d11a90d3281089c00ccdf68a27e2a4"} Jun 11 14:37:51.410539 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:51.410058 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-5j48k" podUID="f6a3bb53-d9ca-42df-bbe7-7e4177a746c0" containerName="registry-server" containerID="cri-o://0410ed6baf385c4a241227989765ec64f7d11a90d3281089c00ccdf68a27e2a4" gracePeriod=2 Jun 11 14:37:51.411745 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:51.411720 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-z5gkq" event={"ID":"58e1e6cd-7577-424d-adc6-5e6261e6e48a","Type":"ContainerStarted","Data":"bc9f4ecc38da397fa793a76d9e3675a4701840fbcff14280e0dfcff127d1d47c"} Jun 11 14:37:51.427984 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:51.427938 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-5j48k" podStartSLOduration=1.982852142 podStartE2EDuration="4.427922761s" totalImagesPullingTime="2.445070619s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:37:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:37:51.426029793 +0000 UTC m=+578.758607283" watchObservedRunningTime="2026-06-11 14:37:51.427922761 +0000 UTC m=+578.760500234" Jun 11 14:37:51.441637 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:51.441595 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-z5gkq" podStartSLOduration=1.5280350569999999 podStartE2EDuration="3.441580233s" totalImagesPullingTime="1.913545176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:37:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:37:51.440122174 +0000 UTC m=+578.772699647" watchObservedRunningTime="2026-06-11 14:37:51.441580233 +0000 UTC m=+578.774157704" Jun 11 14:37:51.663791 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:51.663731 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5j48k" Jun 11 14:37:51.756931 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:51.756905 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wb8jk\" (UniqueName: \"kubernetes.io/projected/f6a3bb53-d9ca-42df-bbe7-7e4177a746c0-kube-api-access-wb8jk\") pod \"f6a3bb53-d9ca-42df-bbe7-7e4177a746c0\" (UID: \"f6a3bb53-d9ca-42df-bbe7-7e4177a746c0\") " Jun 11 14:37:51.759202 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:51.759171 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f6a3bb53-d9ca-42df-bbe7-7e4177a746c0-kube-api-access-wb8jk" (OuterVolumeSpecName: "kube-api-access-wb8jk") pod "f6a3bb53-d9ca-42df-bbe7-7e4177a746c0" (UID: "f6a3bb53-d9ca-42df-bbe7-7e4177a746c0"). InnerVolumeSpecName "kube-api-access-wb8jk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:37:51.857805 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:51.857766 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wb8jk\" (UniqueName: \"kubernetes.io/projected/f6a3bb53-d9ca-42df-bbe7-7e4177a746c0-kube-api-access-wb8jk\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:37:52.418014 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:52.417979 2574 generic.go:356] "Generic (PLEG): container finished" podID="f6a3bb53-d9ca-42df-bbe7-7e4177a746c0" containerID="0410ed6baf385c4a241227989765ec64f7d11a90d3281089c00ccdf68a27e2a4" exitCode=0 Jun 11 14:37:52.418521 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:52.418029 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-5j48k" Jun 11 14:37:52.418521 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:52.418068 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5j48k" event={"ID":"f6a3bb53-d9ca-42df-bbe7-7e4177a746c0","Type":"ContainerDied","Data":"0410ed6baf385c4a241227989765ec64f7d11a90d3281089c00ccdf68a27e2a4"} Jun 11 14:37:52.418521 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:52.418131 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-5j48k" event={"ID":"f6a3bb53-d9ca-42df-bbe7-7e4177a746c0","Type":"ContainerDied","Data":"3b096aabfe3fd2c049b34a015087e9882002ec450e91ef3cb2bd5e91dff18637"} Jun 11 14:37:52.418521 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:52.418153 2574 scope.go:117] "RemoveContainer" containerID="0410ed6baf385c4a241227989765ec64f7d11a90d3281089c00ccdf68a27e2a4" Jun 11 14:37:52.427814 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:52.427796 2574 scope.go:117] "RemoveContainer" containerID="0410ed6baf385c4a241227989765ec64f7d11a90d3281089c00ccdf68a27e2a4" Jun 11 14:37:52.428084 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:37:52.428067 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0410ed6baf385c4a241227989765ec64f7d11a90d3281089c00ccdf68a27e2a4\": container with ID starting with 0410ed6baf385c4a241227989765ec64f7d11a90d3281089c00ccdf68a27e2a4 not found: ID does not exist" containerID="0410ed6baf385c4a241227989765ec64f7d11a90d3281089c00ccdf68a27e2a4" Jun 11 14:37:52.428141 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:52.428096 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0410ed6baf385c4a241227989765ec64f7d11a90d3281089c00ccdf68a27e2a4"} err="failed to get container status \"0410ed6baf385c4a241227989765ec64f7d11a90d3281089c00ccdf68a27e2a4\": rpc error: code = NotFound desc = could not find container \"0410ed6baf385c4a241227989765ec64f7d11a90d3281089c00ccdf68a27e2a4\": container with ID starting with 0410ed6baf385c4a241227989765ec64f7d11a90d3281089c00ccdf68a27e2a4 not found: ID does not exist" Jun 11 14:37:52.440969 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:52.440945 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5j48k"] Jun 11 14:37:52.445382 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:52.445361 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-5j48k"] Jun 11 14:37:53.113509 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:53.113479 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f6a3bb53-d9ca-42df-bbe7-7e4177a746c0" path="/var/lib/kubelet/pods/f6a3bb53-d9ca-42df-bbe7-7e4177a746c0/volumes" Jun 11 14:37:58.354182 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:58.354149 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-z5gkq" Jun 11 14:37:58.354726 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:58.354206 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-z5gkq" Jun 11 14:37:58.376639 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:58.376616 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-z5gkq" Jun 11 14:37:58.467977 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:37:58.467948 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-z5gkq" Jun 11 14:38:13.079726 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:13.079698 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5lpfx_c3a99230-0749-4f98-97a8-cd9f586e529e/console-operator/2.log" Jun 11 14:38:13.080672 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:13.080649 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5lpfx_c3a99230-0749-4f98-97a8-cd9f586e529e/console-operator/2.log" Jun 11 14:38:13.083352 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:13.083313 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qld5j_37cb9247-f8d1-4b39-a031-89f74f7a8e1b/ovn-acl-logging/0.log" Jun 11 14:38:13.084275 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:13.084260 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qld5j_37cb9247-f8d1-4b39-a031-89f74f7a8e1b/ovn-acl-logging/0.log" Jun 11 14:38:14.388048 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:14.388009 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9jj4r"] Jun 11 14:38:14.388582 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:14.388562 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f6a3bb53-d9ca-42df-bbe7-7e4177a746c0" containerName="registry-server" Jun 11 14:38:14.388658 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:14.388585 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="f6a3bb53-d9ca-42df-bbe7-7e4177a746c0" containerName="registry-server" Jun 11 14:38:14.388713 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:14.388692 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="f6a3bb53-d9ca-42df-bbe7-7e4177a746c0" containerName="registry-server" Jun 11 14:38:14.409483 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:14.409454 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9jj4r"] Jun 11 14:38:14.409666 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:14.409570 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9jj4r" Jun 11 14:38:14.415671 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:14.415643 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-z72cr\"" Jun 11 14:38:14.459512 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:14.459482 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bx8gt\" (UniqueName: \"kubernetes.io/projected/5082fde5-cf3e-4d25-b3d2-d1bc52453a41-kube-api-access-bx8gt\") pod \"authorino-operator-75cc8d5cb7-9jj4r\" (UID: \"5082fde5-cf3e-4d25-b3d2-d1bc52453a41\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9jj4r" Jun 11 14:38:14.560675 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:14.560641 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bx8gt\" (UniqueName: \"kubernetes.io/projected/5082fde5-cf3e-4d25-b3d2-d1bc52453a41-kube-api-access-bx8gt\") pod \"authorino-operator-75cc8d5cb7-9jj4r\" (UID: \"5082fde5-cf3e-4d25-b3d2-d1bc52453a41\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9jj4r" Jun 11 14:38:14.572367 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:14.572313 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bx8gt\" (UniqueName: \"kubernetes.io/projected/5082fde5-cf3e-4d25-b3d2-d1bc52453a41-kube-api-access-bx8gt\") pod \"authorino-operator-75cc8d5cb7-9jj4r\" (UID: \"5082fde5-cf3e-4d25-b3d2-d1bc52453a41\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9jj4r" Jun 11 14:38:14.720237 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:14.720211 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9jj4r" Jun 11 14:38:14.880955 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:14.880929 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9jj4r"] Jun 11 14:38:14.883749 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:38:14.883719 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5082fde5_cf3e_4d25_b3d2_d1bc52453a41.slice/crio-4933d1a1f9ad2b32c24ab4969fb28b700754a2358ad038c2af9172f14cd29ba3 WatchSource:0}: Error finding container 4933d1a1f9ad2b32c24ab4969fb28b700754a2358ad038c2af9172f14cd29ba3: Status 404 returned error can't find the container with id 4933d1a1f9ad2b32c24ab4969fb28b700754a2358ad038c2af9172f14cd29ba3 Jun 11 14:38:15.527772 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:15.527725 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9jj4r" event={"ID":"5082fde5-cf3e-4d25-b3d2-d1bc52453a41","Type":"ContainerStarted","Data":"4933d1a1f9ad2b32c24ab4969fb28b700754a2358ad038c2af9172f14cd29ba3"} Jun 11 14:38:17.166303 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:17.166278 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2d2fr"] Jun 11 14:38:17.170837 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:17.170822 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2d2fr" Jun 11 14:38:17.175669 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:17.175651 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-r9brz\"" Jun 11 14:38:17.175726 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:17.175660 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jun 11 14:38:17.191867 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:17.191842 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlkhc\" (UniqueName: \"kubernetes.io/projected/0df91591-35ff-4b11-8f7c-eda6377690c7-kube-api-access-mlkhc\") pod \"dns-operator-controller-manager-864dd78c4c-2d2fr\" (UID: \"0df91591-35ff-4b11-8f7c-eda6377690c7\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2d2fr" Jun 11 14:38:17.194319 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:17.194298 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2d2fr"] Jun 11 14:38:17.293243 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:17.293213 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlkhc\" (UniqueName: \"kubernetes.io/projected/0df91591-35ff-4b11-8f7c-eda6377690c7-kube-api-access-mlkhc\") pod \"dns-operator-controller-manager-864dd78c4c-2d2fr\" (UID: \"0df91591-35ff-4b11-8f7c-eda6377690c7\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2d2fr" Jun 11 14:38:17.319885 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:17.319847 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlkhc\" (UniqueName: \"kubernetes.io/projected/0df91591-35ff-4b11-8f7c-eda6377690c7-kube-api-access-mlkhc\") pod \"dns-operator-controller-manager-864dd78c4c-2d2fr\" (UID: \"0df91591-35ff-4b11-8f7c-eda6377690c7\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2d2fr" Jun 11 14:38:17.490282 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:17.490242 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2d2fr" Jun 11 14:38:17.541811 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:17.541777 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9jj4r" event={"ID":"5082fde5-cf3e-4d25-b3d2-d1bc52453a41","Type":"ContainerStarted","Data":"4cd8e40d0f5f4dcf1c4cdcac1788c28a901e9729958dee20380d220df499fa36"} Jun 11 14:38:17.541984 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:17.541882 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9jj4r" Jun 11 14:38:17.668381 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:17.668302 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9jj4r" podStartSLOduration=1.414585277 podStartE2EDuration="3.668285731s" totalImagesPullingTime="2.253700454s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:38:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:38:17.588223117 +0000 UTC m=+604.920800591" watchObservedRunningTime="2026-06-11 14:38:17.668285731 +0000 UTC m=+605.000863242" Jun 11 14:38:17.669851 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:17.669826 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-2d2fr"] Jun 11 14:38:17.672222 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:38:17.672192 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0df91591_35ff_4b11_8f7c_eda6377690c7.slice/crio-ac1cc6cd33bcff785d7f093df88b8d346090ad78c891a35d91c4676e0c6a164c WatchSource:0}: Error finding container ac1cc6cd33bcff785d7f093df88b8d346090ad78c891a35d91c4676e0c6a164c: Status 404 returned error can't find the container with id ac1cc6cd33bcff785d7f093df88b8d346090ad78c891a35d91c4676e0c6a164c Jun 11 14:38:18.550943 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:18.550912 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2d2fr" event={"ID":"0df91591-35ff-4b11-8f7c-eda6377690c7","Type":"ContainerStarted","Data":"ac1cc6cd33bcff785d7f093df88b8d346090ad78c891a35d91c4676e0c6a164c"} Jun 11 14:38:19.779877 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:19.779367 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kj7c"] Jun 11 14:38:19.783219 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:19.783198 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kj7c" Jun 11 14:38:19.786958 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:19.786935 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-z4g24\"" Jun 11 14:38:19.804292 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:19.804257 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kj7c"] Jun 11 14:38:19.817513 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:19.817488 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n6psk\" (UniqueName: \"kubernetes.io/projected/42afceca-a587-4874-ac8a-09984ed59ae2-kube-api-access-n6psk\") pod \"limitador-operator-controller-manager-859d7b78bd-9kj7c\" (UID: \"42afceca-a587-4874-ac8a-09984ed59ae2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kj7c" Jun 11 14:38:19.918766 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:19.918721 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n6psk\" (UniqueName: \"kubernetes.io/projected/42afceca-a587-4874-ac8a-09984ed59ae2-kube-api-access-n6psk\") pod \"limitador-operator-controller-manager-859d7b78bd-9kj7c\" (UID: \"42afceca-a587-4874-ac8a-09984ed59ae2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kj7c" Jun 11 14:38:19.929121 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:19.929095 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-n6psk\" (UniqueName: \"kubernetes.io/projected/42afceca-a587-4874-ac8a-09984ed59ae2-kube-api-access-n6psk\") pod \"limitador-operator-controller-manager-859d7b78bd-9kj7c\" (UID: \"42afceca-a587-4874-ac8a-09984ed59ae2\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kj7c" Jun 11 14:38:20.093745 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:20.093663 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kj7c" Jun 11 14:38:20.467815 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:20.467786 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kj7c"] Jun 11 14:38:20.469488 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:38:20.469465 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod42afceca_a587_4874_ac8a_09984ed59ae2.slice/crio-b7e833a7ba8cca3e8b65916ceb7ba85a91439334597317080597114d30063041 WatchSource:0}: Error finding container b7e833a7ba8cca3e8b65916ceb7ba85a91439334597317080597114d30063041: Status 404 returned error can't find the container with id b7e833a7ba8cca3e8b65916ceb7ba85a91439334597317080597114d30063041 Jun 11 14:38:20.564154 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:20.564116 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kj7c" event={"ID":"42afceca-a587-4874-ac8a-09984ed59ae2","Type":"ContainerStarted","Data":"b7e833a7ba8cca3e8b65916ceb7ba85a91439334597317080597114d30063041"} Jun 11 14:38:20.565816 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:20.565792 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2d2fr" event={"ID":"0df91591-35ff-4b11-8f7c-eda6377690c7","Type":"ContainerStarted","Data":"8cfe0395c957e55f808534dbdda7e14c1209e8b866631fc23dafd8dfab807733"} Jun 11 14:38:20.565954 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:20.565852 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2d2fr" Jun 11 14:38:23.584292 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:23.584258 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kj7c" event={"ID":"42afceca-a587-4874-ac8a-09984ed59ae2","Type":"ContainerStarted","Data":"f758229ad083d286ac15efc7e353f4d36c1ef956473be3b2eb9764c2eafc449c"} Jun 11 14:38:23.584724 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:23.584381 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kj7c" Jun 11 14:38:23.608684 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:23.608621 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kj7c" podStartSLOduration=2.213925174 podStartE2EDuration="4.608598624s" totalImagesPullingTime="2.39467345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:38:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:38:23.60536737 +0000 UTC m=+610.937944843" watchObservedRunningTime="2026-06-11 14:38:23.608598624 +0000 UTC m=+610.941176101" Jun 11 14:38:23.608919 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:23.608893 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2d2fr" podStartSLOduration=3.9159368949999998 podStartE2EDuration="6.608881417s" totalImagesPullingTime="2.692944522s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:38:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:38:20.600712782 +0000 UTC m=+607.933290266" watchObservedRunningTime="2026-06-11 14:38:23.608881417 +0000 UTC m=+610.941458891" Jun 11 14:38:28.553632 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:28.553602 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9jj4r" Jun 11 14:38:31.572844 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:31.572771 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-2d2fr" Jun 11 14:38:34.591402 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:34.591370 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kj7c" Jun 11 14:38:45.507138 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:45.507103 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kj7c"] Jun 11 14:38:45.507534 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:45.507338 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kj7c" podUID="42afceca-a587-4874-ac8a-09984ed59ae2" containerName="manager" containerID="cri-o://f758229ad083d286ac15efc7e353f4d36c1ef956473be3b2eb9764c2eafc449c" gracePeriod=2 Jun 11 14:38:45.518541 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:45.518508 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kj7c"] Jun 11 14:38:45.637184 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:45.637148 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xzr4l"] Jun 11 14:38:45.637757 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:45.637734 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42afceca-a587-4874-ac8a-09984ed59ae2" containerName="manager" Jun 11 14:38:45.637757 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:45.637759 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="42afceca-a587-4874-ac8a-09984ed59ae2" containerName="manager" Jun 11 14:38:45.637960 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:45.637863 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="42afceca-a587-4874-ac8a-09984ed59ae2" containerName="manager" Jun 11 14:38:45.641288 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:45.641267 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xzr4l" Jun 11 14:38:45.646598 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:38:45.646565 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9kj7c\" is forbidden: User \"system:node:ip-10-0-135-108.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-108.ec2.internal' and this object" podUID="42afceca-a587-4874-ac8a-09984ed59ae2" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kj7c" Jun 11 14:38:45.693459 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:45.693426 2574 generic.go:356] "Generic (PLEG): container finished" podID="42afceca-a587-4874-ac8a-09984ed59ae2" containerID="f758229ad083d286ac15efc7e353f4d36c1ef956473be3b2eb9764c2eafc449c" exitCode=0 Jun 11 14:38:45.704524 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:45.704496 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xzr4l"] Jun 11 14:38:45.752781 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:45.752751 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kmfvg\" (UniqueName: \"kubernetes.io/projected/4116af36-9b01-4c99-88fe-b8c943020067-kube-api-access-kmfvg\") pod \"limitador-operator-controller-manager-859d7b78bd-xzr4l\" (UID: \"4116af36-9b01-4c99-88fe-b8c943020067\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xzr4l" Jun 11 14:38:45.774896 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:45.774873 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kj7c" Jun 11 14:38:45.777897 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:38:45.777869 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9kj7c\" is forbidden: User \"system:node:ip-10-0-135-108.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-108.ec2.internal' and this object" podUID="42afceca-a587-4874-ac8a-09984ed59ae2" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kj7c" Jun 11 14:38:45.853587 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:45.853552 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n6psk\" (UniqueName: \"kubernetes.io/projected/42afceca-a587-4874-ac8a-09984ed59ae2-kube-api-access-n6psk\") pod \"42afceca-a587-4874-ac8a-09984ed59ae2\" (UID: \"42afceca-a587-4874-ac8a-09984ed59ae2\") " Jun 11 14:38:45.853760 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:45.853749 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kmfvg\" (UniqueName: \"kubernetes.io/projected/4116af36-9b01-4c99-88fe-b8c943020067-kube-api-access-kmfvg\") pod \"limitador-operator-controller-manager-859d7b78bd-xzr4l\" (UID: \"4116af36-9b01-4c99-88fe-b8c943020067\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xzr4l" Jun 11 14:38:45.855770 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:45.855744 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/42afceca-a587-4874-ac8a-09984ed59ae2-kube-api-access-n6psk" (OuterVolumeSpecName: "kube-api-access-n6psk") pod "42afceca-a587-4874-ac8a-09984ed59ae2" (UID: "42afceca-a587-4874-ac8a-09984ed59ae2"). InnerVolumeSpecName "kube-api-access-n6psk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:38:45.940158 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:45.940128 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kmfvg\" (UniqueName: \"kubernetes.io/projected/4116af36-9b01-4c99-88fe-b8c943020067-kube-api-access-kmfvg\") pod \"limitador-operator-controller-manager-859d7b78bd-xzr4l\" (UID: \"4116af36-9b01-4c99-88fe-b8c943020067\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xzr4l" Jun 11 14:38:45.953932 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:45.953905 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xzr4l" Jun 11 14:38:45.954210 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:45.954193 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n6psk\" (UniqueName: \"kubernetes.io/projected/42afceca-a587-4874-ac8a-09984ed59ae2-kube-api-access-n6psk\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:38:46.137305 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:46.137281 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xzr4l"] Jun 11 14:38:46.139509 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:38:46.139484 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4116af36_9b01_4c99_88fe_b8c943020067.slice/crio-f33f2fdb0b905a348e8422d65e61724d67dc58f900cc9720edb1493b8599b718 WatchSource:0}: Error finding container f33f2fdb0b905a348e8422d65e61724d67dc58f900cc9720edb1493b8599b718: Status 404 returned error can't find the container with id f33f2fdb0b905a348e8422d65e61724d67dc58f900cc9720edb1493b8599b718 Jun 11 14:38:46.706343 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:46.706304 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kj7c" Jun 11 14:38:46.706795 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:46.706311 2574 scope.go:117] "RemoveContainer" containerID="f758229ad083d286ac15efc7e353f4d36c1ef956473be3b2eb9764c2eafc449c" Jun 11 14:38:46.707979 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:46.707947 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xzr4l" event={"ID":"4116af36-9b01-4c99-88fe-b8c943020067","Type":"ContainerStarted","Data":"9574bbf208fb5d02f893763a8615a5944288a1e01e96557eced17dee6fe3a7d5"} Jun 11 14:38:46.708084 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:46.708042 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xzr4l" event={"ID":"4116af36-9b01-4c99-88fe-b8c943020067","Type":"ContainerStarted","Data":"f33f2fdb0b905a348e8422d65e61724d67dc58f900cc9720edb1493b8599b718"} Jun 11 14:38:46.708084 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:46.708073 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xzr4l" Jun 11 14:38:46.710941 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:38:46.710906 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9kj7c\" is forbidden: User \"system:node:ip-10-0-135-108.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-108.ec2.internal' and this object" podUID="42afceca-a587-4874-ac8a-09984ed59ae2" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kj7c" Jun 11 14:38:46.747197 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:46.747154 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xzr4l" podStartSLOduration=1.747139977 podStartE2EDuration="1.747139977s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:38:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:38:46.744988418 +0000 UTC m=+634.077565891" watchObservedRunningTime="2026-06-11 14:38:46.747139977 +0000 UTC m=+634.079717451" Jun 11 14:38:46.756598 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:38:46.756571 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9kj7c\" is forbidden: User \"system:node:ip-10-0-135-108.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-108.ec2.internal' and this object" podUID="42afceca-a587-4874-ac8a-09984ed59ae2" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kj7c" Jun 11 14:38:46.759035 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:38:46.759011 2574 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-9kj7c\" is forbidden: User \"system:node:ip-10-0-135-108.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-135-108.ec2.internal' and this object" podUID="42afceca-a587-4874-ac8a-09984ed59ae2" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9kj7c" Jun 11 14:38:47.113232 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:47.113197 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="42afceca-a587-4874-ac8a-09984ed59ae2" path="/var/lib/kubelet/pods/42afceca-a587-4874-ac8a-09984ed59ae2/volumes" Jun 11 14:38:48.513519 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:48.513483 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mrj49"] Jun 11 14:38:48.518492 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:48.518473 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mrj49" Jun 11 14:38:48.522119 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:48.522100 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-fkrxw\"" Jun 11 14:38:48.550280 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:48.550248 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mrj49"] Jun 11 14:38:48.679881 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:48.679829 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x8g8g\" (UniqueName: \"kubernetes.io/projected/c4471894-8f94-40cf-890a-50e622b4e3aa-kube-api-access-x8g8g\") pod \"kuadrant-operator-controller-manager-86878c769f-mrj49\" (UID: \"c4471894-8f94-40cf-890a-50e622b4e3aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mrj49" Jun 11 14:38:48.680065 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:48.679899 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4471894-8f94-40cf-890a-50e622b4e3aa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mrj49\" (UID: \"c4471894-8f94-40cf-890a-50e622b4e3aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mrj49" Jun 11 14:38:48.781508 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:48.781395 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x8g8g\" (UniqueName: \"kubernetes.io/projected/c4471894-8f94-40cf-890a-50e622b4e3aa-kube-api-access-x8g8g\") pod \"kuadrant-operator-controller-manager-86878c769f-mrj49\" (UID: \"c4471894-8f94-40cf-890a-50e622b4e3aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mrj49" Jun 11 14:38:48.781508 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:48.781469 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4471894-8f94-40cf-890a-50e622b4e3aa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mrj49\" (UID: \"c4471894-8f94-40cf-890a-50e622b4e3aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mrj49" Jun 11 14:38:48.781830 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:48.781814 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4471894-8f94-40cf-890a-50e622b4e3aa-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-mrj49\" (UID: \"c4471894-8f94-40cf-890a-50e622b4e3aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mrj49" Jun 11 14:38:48.813933 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:48.813900 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x8g8g\" (UniqueName: \"kubernetes.io/projected/c4471894-8f94-40cf-890a-50e622b4e3aa-kube-api-access-x8g8g\") pod \"kuadrant-operator-controller-manager-86878c769f-mrj49\" (UID: \"c4471894-8f94-40cf-890a-50e622b4e3aa\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mrj49" Jun 11 14:38:48.828762 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:48.828739 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mrj49" Jun 11 14:38:49.025391 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:49.025251 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mrj49"] Jun 11 14:38:49.028201 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:38:49.028176 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4471894_8f94_40cf_890a_50e622b4e3aa.slice/crio-5fa0a0928c89f06a79f41d2b8b36983a785fc5b3317dbf42ff720c04725b186b WatchSource:0}: Error finding container 5fa0a0928c89f06a79f41d2b8b36983a785fc5b3317dbf42ff720c04725b186b: Status 404 returned error can't find the container with id 5fa0a0928c89f06a79f41d2b8b36983a785fc5b3317dbf42ff720c04725b186b Jun 11 14:38:49.726615 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:49.726576 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mrj49" event={"ID":"c4471894-8f94-40cf-890a-50e622b4e3aa","Type":"ContainerStarted","Data":"5fa0a0928c89f06a79f41d2b8b36983a785fc5b3317dbf42ff720c04725b186b"} Jun 11 14:38:54.763679 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:54.763638 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mrj49" event={"ID":"c4471894-8f94-40cf-890a-50e622b4e3aa","Type":"ContainerStarted","Data":"4afa16068dbdeef2a96c907ee67dd6c7600679fc296fd4c8f4487dd551b7b1f7"} Jun 11 14:38:54.764090 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:54.763733 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mrj49" Jun 11 14:38:54.803103 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:54.803048 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mrj49" podStartSLOduration=1.957898071 podStartE2EDuration="6.803033847s" totalImagesPullingTime="4.845135776s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:38:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:38:54.802471274 +0000 UTC m=+642.135048747" watchObservedRunningTime="2026-06-11 14:38:54.803033847 +0000 UTC m=+642.135611319" Jun 11 14:38:57.716828 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:38:57.716792 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-xzr4l" Jun 11 14:39:05.771482 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:39:05.771448 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mrj49" Jun 11 14:39:29.203086 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:39:29.203049 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-zn8bx"] Jun 11 14:39:29.206395 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:39:29.206371 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zn8bx" Jun 11 14:39:29.210222 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:39:29.210201 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-m6g5d\"" Jun 11 14:39:29.229686 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:39:29.229659 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zn8bx"] Jun 11 14:39:29.343221 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:39:29.343183 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjqcg\" (UniqueName: \"kubernetes.io/projected/68eb5e83-bb3e-4842-86f8-10bf22573c94-kube-api-access-fjqcg\") pod \"authorino-75d556bd77-zn8bx\" (UID: \"68eb5e83-bb3e-4842-86f8-10bf22573c94\") " pod="kuadrant-system/authorino-75d556bd77-zn8bx" Jun 11 14:39:29.443915 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:39:29.443881 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjqcg\" (UniqueName: \"kubernetes.io/projected/68eb5e83-bb3e-4842-86f8-10bf22573c94-kube-api-access-fjqcg\") pod \"authorino-75d556bd77-zn8bx\" (UID: \"68eb5e83-bb3e-4842-86f8-10bf22573c94\") " pod="kuadrant-system/authorino-75d556bd77-zn8bx" Jun 11 14:39:29.456115 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:39:29.456045 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjqcg\" (UniqueName: \"kubernetes.io/projected/68eb5e83-bb3e-4842-86f8-10bf22573c94-kube-api-access-fjqcg\") pod \"authorino-75d556bd77-zn8bx\" (UID: \"68eb5e83-bb3e-4842-86f8-10bf22573c94\") " pod="kuadrant-system/authorino-75d556bd77-zn8bx" Jun 11 14:39:29.515294 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:39:29.515252 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zn8bx" Jun 11 14:39:29.655186 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:39:29.655077 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zn8bx"] Jun 11 14:39:29.657661 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:39:29.657622 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod68eb5e83_bb3e_4842_86f8_10bf22573c94.slice/crio-3503a2cf8d9d9ed6d1703661f8c23f63a4e08d1db3fdebefb0ff76df67c1e25c WatchSource:0}: Error finding container 3503a2cf8d9d9ed6d1703661f8c23f63a4e08d1db3fdebefb0ff76df67c1e25c: Status 404 returned error can't find the container with id 3503a2cf8d9d9ed6d1703661f8c23f63a4e08d1db3fdebefb0ff76df67c1e25c Jun 11 14:39:29.932143 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:39:29.932108 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zn8bx" event={"ID":"68eb5e83-bb3e-4842-86f8-10bf22573c94","Type":"ContainerStarted","Data":"3503a2cf8d9d9ed6d1703661f8c23f63a4e08d1db3fdebefb0ff76df67c1e25c"} Jun 11 14:39:32.950481 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:39:32.950450 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zn8bx" event={"ID":"68eb5e83-bb3e-4842-86f8-10bf22573c94","Type":"ContainerStarted","Data":"69911fc430464792e06f60ca41327aa8afb00c0b693a4ca6096b9a10dc51eab7"} Jun 11 14:39:32.965518 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:39:32.965472 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-zn8bx" podStartSLOduration=0.737019732 podStartE2EDuration="3.965455954s" totalImagesPullingTime="3.228436222s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:39:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:39:32.964345109 +0000 UTC m=+680.296922580" watchObservedRunningTime="2026-06-11 14:39:32.965455954 +0000 UTC m=+680.298033427" Jun 11 14:40:28.698840 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:40:28.698805 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 14:40:28.703735 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:40:28.703713 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 14:40:28.708233 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:40:28.708212 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-zn7nl\"" Jun 11 14:40:28.708986 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:40:28.708964 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 14:40:28.708986 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:40:28.708981 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 14:40:28.709288 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:40:28.709271 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 14:40:28.722176 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:40:28.722153 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 14:40:28.850799 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:40:28.850767 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv4n2\" (UniqueName: \"kubernetes.io/projected/dd72c1bd-77c5-452f-ba7c-8afb8db38b8b-kube-api-access-pv4n2\") pod \"maas-keycloak-0\" (UID: \"dd72c1bd-77c5-452f-ba7c-8afb8db38b8b\") " pod="keycloak-system/maas-keycloak-0" Jun 11 14:40:28.952149 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:40:28.952063 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv4n2\" (UniqueName: \"kubernetes.io/projected/dd72c1bd-77c5-452f-ba7c-8afb8db38b8b-kube-api-access-pv4n2\") pod \"maas-keycloak-0\" (UID: \"dd72c1bd-77c5-452f-ba7c-8afb8db38b8b\") " pod="keycloak-system/maas-keycloak-0" Jun 11 14:40:28.961562 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:40:28.961533 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv4n2\" (UniqueName: \"kubernetes.io/projected/dd72c1bd-77c5-452f-ba7c-8afb8db38b8b-kube-api-access-pv4n2\") pod \"maas-keycloak-0\" (UID: \"dd72c1bd-77c5-452f-ba7c-8afb8db38b8b\") " pod="keycloak-system/maas-keycloak-0" Jun 11 14:40:29.013416 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:40:29.013376 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 14:40:29.152076 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:40:29.152049 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 14:40:29.153926 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:40:29.153896 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd72c1bd_77c5_452f_ba7c_8afb8db38b8b.slice/crio-596d3eb23f0eca25bf72595a98d2334fe52f45a47cf18d4d975f6358f08cee44 WatchSource:0}: Error finding container 596d3eb23f0eca25bf72595a98d2334fe52f45a47cf18d4d975f6358f08cee44: Status 404 returned error can't find the container with id 596d3eb23f0eca25bf72595a98d2334fe52f45a47cf18d4d975f6358f08cee44 Jun 11 14:40:29.230555 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:40:29.230520 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"dd72c1bd-77c5-452f-ba7c-8afb8db38b8b","Type":"ContainerStarted","Data":"596d3eb23f0eca25bf72595a98d2334fe52f45a47cf18d4d975f6358f08cee44"} Jun 11 14:40:36.273364 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:40:36.273296 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"dd72c1bd-77c5-452f-ba7c-8afb8db38b8b","Type":"ContainerStarted","Data":"196ac647c26a70c1dc645e059389c9e7737fcad26bc029dc16f5f6970a9f08aa"} Jun 11 14:40:36.296120 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:40:36.293389 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.98999885 podStartE2EDuration="8.293365866s" totalImagesPullingTime="6.303367016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:40:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:40:36.292917168 +0000 UTC m=+743.625494644" watchObservedRunningTime="2026-06-11 14:40:36.293365866 +0000 UTC m=+743.625943343" Jun 11 14:40:37.014246 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:40:37.014198 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 14:40:37.016441 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:40:37.016392 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dd72c1bd-77c5-452f-ba7c-8afb8db38b8b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 11 14:40:38.014778 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:40:38.014732 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dd72c1bd-77c5-452f-ba7c-8afb8db38b8b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 11 14:40:39.014300 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:40:39.014254 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 14:40:39.014629 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:40:39.014591 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dd72c1bd-77c5-452f-ba7c-8afb8db38b8b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 11 14:40:40.014756 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:40:40.014711 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dd72c1bd-77c5-452f-ba7c-8afb8db38b8b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 11 14:40:41.014278 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:40:41.014230 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dd72c1bd-77c5-452f-ba7c-8afb8db38b8b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 11 14:40:42.014472 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:40:42.014416 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dd72c1bd-77c5-452f-ba7c-8afb8db38b8b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 11 14:40:43.014718 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:40:43.014662 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dd72c1bd-77c5-452f-ba7c-8afb8db38b8b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 11 14:40:44.014124 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:40:44.014063 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dd72c1bd-77c5-452f-ba7c-8afb8db38b8b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 11 14:40:45.014177 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:40:45.014126 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dd72c1bd-77c5-452f-ba7c-8afb8db38b8b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 11 14:40:46.014096 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:40:46.014023 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dd72c1bd-77c5-452f-ba7c-8afb8db38b8b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 11 14:40:47.014587 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:40:47.014528 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dd72c1bd-77c5-452f-ba7c-8afb8db38b8b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 11 14:40:48.014339 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:40:48.014292 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="dd72c1bd-77c5-452f-ba7c-8afb8db38b8b" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.36:9000/health/started\": dial tcp 10.134.0.36:9000: connect: connection refused" Jun 11 14:40:49.141157 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:40:49.141111 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 14:40:49.158986 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:40:49.158939 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="dd72c1bd-77c5-452f-ba7c-8afb8db38b8b" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 14:40:59.148048 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:40:59.148011 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 14:41:00.092710 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:00.092673 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xdqb2"] Jun 11 14:41:00.100386 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:00.100365 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xdqb2" Jun 11 14:41:00.106207 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:00.106181 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xdqb2"] Jun 11 14:41:00.169720 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:00.169682 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-65bwc\" (UniqueName: \"kubernetes.io/projected/95ed7bd2-8052-4f4c-b132-f23acd63a642-kube-api-access-65bwc\") pod \"authorino-5d4b67c446-xdqb2\" (UID: \"95ed7bd2-8052-4f4c-b132-f23acd63a642\") " pod="kuadrant-system/authorino-5d4b67c446-xdqb2" Jun 11 14:41:00.271196 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:00.271160 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-65bwc\" (UniqueName: \"kubernetes.io/projected/95ed7bd2-8052-4f4c-b132-f23acd63a642-kube-api-access-65bwc\") pod \"authorino-5d4b67c446-xdqb2\" (UID: \"95ed7bd2-8052-4f4c-b132-f23acd63a642\") " pod="kuadrant-system/authorino-5d4b67c446-xdqb2" Jun 11 14:41:00.295980 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:00.295946 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-65bwc\" (UniqueName: \"kubernetes.io/projected/95ed7bd2-8052-4f4c-b132-f23acd63a642-kube-api-access-65bwc\") pod \"authorino-5d4b67c446-xdqb2\" (UID: \"95ed7bd2-8052-4f4c-b132-f23acd63a642\") " pod="kuadrant-system/authorino-5d4b67c446-xdqb2" Jun 11 14:41:00.357575 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:00.357483 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xdqb2"] Jun 11 14:41:00.357775 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:00.357762 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xdqb2" Jun 11 14:41:00.421960 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:00.421795 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-db66d64df-qzw5d"] Jun 11 14:41:00.425963 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:00.425898 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-db66d64df-qzw5d" Jun 11 14:41:00.441456 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:00.441432 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-db66d64df-qzw5d"] Jun 11 14:41:00.473186 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:00.473148 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pc7sm\" (UniqueName: \"kubernetes.io/projected/be226020-1ece-4baa-a54c-389e76f83879-kube-api-access-pc7sm\") pod \"authorino-db66d64df-qzw5d\" (UID: \"be226020-1ece-4baa-a54c-389e76f83879\") " pod="kuadrant-system/authorino-db66d64df-qzw5d" Jun 11 14:41:00.512538 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:00.512504 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xdqb2"] Jun 11 14:41:00.517295 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:41:00.517269 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod95ed7bd2_8052_4f4c_b132_f23acd63a642.slice/crio-c39166360c77285c622a00ff3bd5857ba462175311328d35d01890b5cc38f6cc WatchSource:0}: Error finding container c39166360c77285c622a00ff3bd5857ba462175311328d35d01890b5cc38f6cc: Status 404 returned error can't find the container with id c39166360c77285c622a00ff3bd5857ba462175311328d35d01890b5cc38f6cc Jun 11 14:41:00.518707 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:00.518687 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 14:41:00.574287 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:00.574253 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pc7sm\" (UniqueName: \"kubernetes.io/projected/be226020-1ece-4baa-a54c-389e76f83879-kube-api-access-pc7sm\") pod \"authorino-db66d64df-qzw5d\" (UID: \"be226020-1ece-4baa-a54c-389e76f83879\") " pod="kuadrant-system/authorino-db66d64df-qzw5d" Jun 11 14:41:00.593757 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:00.593724 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pc7sm\" (UniqueName: \"kubernetes.io/projected/be226020-1ece-4baa-a54c-389e76f83879-kube-api-access-pc7sm\") pod \"authorino-db66d64df-qzw5d\" (UID: \"be226020-1ece-4baa-a54c-389e76f83879\") " pod="kuadrant-system/authorino-db66d64df-qzw5d" Jun 11 14:41:00.656667 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:00.656584 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-db66d64df-qzw5d"] Jun 11 14:41:00.656872 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:00.656856 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-db66d64df-qzw5d" Jun 11 14:41:00.727601 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:00.727569 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6c67c4b665-fm8bj"] Jun 11 14:41:00.730414 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:00.730390 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c67c4b665-fm8bj" Jun 11 14:41:00.760169 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:00.760138 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 11 14:41:00.762101 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:00.762066 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6c67c4b665-fm8bj"] Jun 11 14:41:00.775979 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:00.775948 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e7e7768c-92ab-4023-960c-279a3f7d2119-tls-cert\") pod \"authorino-6c67c4b665-fm8bj\" (UID: \"e7e7768c-92ab-4023-960c-279a3f7d2119\") " pod="kuadrant-system/authorino-6c67c4b665-fm8bj" Jun 11 14:41:00.776127 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:00.776031 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jphmr\" (UniqueName: \"kubernetes.io/projected/e7e7768c-92ab-4023-960c-279a3f7d2119-kube-api-access-jphmr\") pod \"authorino-6c67c4b665-fm8bj\" (UID: \"e7e7768c-92ab-4023-960c-279a3f7d2119\") " pod="kuadrant-system/authorino-6c67c4b665-fm8bj" Jun 11 14:41:00.826272 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:00.826234 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-db66d64df-qzw5d"] Jun 11 14:41:00.832964 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:41:00.832935 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbe226020_1ece_4baa_a54c_389e76f83879.slice/crio-c16ac023d7b31120e88aeee18b998d793e047fff0cd527b50225ca42b30af456 WatchSource:0}: Error finding container c16ac023d7b31120e88aeee18b998d793e047fff0cd527b50225ca42b30af456: Status 404 returned error can't find the container with id c16ac023d7b31120e88aeee18b998d793e047fff0cd527b50225ca42b30af456 Jun 11 14:41:00.877472 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:00.877442 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e7e7768c-92ab-4023-960c-279a3f7d2119-tls-cert\") pod \"authorino-6c67c4b665-fm8bj\" (UID: \"e7e7768c-92ab-4023-960c-279a3f7d2119\") " pod="kuadrant-system/authorino-6c67c4b665-fm8bj" Jun 11 14:41:00.877619 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:00.877499 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jphmr\" (UniqueName: \"kubernetes.io/projected/e7e7768c-92ab-4023-960c-279a3f7d2119-kube-api-access-jphmr\") pod \"authorino-6c67c4b665-fm8bj\" (UID: \"e7e7768c-92ab-4023-960c-279a3f7d2119\") " pod="kuadrant-system/authorino-6c67c4b665-fm8bj" Jun 11 14:41:00.880279 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:00.880252 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e7e7768c-92ab-4023-960c-279a3f7d2119-tls-cert\") pod \"authorino-6c67c4b665-fm8bj\" (UID: \"e7e7768c-92ab-4023-960c-279a3f7d2119\") " pod="kuadrant-system/authorino-6c67c4b665-fm8bj" Jun 11 14:41:00.894086 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:00.894057 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jphmr\" (UniqueName: \"kubernetes.io/projected/e7e7768c-92ab-4023-960c-279a3f7d2119-kube-api-access-jphmr\") pod \"authorino-6c67c4b665-fm8bj\" (UID: \"e7e7768c-92ab-4023-960c-279a3f7d2119\") " pod="kuadrant-system/authorino-6c67c4b665-fm8bj" Jun 11 14:41:01.044711 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:01.044681 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c67c4b665-fm8bj" Jun 11 14:41:01.192878 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:01.192853 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6c67c4b665-fm8bj"] Jun 11 14:41:01.195855 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:41:01.195831 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode7e7768c_92ab_4023_960c_279a3f7d2119.slice/crio-3f296d24c37d61a9d87a6a3be2d8ecc4b39c8e02b0fa84e7980f18f335a8110a WatchSource:0}: Error finding container 3f296d24c37d61a9d87a6a3be2d8ecc4b39c8e02b0fa84e7980f18f335a8110a: Status 404 returned error can't find the container with id 3f296d24c37d61a9d87a6a3be2d8ecc4b39c8e02b0fa84e7980f18f335a8110a Jun 11 14:41:01.433633 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:01.433534 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-xdqb2" event={"ID":"95ed7bd2-8052-4f4c-b132-f23acd63a642","Type":"ContainerStarted","Data":"455f99a73f6188560c7307b0aa203a73772d0334de30e2c5564b07fc2f2a569c"} Jun 11 14:41:01.433633 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:01.433549 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-xdqb2" podUID="95ed7bd2-8052-4f4c-b132-f23acd63a642" containerName="authorino" containerID="cri-o://455f99a73f6188560c7307b0aa203a73772d0334de30e2c5564b07fc2f2a569c" gracePeriod=30 Jun 11 14:41:01.433633 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:01.433585 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-xdqb2" event={"ID":"95ed7bd2-8052-4f4c-b132-f23acd63a642","Type":"ContainerStarted","Data":"c39166360c77285c622a00ff3bd5857ba462175311328d35d01890b5cc38f6cc"} Jun 11 14:41:01.434907 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:01.434880 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c67c4b665-fm8bj" event={"ID":"e7e7768c-92ab-4023-960c-279a3f7d2119","Type":"ContainerStarted","Data":"3f296d24c37d61a9d87a6a3be2d8ecc4b39c8e02b0fa84e7980f18f335a8110a"} Jun 11 14:41:01.436559 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:01.436502 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-db66d64df-qzw5d" event={"ID":"be226020-1ece-4baa-a54c-389e76f83879","Type":"ContainerStarted","Data":"91bf7d81152c0f07c992194edf4a0fa2a5f9cb1f49745a972290e7dba7155dcf"} Jun 11 14:41:01.436559 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:01.436534 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-db66d64df-qzw5d" event={"ID":"be226020-1ece-4baa-a54c-389e76f83879","Type":"ContainerStarted","Data":"c16ac023d7b31120e88aeee18b998d793e047fff0cd527b50225ca42b30af456"} Jun 11 14:41:01.436736 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:01.436630 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-db66d64df-qzw5d" podUID="be226020-1ece-4baa-a54c-389e76f83879" containerName="authorino" containerID="cri-o://91bf7d81152c0f07c992194edf4a0fa2a5f9cb1f49745a972290e7dba7155dcf" gracePeriod=30 Jun 11 14:41:01.463722 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:01.463676 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-xdqb2" podStartSLOduration=1.142021025 podStartE2EDuration="1.463659952s" totalImagesPullingTime="321.638927ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:41:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:41:01.461903575 +0000 UTC m=+768.794481049" watchObservedRunningTime="2026-06-11 14:41:01.463659952 +0000 UTC m=+768.796237424" Jun 11 14:41:01.489343 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:01.489280 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-db66d64df-qzw5d" podStartSLOduration=1.200117951 podStartE2EDuration="1.489264017s" totalImagesPullingTime="289.146066ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:41:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:41:01.486215276 +0000 UTC m=+768.818792751" watchObservedRunningTime="2026-06-11 14:41:01.489264017 +0000 UTC m=+768.821841489" Jun 11 14:41:01.685917 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:01.685853 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-db66d64df-qzw5d" Jun 11 14:41:01.718904 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:01.718842 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xdqb2" Jun 11 14:41:01.787262 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:01.787220 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pc7sm\" (UniqueName: \"kubernetes.io/projected/be226020-1ece-4baa-a54c-389e76f83879-kube-api-access-pc7sm\") pod \"be226020-1ece-4baa-a54c-389e76f83879\" (UID: \"be226020-1ece-4baa-a54c-389e76f83879\") " Jun 11 14:41:01.787452 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:01.787385 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-65bwc\" (UniqueName: \"kubernetes.io/projected/95ed7bd2-8052-4f4c-b132-f23acd63a642-kube-api-access-65bwc\") pod \"95ed7bd2-8052-4f4c-b132-f23acd63a642\" (UID: \"95ed7bd2-8052-4f4c-b132-f23acd63a642\") " Jun 11 14:41:01.789593 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:01.789555 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be226020-1ece-4baa-a54c-389e76f83879-kube-api-access-pc7sm" (OuterVolumeSpecName: "kube-api-access-pc7sm") pod "be226020-1ece-4baa-a54c-389e76f83879" (UID: "be226020-1ece-4baa-a54c-389e76f83879"). InnerVolumeSpecName "kube-api-access-pc7sm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:41:01.789704 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:01.789676 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95ed7bd2-8052-4f4c-b132-f23acd63a642-kube-api-access-65bwc" (OuterVolumeSpecName: "kube-api-access-65bwc") pod "95ed7bd2-8052-4f4c-b132-f23acd63a642" (UID: "95ed7bd2-8052-4f4c-b132-f23acd63a642"). InnerVolumeSpecName "kube-api-access-65bwc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:41:01.888576 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:01.888540 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-65bwc\" (UniqueName: \"kubernetes.io/projected/95ed7bd2-8052-4f4c-b132-f23acd63a642-kube-api-access-65bwc\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:41:01.888576 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:01.888567 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pc7sm\" (UniqueName: \"kubernetes.io/projected/be226020-1ece-4baa-a54c-389e76f83879-kube-api-access-pc7sm\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:41:02.442169 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:02.442136 2574 generic.go:356] "Generic (PLEG): container finished" podID="95ed7bd2-8052-4f4c-b132-f23acd63a642" containerID="455f99a73f6188560c7307b0aa203a73772d0334de30e2c5564b07fc2f2a569c" exitCode=0 Jun 11 14:41:02.442621 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:02.442196 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-xdqb2" Jun 11 14:41:02.442621 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:02.442242 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-xdqb2" event={"ID":"95ed7bd2-8052-4f4c-b132-f23acd63a642","Type":"ContainerDied","Data":"455f99a73f6188560c7307b0aa203a73772d0334de30e2c5564b07fc2f2a569c"} Jun 11 14:41:02.442621 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:02.442277 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-xdqb2" event={"ID":"95ed7bd2-8052-4f4c-b132-f23acd63a642","Type":"ContainerDied","Data":"c39166360c77285c622a00ff3bd5857ba462175311328d35d01890b5cc38f6cc"} Jun 11 14:41:02.442621 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:02.442299 2574 scope.go:117] "RemoveContainer" containerID="455f99a73f6188560c7307b0aa203a73772d0334de30e2c5564b07fc2f2a569c" Jun 11 14:41:02.444457 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:02.444423 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c67c4b665-fm8bj" event={"ID":"e7e7768c-92ab-4023-960c-279a3f7d2119","Type":"ContainerStarted","Data":"60e3b23e8434d09405f9aae28ba06c4194a0658143f5b1af30ed03a4f9d1197d"} Jun 11 14:41:02.445940 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:02.445915 2574 generic.go:356] "Generic (PLEG): container finished" podID="be226020-1ece-4baa-a54c-389e76f83879" containerID="91bf7d81152c0f07c992194edf4a0fa2a5f9cb1f49745a972290e7dba7155dcf" exitCode=0 Jun 11 14:41:02.446059 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:02.445949 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-db66d64df-qzw5d" Jun 11 14:41:02.446059 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:02.445967 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-db66d64df-qzw5d" event={"ID":"be226020-1ece-4baa-a54c-389e76f83879","Type":"ContainerDied","Data":"91bf7d81152c0f07c992194edf4a0fa2a5f9cb1f49745a972290e7dba7155dcf"} Jun 11 14:41:02.446059 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:02.445993 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-db66d64df-qzw5d" event={"ID":"be226020-1ece-4baa-a54c-389e76f83879","Type":"ContainerDied","Data":"c16ac023d7b31120e88aeee18b998d793e047fff0cd527b50225ca42b30af456"} Jun 11 14:41:02.453244 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:02.453226 2574 scope.go:117] "RemoveContainer" containerID="455f99a73f6188560c7307b0aa203a73772d0334de30e2c5564b07fc2f2a569c" Jun 11 14:41:02.453526 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:41:02.453508 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"455f99a73f6188560c7307b0aa203a73772d0334de30e2c5564b07fc2f2a569c\": container with ID starting with 455f99a73f6188560c7307b0aa203a73772d0334de30e2c5564b07fc2f2a569c not found: ID does not exist" containerID="455f99a73f6188560c7307b0aa203a73772d0334de30e2c5564b07fc2f2a569c" Jun 11 14:41:02.453583 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:02.453533 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"455f99a73f6188560c7307b0aa203a73772d0334de30e2c5564b07fc2f2a569c"} err="failed to get container status \"455f99a73f6188560c7307b0aa203a73772d0334de30e2c5564b07fc2f2a569c\": rpc error: code = NotFound desc = could not find container \"455f99a73f6188560c7307b0aa203a73772d0334de30e2c5564b07fc2f2a569c\": container with ID starting with 455f99a73f6188560c7307b0aa203a73772d0334de30e2c5564b07fc2f2a569c not found: ID does not exist" Jun 11 14:41:02.453583 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:02.453551 2574 scope.go:117] "RemoveContainer" containerID="91bf7d81152c0f07c992194edf4a0fa2a5f9cb1f49745a972290e7dba7155dcf" Jun 11 14:41:02.461798 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:02.461772 2574 scope.go:117] "RemoveContainer" containerID="91bf7d81152c0f07c992194edf4a0fa2a5f9cb1f49745a972290e7dba7155dcf" Jun 11 14:41:02.462097 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:41:02.462064 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91bf7d81152c0f07c992194edf4a0fa2a5f9cb1f49745a972290e7dba7155dcf\": container with ID starting with 91bf7d81152c0f07c992194edf4a0fa2a5f9cb1f49745a972290e7dba7155dcf not found: ID does not exist" containerID="91bf7d81152c0f07c992194edf4a0fa2a5f9cb1f49745a972290e7dba7155dcf" Jun 11 14:41:02.462173 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:02.462105 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91bf7d81152c0f07c992194edf4a0fa2a5f9cb1f49745a972290e7dba7155dcf"} err="failed to get container status \"91bf7d81152c0f07c992194edf4a0fa2a5f9cb1f49745a972290e7dba7155dcf\": rpc error: code = NotFound desc = could not find container \"91bf7d81152c0f07c992194edf4a0fa2a5f9cb1f49745a972290e7dba7155dcf\": container with ID starting with 91bf7d81152c0f07c992194edf4a0fa2a5f9cb1f49745a972290e7dba7155dcf not found: ID does not exist" Jun 11 14:41:02.476250 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:02.476194 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6c67c4b665-fm8bj" podStartSLOduration=2.053796478 podStartE2EDuration="2.47617827s" totalImagesPullingTime="422.381792ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:41:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:41:02.475293949 +0000 UTC m=+769.807871424" watchObservedRunningTime="2026-06-11 14:41:02.47617827 +0000 UTC m=+769.808755798" Jun 11 14:41:02.500960 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:02.500928 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-db66d64df-qzw5d"] Jun 11 14:41:02.503933 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:02.503907 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-db66d64df-qzw5d"] Jun 11 14:41:02.521487 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:02.520701 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zn8bx"] Jun 11 14:41:02.521487 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:02.520975 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-zn8bx" podUID="68eb5e83-bb3e-4842-86f8-10bf22573c94" containerName="authorino" containerID="cri-o://69911fc430464792e06f60ca41327aa8afb00c0b693a4ca6096b9a10dc51eab7" gracePeriod=30 Jun 11 14:41:02.525037 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:02.525012 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xdqb2"] Jun 11 14:41:02.539998 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:02.539671 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-xdqb2"] Jun 11 14:41:02.787983 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:02.787960 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zn8bx" Jun 11 14:41:02.899006 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:02.898922 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fjqcg\" (UniqueName: \"kubernetes.io/projected/68eb5e83-bb3e-4842-86f8-10bf22573c94-kube-api-access-fjqcg\") pod \"68eb5e83-bb3e-4842-86f8-10bf22573c94\" (UID: \"68eb5e83-bb3e-4842-86f8-10bf22573c94\") " Jun 11 14:41:02.901094 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:02.901070 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/68eb5e83-bb3e-4842-86f8-10bf22573c94-kube-api-access-fjqcg" (OuterVolumeSpecName: "kube-api-access-fjqcg") pod "68eb5e83-bb3e-4842-86f8-10bf22573c94" (UID: "68eb5e83-bb3e-4842-86f8-10bf22573c94"). InnerVolumeSpecName "kube-api-access-fjqcg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:41:03.000269 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:03.000233 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fjqcg\" (UniqueName: \"kubernetes.io/projected/68eb5e83-bb3e-4842-86f8-10bf22573c94-kube-api-access-fjqcg\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:41:03.116629 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:03.116600 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95ed7bd2-8052-4f4c-b132-f23acd63a642" path="/var/lib/kubelet/pods/95ed7bd2-8052-4f4c-b132-f23acd63a642/volumes" Jun 11 14:41:03.116925 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:03.116912 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be226020-1ece-4baa-a54c-389e76f83879" path="/var/lib/kubelet/pods/be226020-1ece-4baa-a54c-389e76f83879/volumes" Jun 11 14:41:03.452765 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:03.452733 2574 generic.go:356] "Generic (PLEG): container finished" podID="68eb5e83-bb3e-4842-86f8-10bf22573c94" containerID="69911fc430464792e06f60ca41327aa8afb00c0b693a4ca6096b9a10dc51eab7" exitCode=0 Jun 11 14:41:03.453237 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:03.452795 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-zn8bx" Jun 11 14:41:03.453237 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:03.452804 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zn8bx" event={"ID":"68eb5e83-bb3e-4842-86f8-10bf22573c94","Type":"ContainerDied","Data":"69911fc430464792e06f60ca41327aa8afb00c0b693a4ca6096b9a10dc51eab7"} Jun 11 14:41:03.453237 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:03.452842 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-zn8bx" event={"ID":"68eb5e83-bb3e-4842-86f8-10bf22573c94","Type":"ContainerDied","Data":"3503a2cf8d9d9ed6d1703661f8c23f63a4e08d1db3fdebefb0ff76df67c1e25c"} Jun 11 14:41:03.453237 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:03.452862 2574 scope.go:117] "RemoveContainer" containerID="69911fc430464792e06f60ca41327aa8afb00c0b693a4ca6096b9a10dc51eab7" Jun 11 14:41:03.461567 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:03.461547 2574 scope.go:117] "RemoveContainer" containerID="69911fc430464792e06f60ca41327aa8afb00c0b693a4ca6096b9a10dc51eab7" Jun 11 14:41:03.461823 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:41:03.461802 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"69911fc430464792e06f60ca41327aa8afb00c0b693a4ca6096b9a10dc51eab7\": container with ID starting with 69911fc430464792e06f60ca41327aa8afb00c0b693a4ca6096b9a10dc51eab7 not found: ID does not exist" containerID="69911fc430464792e06f60ca41327aa8afb00c0b693a4ca6096b9a10dc51eab7" Jun 11 14:41:03.461905 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:03.461830 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"69911fc430464792e06f60ca41327aa8afb00c0b693a4ca6096b9a10dc51eab7"} err="failed to get container status \"69911fc430464792e06f60ca41327aa8afb00c0b693a4ca6096b9a10dc51eab7\": rpc error: code = NotFound desc = could not find container \"69911fc430464792e06f60ca41327aa8afb00c0b693a4ca6096b9a10dc51eab7\": container with ID starting with 69911fc430464792e06f60ca41327aa8afb00c0b693a4ca6096b9a10dc51eab7 not found: ID does not exist" Jun 11 14:41:03.489315 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:03.489279 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zn8bx"] Jun 11 14:41:03.497795 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:03.497764 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-zn8bx"] Jun 11 14:41:05.112861 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:05.112828 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="68eb5e83-bb3e-4842-86f8-10bf22573c94" path="/var/lib/kubelet/pods/68eb5e83-bb3e-4842-86f8-10bf22573c94/volumes" Jun 11 14:41:06.392809 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:06.392772 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-f698ddb87-b9b2b"] Jun 11 14:41:06.393219 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:06.393204 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95ed7bd2-8052-4f4c-b132-f23acd63a642" containerName="authorino" Jun 11 14:41:06.393277 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:06.393221 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="95ed7bd2-8052-4f4c-b132-f23acd63a642" containerName="authorino" Jun 11 14:41:06.393277 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:06.393236 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be226020-1ece-4baa-a54c-389e76f83879" containerName="authorino" Jun 11 14:41:06.393277 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:06.393244 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="be226020-1ece-4baa-a54c-389e76f83879" containerName="authorino" Jun 11 14:41:06.393277 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:06.393257 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="68eb5e83-bb3e-4842-86f8-10bf22573c94" containerName="authorino" Jun 11 14:41:06.393277 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:06.393263 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="68eb5e83-bb3e-4842-86f8-10bf22573c94" containerName="authorino" Jun 11 14:41:06.393507 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:06.393354 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="be226020-1ece-4baa-a54c-389e76f83879" containerName="authorino" Jun 11 14:41:06.393507 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:06.393368 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="68eb5e83-bb3e-4842-86f8-10bf22573c94" containerName="authorino" Jun 11 14:41:06.393507 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:06.393376 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="95ed7bd2-8052-4f4c-b132-f23acd63a642" containerName="authorino" Jun 11 14:41:06.397807 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:06.397780 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f698ddb87-b9b2b" Jun 11 14:41:06.404127 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:06.404106 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-rl4fw\"" Jun 11 14:41:06.404240 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:06.404106 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jun 11 14:41:06.404240 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:06.404107 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jun 11 14:41:06.415599 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:06.415577 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f698ddb87-b9b2b"] Jun 11 14:41:06.535917 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:06.535881 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4c347857-1f33-49ca-9782-5b7f69859572-webhook-cert\") pod \"maas-controller-f698ddb87-b9b2b\" (UID: \"4c347857-1f33-49ca-9782-5b7f69859572\") " pod="opendatahub/maas-controller-f698ddb87-b9b2b" Jun 11 14:41:06.536072 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:06.535975 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5glmg\" (UniqueName: \"kubernetes.io/projected/4c347857-1f33-49ca-9782-5b7f69859572-kube-api-access-5glmg\") pod \"maas-controller-f698ddb87-b9b2b\" (UID: \"4c347857-1f33-49ca-9782-5b7f69859572\") " pod="opendatahub/maas-controller-f698ddb87-b9b2b" Jun 11 14:41:06.637203 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:06.637172 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4c347857-1f33-49ca-9782-5b7f69859572-webhook-cert\") pod \"maas-controller-f698ddb87-b9b2b\" (UID: \"4c347857-1f33-49ca-9782-5b7f69859572\") " pod="opendatahub/maas-controller-f698ddb87-b9b2b" Jun 11 14:41:06.637390 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:06.637235 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5glmg\" (UniqueName: \"kubernetes.io/projected/4c347857-1f33-49ca-9782-5b7f69859572-kube-api-access-5glmg\") pod \"maas-controller-f698ddb87-b9b2b\" (UID: \"4c347857-1f33-49ca-9782-5b7f69859572\") " pod="opendatahub/maas-controller-f698ddb87-b9b2b" Jun 11 14:41:06.639825 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:06.639801 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4c347857-1f33-49ca-9782-5b7f69859572-webhook-cert\") pod \"maas-controller-f698ddb87-b9b2b\" (UID: \"4c347857-1f33-49ca-9782-5b7f69859572\") " pod="opendatahub/maas-controller-f698ddb87-b9b2b" Jun 11 14:41:06.649816 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:06.649750 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5glmg\" (UniqueName: \"kubernetes.io/projected/4c347857-1f33-49ca-9782-5b7f69859572-kube-api-access-5glmg\") pod \"maas-controller-f698ddb87-b9b2b\" (UID: \"4c347857-1f33-49ca-9782-5b7f69859572\") " pod="opendatahub/maas-controller-f698ddb87-b9b2b" Jun 11 14:41:06.708785 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:06.708746 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f698ddb87-b9b2b" Jun 11 14:41:06.850059 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:06.850030 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-f698ddb87-b9b2b"] Jun 11 14:41:06.851775 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:41:06.851746 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c347857_1f33_49ca_9782_5b7f69859572.slice/crio-d0f0486a09f37b9afd438bc91414768d4794b8d0dad3e31c4004879ad2bc062d WatchSource:0}: Error finding container d0f0486a09f37b9afd438bc91414768d4794b8d0dad3e31c4004879ad2bc062d: Status 404 returned error can't find the container with id d0f0486a09f37b9afd438bc91414768d4794b8d0dad3e31c4004879ad2bc062d Jun 11 14:41:07.479566 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:07.479529 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f698ddb87-b9b2b" event={"ID":"4c347857-1f33-49ca-9782-5b7f69859572","Type":"ContainerStarted","Data":"d0f0486a09f37b9afd438bc91414768d4794b8d0dad3e31c4004879ad2bc062d"} Jun 11 14:41:09.493332 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:09.493303 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f698ddb87-b9b2b" event={"ID":"4c347857-1f33-49ca-9782-5b7f69859572","Type":"ContainerStarted","Data":"ca1fdb7d7d7c4bf6dd6cc02e099feb2518aa42c21b682d71b0bb457127388ed7"} Jun 11 14:41:09.493725 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:09.493494 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-f698ddb87-b9b2b" Jun 11 14:41:09.601912 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:09.601792 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-f698ddb87-b9b2b" podStartSLOduration=1.116972187 podStartE2EDuration="3.601771363s" totalImagesPullingTime="2.484799176s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:41:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:41:09.600952539 +0000 UTC m=+776.933530020" watchObservedRunningTime="2026-06-11 14:41:09.601771363 +0000 UTC m=+776.934348838" Jun 11 14:41:20.505371 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:20.505313 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-f698ddb87-b9b2b" Jun 11 14:41:21.404095 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:21.404058 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f698ddb87-b9b2b"] Jun 11 14:41:21.404276 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:21.404251 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-f698ddb87-b9b2b" podUID="4c347857-1f33-49ca-9782-5b7f69859572" containerName="manager" containerID="cri-o://ca1fdb7d7d7c4bf6dd6cc02e099feb2518aa42c21b682d71b0bb457127388ed7" gracePeriod=30 Jun 11 14:41:21.558994 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:21.558959 2574 generic.go:356] "Generic (PLEG): container finished" podID="4c347857-1f33-49ca-9782-5b7f69859572" containerID="ca1fdb7d7d7c4bf6dd6cc02e099feb2518aa42c21b682d71b0bb457127388ed7" exitCode=0 Jun 11 14:41:21.559412 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:21.559040 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f698ddb87-b9b2b" event={"ID":"4c347857-1f33-49ca-9782-5b7f69859572","Type":"ContainerDied","Data":"ca1fdb7d7d7c4bf6dd6cc02e099feb2518aa42c21b682d71b0bb457127388ed7"} Jun 11 14:41:21.666188 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:21.666127 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f698ddb87-b9b2b" Jun 11 14:41:21.778116 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:21.778071 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5glmg\" (UniqueName: \"kubernetes.io/projected/4c347857-1f33-49ca-9782-5b7f69859572-kube-api-access-5glmg\") pod \"4c347857-1f33-49ca-9782-5b7f69859572\" (UID: \"4c347857-1f33-49ca-9782-5b7f69859572\") " Jun 11 14:41:21.778291 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:21.778163 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4c347857-1f33-49ca-9782-5b7f69859572-webhook-cert\") pod \"4c347857-1f33-49ca-9782-5b7f69859572\" (UID: \"4c347857-1f33-49ca-9782-5b7f69859572\") " Jun 11 14:41:21.780518 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:21.780485 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4c347857-1f33-49ca-9782-5b7f69859572-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "4c347857-1f33-49ca-9782-5b7f69859572" (UID: "4c347857-1f33-49ca-9782-5b7f69859572"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 14:41:21.780632 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:21.780490 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4c347857-1f33-49ca-9782-5b7f69859572-kube-api-access-5glmg" (OuterVolumeSpecName: "kube-api-access-5glmg") pod "4c347857-1f33-49ca-9782-5b7f69859572" (UID: "4c347857-1f33-49ca-9782-5b7f69859572"). InnerVolumeSpecName "kube-api-access-5glmg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:41:21.878977 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:21.878945 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5glmg\" (UniqueName: \"kubernetes.io/projected/4c347857-1f33-49ca-9782-5b7f69859572-kube-api-access-5glmg\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:41:21.878977 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:21.878971 2574 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/4c347857-1f33-49ca-9782-5b7f69859572-webhook-cert\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:41:22.565168 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:22.565132 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-f698ddb87-b9b2b" event={"ID":"4c347857-1f33-49ca-9782-5b7f69859572","Type":"ContainerDied","Data":"d0f0486a09f37b9afd438bc91414768d4794b8d0dad3e31c4004879ad2bc062d"} Jun 11 14:41:22.565612 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:22.565190 2574 scope.go:117] "RemoveContainer" containerID="ca1fdb7d7d7c4bf6dd6cc02e099feb2518aa42c21b682d71b0bb457127388ed7" Jun 11 14:41:22.565612 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:22.565144 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-f698ddb87-b9b2b" Jun 11 14:41:22.588828 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:22.588798 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-f698ddb87-b9b2b"] Jun 11 14:41:22.595904 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:22.595879 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-f698ddb87-b9b2b"] Jun 11 14:41:23.113630 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:23.113597 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c347857-1f33-49ca-9782-5b7f69859572" path="/var/lib/kubelet/pods/4c347857-1f33-49ca-9782-5b7f69859572/volumes" Jun 11 14:41:40.761029 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:40.760946 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-bf46957cd-ttmvz"] Jun 11 14:41:40.761492 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:40.761413 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c347857-1f33-49ca-9782-5b7f69859572" containerName="manager" Jun 11 14:41:40.761492 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:40.761427 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c347857-1f33-49ca-9782-5b7f69859572" containerName="manager" Jun 11 14:41:40.761568 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:40.761494 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c347857-1f33-49ca-9782-5b7f69859572" containerName="manager" Jun 11 14:41:40.764842 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:40.764821 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-bf46957cd-ttmvz" Jun 11 14:41:40.769561 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:40.769534 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\"" Jun 11 14:41:40.769750 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:40.769729 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-rbnx2\"" Jun 11 14:41:40.790610 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:40.790583 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-bf46957cd-ttmvz"] Jun 11 14:41:40.846380 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:40.846348 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75f5a0db-df8a-4f7f-9e44-2a5f95082311-openshift-service-ca\") pod \"maas-api-bf46957cd-ttmvz\" (UID: \"75f5a0db-df8a-4f7f-9e44-2a5f95082311\") " pod="opendatahub/maas-api-bf46957cd-ttmvz" Jun 11 14:41:40.846539 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:40.846418 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75f5a0db-df8a-4f7f-9e44-2a5f95082311-maas-api-tls\") pod \"maas-api-bf46957cd-ttmvz\" (UID: \"75f5a0db-df8a-4f7f-9e44-2a5f95082311\") " pod="opendatahub/maas-api-bf46957cd-ttmvz" Jun 11 14:41:40.846539 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:40.846480 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwlrf\" (UniqueName: \"kubernetes.io/projected/75f5a0db-df8a-4f7f-9e44-2a5f95082311-kube-api-access-jwlrf\") pod \"maas-api-bf46957cd-ttmvz\" (UID: \"75f5a0db-df8a-4f7f-9e44-2a5f95082311\") " pod="opendatahub/maas-api-bf46957cd-ttmvz" Jun 11 14:41:40.947717 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:40.947686 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwlrf\" (UniqueName: \"kubernetes.io/projected/75f5a0db-df8a-4f7f-9e44-2a5f95082311-kube-api-access-jwlrf\") pod \"maas-api-bf46957cd-ttmvz\" (UID: \"75f5a0db-df8a-4f7f-9e44-2a5f95082311\") " pod="opendatahub/maas-api-bf46957cd-ttmvz" Jun 11 14:41:40.947887 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:40.947756 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75f5a0db-df8a-4f7f-9e44-2a5f95082311-openshift-service-ca\") pod \"maas-api-bf46957cd-ttmvz\" (UID: \"75f5a0db-df8a-4f7f-9e44-2a5f95082311\") " pod="opendatahub/maas-api-bf46957cd-ttmvz" Jun 11 14:41:40.947887 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:40.947793 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75f5a0db-df8a-4f7f-9e44-2a5f95082311-maas-api-tls\") pod \"maas-api-bf46957cd-ttmvz\" (UID: \"75f5a0db-df8a-4f7f-9e44-2a5f95082311\") " pod="opendatahub/maas-api-bf46957cd-ttmvz" Jun 11 14:41:40.948562 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:40.948482 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/75f5a0db-df8a-4f7f-9e44-2a5f95082311-openshift-service-ca\") pod \"maas-api-bf46957cd-ttmvz\" (UID: \"75f5a0db-df8a-4f7f-9e44-2a5f95082311\") " pod="opendatahub/maas-api-bf46957cd-ttmvz" Jun 11 14:41:40.950275 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:40.950256 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/75f5a0db-df8a-4f7f-9e44-2a5f95082311-maas-api-tls\") pod \"maas-api-bf46957cd-ttmvz\" (UID: \"75f5a0db-df8a-4f7f-9e44-2a5f95082311\") " pod="opendatahub/maas-api-bf46957cd-ttmvz" Jun 11 14:41:40.989108 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:40.989073 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwlrf\" (UniqueName: \"kubernetes.io/projected/75f5a0db-df8a-4f7f-9e44-2a5f95082311-kube-api-access-jwlrf\") pod \"maas-api-bf46957cd-ttmvz\" (UID: \"75f5a0db-df8a-4f7f-9e44-2a5f95082311\") " pod="opendatahub/maas-api-bf46957cd-ttmvz" Jun 11 14:41:41.076522 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:41.076435 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-bf46957cd-ttmvz" Jun 11 14:41:41.236825 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:41.236795 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-bf46957cd-ttmvz"] Jun 11 14:41:41.238856 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:41:41.238829 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75f5a0db_df8a_4f7f_9e44_2a5f95082311.slice/crio-d4ad1a070c871c46d1c619d5de8e3cc3913918a886481e4978cac005ea2c70e3 WatchSource:0}: Error finding container d4ad1a070c871c46d1c619d5de8e3cc3913918a886481e4978cac005ea2c70e3: Status 404 returned error can't find the container with id d4ad1a070c871c46d1c619d5de8e3cc3913918a886481e4978cac005ea2c70e3 Jun 11 14:41:41.663251 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:41.663216 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-bf46957cd-ttmvz" event={"ID":"75f5a0db-df8a-4f7f-9e44-2a5f95082311","Type":"ContainerStarted","Data":"d4ad1a070c871c46d1c619d5de8e3cc3913918a886481e4978cac005ea2c70e3"} Jun 11 14:41:43.676132 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:43.676092 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-bf46957cd-ttmvz" event={"ID":"75f5a0db-df8a-4f7f-9e44-2a5f95082311","Type":"ContainerStarted","Data":"6f5873024ff70a1c0496fe2507b6f23e1dd070d2305c40895ec40583ecdb74ad"} Jun 11 14:41:43.676581 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:43.676229 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-bf46957cd-ttmvz" Jun 11 14:41:43.701231 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:43.701160 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-bf46957cd-ttmvz" podStartSLOduration=1.975450259 podStartE2EDuration="3.701142975s" totalImagesPullingTime="1.725692716s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:41:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:41:43.699236928 +0000 UTC m=+811.031814421" watchObservedRunningTime="2026-06-11 14:41:43.701142975 +0000 UTC m=+811.033720448" Jun 11 14:41:49.690666 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:41:49.690638 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-bf46957cd-ttmvz" Jun 11 14:43:13.114103 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:13.114022 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5lpfx_c3a99230-0749-4f98-97a8-cd9f586e529e/console-operator/2.log" Jun 11 14:43:13.114598 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:13.114369 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5lpfx_c3a99230-0749-4f98-97a8-cd9f586e529e/console-operator/2.log" Jun 11 14:43:13.118302 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:13.118277 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qld5j_37cb9247-f8d1-4b39-a031-89f74f7a8e1b/ovn-acl-logging/0.log" Jun 11 14:43:13.118474 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:13.118448 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qld5j_37cb9247-f8d1-4b39-a031-89f74f7a8e1b/ovn-acl-logging/0.log" Jun 11 14:43:55.918441 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:55.918409 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 14:43:55.918901 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:55.918610 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="keycloak-system/maas-keycloak-0" podUID="dd72c1bd-77c5-452f-ba7c-8afb8db38b8b" containerName="keycloak" containerID="cri-o://196ac647c26a70c1dc645e059389c9e7737fcad26bc029dc16f5f6970a9f08aa" gracePeriod=30 Jun 11 14:43:57.569792 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:57.569766 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 14:43:57.676195 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:57.676122 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pv4n2\" (UniqueName: \"kubernetes.io/projected/dd72c1bd-77c5-452f-ba7c-8afb8db38b8b-kube-api-access-pv4n2\") pod \"dd72c1bd-77c5-452f-ba7c-8afb8db38b8b\" (UID: \"dd72c1bd-77c5-452f-ba7c-8afb8db38b8b\") " Jun 11 14:43:57.678343 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:57.678304 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd72c1bd-77c5-452f-ba7c-8afb8db38b8b-kube-api-access-pv4n2" (OuterVolumeSpecName: "kube-api-access-pv4n2") pod "dd72c1bd-77c5-452f-ba7c-8afb8db38b8b" (UID: "dd72c1bd-77c5-452f-ba7c-8afb8db38b8b"). InnerVolumeSpecName "kube-api-access-pv4n2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:43:57.777344 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:57.777293 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pv4n2\" (UniqueName: \"kubernetes.io/projected/dd72c1bd-77c5-452f-ba7c-8afb8db38b8b-kube-api-access-pv4n2\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:43:58.361288 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:58.361256 2574 generic.go:356] "Generic (PLEG): container finished" podID="dd72c1bd-77c5-452f-ba7c-8afb8db38b8b" containerID="196ac647c26a70c1dc645e059389c9e7737fcad26bc029dc16f5f6970a9f08aa" exitCode=143 Jun 11 14:43:58.361462 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:58.361303 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 14:43:58.361462 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:58.361361 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"dd72c1bd-77c5-452f-ba7c-8afb8db38b8b","Type":"ContainerDied","Data":"196ac647c26a70c1dc645e059389c9e7737fcad26bc029dc16f5f6970a9f08aa"} Jun 11 14:43:58.361462 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:58.361413 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"dd72c1bd-77c5-452f-ba7c-8afb8db38b8b","Type":"ContainerDied","Data":"596d3eb23f0eca25bf72595a98d2334fe52f45a47cf18d4d975f6358f08cee44"} Jun 11 14:43:58.361462 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:58.361434 2574 scope.go:117] "RemoveContainer" containerID="196ac647c26a70c1dc645e059389c9e7737fcad26bc029dc16f5f6970a9f08aa" Jun 11 14:43:58.372115 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:58.372097 2574 scope.go:117] "RemoveContainer" containerID="196ac647c26a70c1dc645e059389c9e7737fcad26bc029dc16f5f6970a9f08aa" Jun 11 14:43:58.372438 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:43:58.372415 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"196ac647c26a70c1dc645e059389c9e7737fcad26bc029dc16f5f6970a9f08aa\": container with ID starting with 196ac647c26a70c1dc645e059389c9e7737fcad26bc029dc16f5f6970a9f08aa not found: ID does not exist" containerID="196ac647c26a70c1dc645e059389c9e7737fcad26bc029dc16f5f6970a9f08aa" Jun 11 14:43:58.372555 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:58.372446 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"196ac647c26a70c1dc645e059389c9e7737fcad26bc029dc16f5f6970a9f08aa"} err="failed to get container status \"196ac647c26a70c1dc645e059389c9e7737fcad26bc029dc16f5f6970a9f08aa\": rpc error: code = NotFound desc = could not find container \"196ac647c26a70c1dc645e059389c9e7737fcad26bc029dc16f5f6970a9f08aa\": container with ID starting with 196ac647c26a70c1dc645e059389c9e7737fcad26bc029dc16f5f6970a9f08aa not found: ID does not exist" Jun 11 14:43:58.387301 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:58.387273 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 14:43:58.389022 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:58.389002 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 14:43:58.441584 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:58.441550 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 14:43:58.442018 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:58.442000 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd72c1bd-77c5-452f-ba7c-8afb8db38b8b" containerName="keycloak" Jun 11 14:43:58.442144 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:58.442020 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd72c1bd-77c5-452f-ba7c-8afb8db38b8b" containerName="keycloak" Jun 11 14:43:58.442144 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:58.442119 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd72c1bd-77c5-452f-ba7c-8afb8db38b8b" containerName="keycloak" Jun 11 14:43:58.445302 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:58.445280 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 14:43:58.450510 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:58.450484 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 11 14:43:58.450645 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:58.450530 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"keycloak-test-realms\"" Jun 11 14:43:58.450645 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:58.450562 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"default-dockercfg-zn7nl\"" Jun 11 14:43:58.450645 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:58.450497 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 11 14:43:58.450645 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:58.450640 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"maas-keycloak-initial-admin\"" Jun 11 14:43:58.459849 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:58.459827 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 14:43:58.483147 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:58.483120 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zw6cr\" (UniqueName: \"kubernetes.io/projected/310eb8d2-2d08-43bf-a295-717515f98d69-kube-api-access-zw6cr\") pod \"maas-keycloak-0\" (UID: \"310eb8d2-2d08-43bf-a295-717515f98d69\") " pod="keycloak-system/maas-keycloak-0" Jun 11 14:43:58.483305 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:58.483188 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/310eb8d2-2d08-43bf-a295-717515f98d69-test-realms\") pod \"maas-keycloak-0\" (UID: \"310eb8d2-2d08-43bf-a295-717515f98d69\") " pod="keycloak-system/maas-keycloak-0" Jun 11 14:43:58.584214 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:58.584172 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/310eb8d2-2d08-43bf-a295-717515f98d69-test-realms\") pod \"maas-keycloak-0\" (UID: \"310eb8d2-2d08-43bf-a295-717515f98d69\") " pod="keycloak-system/maas-keycloak-0" Jun 11 14:43:58.584658 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:58.584243 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zw6cr\" (UniqueName: \"kubernetes.io/projected/310eb8d2-2d08-43bf-a295-717515f98d69-kube-api-access-zw6cr\") pod \"maas-keycloak-0\" (UID: \"310eb8d2-2d08-43bf-a295-717515f98d69\") " pod="keycloak-system/maas-keycloak-0" Jun 11 14:43:58.584979 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:58.584959 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"test-realms\" (UniqueName: \"kubernetes.io/configmap/310eb8d2-2d08-43bf-a295-717515f98d69-test-realms\") pod \"maas-keycloak-0\" (UID: \"310eb8d2-2d08-43bf-a295-717515f98d69\") " pod="keycloak-system/maas-keycloak-0" Jun 11 14:43:58.594788 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:58.594767 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zw6cr\" (UniqueName: \"kubernetes.io/projected/310eb8d2-2d08-43bf-a295-717515f98d69-kube-api-access-zw6cr\") pod \"maas-keycloak-0\" (UID: \"310eb8d2-2d08-43bf-a295-717515f98d69\") " pod="keycloak-system/maas-keycloak-0" Jun 11 14:43:58.758870 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:58.758836 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/maas-keycloak-0" Jun 11 14:43:58.896283 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:58.896259 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/maas-keycloak-0"] Jun 11 14:43:58.898605 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:43:58.898580 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod310eb8d2_2d08_43bf_a295_717515f98d69.slice/crio-73054dc8bc01e3725246201afa6be03d767c6af773aefec98f5bcc6e64e82952 WatchSource:0}: Error finding container 73054dc8bc01e3725246201afa6be03d767c6af773aefec98f5bcc6e64e82952: Status 404 returned error can't find the container with id 73054dc8bc01e3725246201afa6be03d767c6af773aefec98f5bcc6e64e82952 Jun 11 14:43:59.113308 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:59.113227 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd72c1bd-77c5-452f-ba7c-8afb8db38b8b" path="/var/lib/kubelet/pods/dd72c1bd-77c5-452f-ba7c-8afb8db38b8b/volumes" Jun 11 14:43:59.369485 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:59.369398 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"310eb8d2-2d08-43bf-a295-717515f98d69","Type":"ContainerStarted","Data":"77ac34ceeb3c74ac5e408ec0563ce9f003bc0a859abd5ea57c9b19ed041171c3"} Jun 11 14:43:59.369485 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:59.369461 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/maas-keycloak-0" event={"ID":"310eb8d2-2d08-43bf-a295-717515f98d69","Type":"ContainerStarted","Data":"73054dc8bc01e3725246201afa6be03d767c6af773aefec98f5bcc6e64e82952"} Jun 11 14:43:59.394056 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:59.393924 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/maas-keycloak-0" podStartSLOduration=1.048727105 podStartE2EDuration="1.393908487s" totalImagesPullingTime="345.181382ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:43:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:43:59.391255753 +0000 UTC m=+946.723833237" watchObservedRunningTime="2026-06-11 14:43:59.393908487 +0000 UTC m=+946.726485959" Jun 11 14:43:59.759556 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:59.759513 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="keycloak-system/maas-keycloak-0" Jun 11 14:43:59.761284 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:43:59.761252 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="310eb8d2-2d08-43bf-a295-717515f98d69" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 11 14:44:00.759928 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:44:00.759865 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="310eb8d2-2d08-43bf-a295-717515f98d69" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 11 14:44:01.759757 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:44:01.759716 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="310eb8d2-2d08-43bf-a295-717515f98d69" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 11 14:44:02.760345 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:44:02.760269 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="310eb8d2-2d08-43bf-a295-717515f98d69" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 11 14:44:03.759666 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:44:03.759616 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="310eb8d2-2d08-43bf-a295-717515f98d69" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 11 14:44:04.759840 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:44:04.759775 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="310eb8d2-2d08-43bf-a295-717515f98d69" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 11 14:44:05.759576 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:44:05.759520 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="310eb8d2-2d08-43bf-a295-717515f98d69" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 11 14:44:06.760094 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:44:06.760045 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="310eb8d2-2d08-43bf-a295-717515f98d69" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 11 14:44:07.759659 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:44:07.759620 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="310eb8d2-2d08-43bf-a295-717515f98d69" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 11 14:44:08.759221 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:44:08.759174 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="keycloak-system/maas-keycloak-0" Jun 11 14:44:08.759763 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:44:08.759575 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="310eb8d2-2d08-43bf-a295-717515f98d69" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 11 14:44:09.759808 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:44:09.759757 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="310eb8d2-2d08-43bf-a295-717515f98d69" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 11 14:44:10.759528 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:44:10.759468 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="310eb8d2-2d08-43bf-a295-717515f98d69" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 11 14:44:11.759855 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:44:11.759788 2574 prober.go:120] "Probe failed" probeType="Startup" pod="keycloak-system/maas-keycloak-0" podUID="310eb8d2-2d08-43bf-a295-717515f98d69" containerName="keycloak" probeResult="failure" output="Get \"http://10.134.0.42:9000/health/started\": dial tcp 10.134.0.42:9000: connect: connection refused" Jun 11 14:44:12.852733 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:44:12.852678 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="keycloak-system/maas-keycloak-0" Jun 11 14:44:12.867172 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:44:12.867122 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="310eb8d2-2d08-43bf-a295-717515f98d69" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 14:44:22.858228 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:44:22.857774 2574 prober.go:120] "Probe failed" probeType="Readiness" pod="keycloak-system/maas-keycloak-0" podUID="310eb8d2-2d08-43bf-a295-717515f98d69" containerName="keycloak" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 11 14:44:32.859513 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:44:32.859412 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="keycloak-system/maas-keycloak-0" Jun 11 14:44:49.821390 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:44:49.821356 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6c67c4b665-fm8bj"] Jun 11 14:44:49.821877 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:44:49.821582 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-6c67c4b665-fm8bj" podUID="e7e7768c-92ab-4023-960c-279a3f7d2119" containerName="authorino" containerID="cri-o://60e3b23e8434d09405f9aae28ba06c4194a0658143f5b1af30ed03a4f9d1197d" gracePeriod=30 Jun 11 14:44:50.076160 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:44:50.076100 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c67c4b665-fm8bj" Jun 11 14:44:50.164744 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:44:50.164702 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e7e7768c-92ab-4023-960c-279a3f7d2119-tls-cert\") pod \"e7e7768c-92ab-4023-960c-279a3f7d2119\" (UID: \"e7e7768c-92ab-4023-960c-279a3f7d2119\") " Jun 11 14:44:50.164921 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:44:50.164791 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jphmr\" (UniqueName: \"kubernetes.io/projected/e7e7768c-92ab-4023-960c-279a3f7d2119-kube-api-access-jphmr\") pod \"e7e7768c-92ab-4023-960c-279a3f7d2119\" (UID: \"e7e7768c-92ab-4023-960c-279a3f7d2119\") " Jun 11 14:44:50.167045 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:44:50.167015 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7e7768c-92ab-4023-960c-279a3f7d2119-kube-api-access-jphmr" (OuterVolumeSpecName: "kube-api-access-jphmr") pod "e7e7768c-92ab-4023-960c-279a3f7d2119" (UID: "e7e7768c-92ab-4023-960c-279a3f7d2119"). InnerVolumeSpecName "kube-api-access-jphmr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:44:50.175789 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:44:50.175758 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7e7768c-92ab-4023-960c-279a3f7d2119-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "e7e7768c-92ab-4023-960c-279a3f7d2119" (UID: "e7e7768c-92ab-4023-960c-279a3f7d2119"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 11 14:44:50.266183 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:44:50.266145 2574 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e7e7768c-92ab-4023-960c-279a3f7d2119-tls-cert\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:44:50.266183 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:44:50.266182 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jphmr\" (UniqueName: \"kubernetes.io/projected/e7e7768c-92ab-4023-960c-279a3f7d2119-kube-api-access-jphmr\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:44:50.653203 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:44:50.653170 2574 generic.go:356] "Generic (PLEG): container finished" podID="e7e7768c-92ab-4023-960c-279a3f7d2119" containerID="60e3b23e8434d09405f9aae28ba06c4194a0658143f5b1af30ed03a4f9d1197d" exitCode=0 Jun 11 14:44:50.653403 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:44:50.653211 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6c67c4b665-fm8bj" Jun 11 14:44:50.653403 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:44:50.653255 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c67c4b665-fm8bj" event={"ID":"e7e7768c-92ab-4023-960c-279a3f7d2119","Type":"ContainerDied","Data":"60e3b23e8434d09405f9aae28ba06c4194a0658143f5b1af30ed03a4f9d1197d"} Jun 11 14:44:50.653403 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:44:50.653302 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6c67c4b665-fm8bj" event={"ID":"e7e7768c-92ab-4023-960c-279a3f7d2119","Type":"ContainerDied","Data":"3f296d24c37d61a9d87a6a3be2d8ecc4b39c8e02b0fa84e7980f18f335a8110a"} Jun 11 14:44:50.653403 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:44:50.653320 2574 scope.go:117] "RemoveContainer" containerID="60e3b23e8434d09405f9aae28ba06c4194a0658143f5b1af30ed03a4f9d1197d" Jun 11 14:44:50.666514 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:44:50.664240 2574 scope.go:117] "RemoveContainer" containerID="60e3b23e8434d09405f9aae28ba06c4194a0658143f5b1af30ed03a4f9d1197d" Jun 11 14:44:50.666804 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:44:50.666631 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60e3b23e8434d09405f9aae28ba06c4194a0658143f5b1af30ed03a4f9d1197d\": container with ID starting with 60e3b23e8434d09405f9aae28ba06c4194a0658143f5b1af30ed03a4f9d1197d not found: ID does not exist" containerID="60e3b23e8434d09405f9aae28ba06c4194a0658143f5b1af30ed03a4f9d1197d" Jun 11 14:44:50.666914 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:44:50.666818 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60e3b23e8434d09405f9aae28ba06c4194a0658143f5b1af30ed03a4f9d1197d"} err="failed to get container status \"60e3b23e8434d09405f9aae28ba06c4194a0658143f5b1af30ed03a4f9d1197d\": rpc error: code = NotFound desc = could not find container \"60e3b23e8434d09405f9aae28ba06c4194a0658143f5b1af30ed03a4f9d1197d\": container with ID starting with 60e3b23e8434d09405f9aae28ba06c4194a0658143f5b1af30ed03a4f9d1197d not found: ID does not exist" Jun 11 14:44:50.681023 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:44:50.680999 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6c67c4b665-fm8bj"] Jun 11 14:44:50.682665 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:44:50.682647 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6c67c4b665-fm8bj"] Jun 11 14:44:51.116438 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:44:51.116402 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7e7768c-92ab-4023-960c-279a3f7d2119" path="/var/lib/kubelet/pods/e7e7768c-92ab-4023-960c-279a3f7d2119/volumes" Jun 11 14:45:02.612740 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:02.612702 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq"] Jun 11 14:45:02.613232 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:02.613104 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7e7768c-92ab-4023-960c-279a3f7d2119" containerName="authorino" Jun 11 14:45:02.613232 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:02.613116 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7e7768c-92ab-4023-960c-279a3f7d2119" containerName="authorino" Jun 11 14:45:02.613232 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:02.613185 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7e7768c-92ab-4023-960c-279a3f7d2119" containerName="authorino" Jun 11 14:45:02.618040 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:02.618015 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq" Jun 11 14:45:02.621861 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:02.621834 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-cr49b\"" Jun 11 14:45:02.622009 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:02.621860 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 11 14:45:02.622009 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:02.621860 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 11 14:45:02.622009 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:02.621834 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jun 11 14:45:02.632512 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:02.632486 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq"] Jun 11 14:45:02.682891 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:02.682846 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0508791f-327b-4331-9a18-207c61f6f9b0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq\" (UID: \"0508791f-327b-4331-9a18-207c61f6f9b0\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq" Jun 11 14:45:02.683079 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:02.682900 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0508791f-327b-4331-9a18-207c61f6f9b0-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq\" (UID: \"0508791f-327b-4331-9a18-207c61f6f9b0\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq" Jun 11 14:45:02.683079 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:02.682921 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0508791f-327b-4331-9a18-207c61f6f9b0-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq\" (UID: \"0508791f-327b-4331-9a18-207c61f6f9b0\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq" Jun 11 14:45:02.683079 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:02.682995 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0508791f-327b-4331-9a18-207c61f6f9b0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq\" (UID: \"0508791f-327b-4331-9a18-207c61f6f9b0\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq" Jun 11 14:45:02.683079 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:02.683035 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0508791f-327b-4331-9a18-207c61f6f9b0-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq\" (UID: \"0508791f-327b-4331-9a18-207c61f6f9b0\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq" Jun 11 14:45:02.683243 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:02.683085 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zpn77\" (UniqueName: \"kubernetes.io/projected/0508791f-327b-4331-9a18-207c61f6f9b0-kube-api-access-zpn77\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq\" (UID: \"0508791f-327b-4331-9a18-207c61f6f9b0\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq" Jun 11 14:45:02.784044 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:02.784009 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0508791f-327b-4331-9a18-207c61f6f9b0-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq\" (UID: \"0508791f-327b-4331-9a18-207c61f6f9b0\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq" Jun 11 14:45:02.784044 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:02.784047 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0508791f-327b-4331-9a18-207c61f6f9b0-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq\" (UID: \"0508791f-327b-4331-9a18-207c61f6f9b0\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq" Jun 11 14:45:02.784361 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:02.784075 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0508791f-327b-4331-9a18-207c61f6f9b0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq\" (UID: \"0508791f-327b-4331-9a18-207c61f6f9b0\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq" Jun 11 14:45:02.784361 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:02.784102 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0508791f-327b-4331-9a18-207c61f6f9b0-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq\" (UID: \"0508791f-327b-4331-9a18-207c61f6f9b0\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq" Jun 11 14:45:02.784361 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:02.784142 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zpn77\" (UniqueName: \"kubernetes.io/projected/0508791f-327b-4331-9a18-207c61f6f9b0-kube-api-access-zpn77\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq\" (UID: \"0508791f-327b-4331-9a18-207c61f6f9b0\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq" Jun 11 14:45:02.784361 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:02.784214 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0508791f-327b-4331-9a18-207c61f6f9b0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq\" (UID: \"0508791f-327b-4331-9a18-207c61f6f9b0\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq" Jun 11 14:45:02.784598 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:02.784550 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/0508791f-327b-4331-9a18-207c61f6f9b0-home\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq\" (UID: \"0508791f-327b-4331-9a18-207c61f6f9b0\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq" Jun 11 14:45:02.784598 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:02.784571 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/0508791f-327b-4331-9a18-207c61f6f9b0-kserve-provision-location\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq\" (UID: \"0508791f-327b-4331-9a18-207c61f6f9b0\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq" Jun 11 14:45:02.784683 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:02.784615 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/0508791f-327b-4331-9a18-207c61f6f9b0-model-cache\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq\" (UID: \"0508791f-327b-4331-9a18-207c61f6f9b0\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq" Jun 11 14:45:02.786492 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:02.786473 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/0508791f-327b-4331-9a18-207c61f6f9b0-dshm\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq\" (UID: \"0508791f-327b-4331-9a18-207c61f6f9b0\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq" Jun 11 14:45:02.786833 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:02.786815 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0508791f-327b-4331-9a18-207c61f6f9b0-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq\" (UID: \"0508791f-327b-4331-9a18-207c61f6f9b0\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq" Jun 11 14:45:02.798145 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:02.798112 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zpn77\" (UniqueName: \"kubernetes.io/projected/0508791f-327b-4331-9a18-207c61f6f9b0-kube-api-access-zpn77\") pod \"e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq\" (UID: \"0508791f-327b-4331-9a18-207c61f6f9b0\") " pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq" Jun 11 14:45:02.928770 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:02.928667 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq" Jun 11 14:45:03.072729 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:03.072703 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq"] Jun 11 14:45:03.075817 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:45:03.075778 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0508791f_327b_4331_9a18_207c61f6f9b0.slice/crio-6fdf734456c30fe3367995b4824e726eef4bb4be296583afd1429a6146dbc719 WatchSource:0}: Error finding container 6fdf734456c30fe3367995b4824e726eef4bb4be296583afd1429a6146dbc719: Status 404 returned error can't find the container with id 6fdf734456c30fe3367995b4824e726eef4bb4be296583afd1429a6146dbc719 Jun 11 14:45:03.720103 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:03.720071 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq" event={"ID":"0508791f-327b-4331-9a18-207c61f6f9b0","Type":"ContainerStarted","Data":"6fdf734456c30fe3367995b4824e726eef4bb4be296583afd1429a6146dbc719"} Jun 11 14:45:07.744410 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:07.744368 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq" event={"ID":"0508791f-327b-4331-9a18-207c61f6f9b0","Type":"ContainerStarted","Data":"e05fec8a051772105f9a353cdcff552c32d29d241073b240675da6820b73fa59"} Jun 11 14:45:16.078474 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:16.078434 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt"] Jun 11 14:45:16.083601 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:16.083580 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt" Jun 11 14:45:16.088546 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:16.088522 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jun 11 14:45:16.122339 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:16.122291 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt"] Jun 11 14:45:16.207604 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:16.207572 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/27adc9b4-6d46-4ed2-9484-6530174b7984-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt\" (UID: \"27adc9b4-6d46-4ed2-9484-6530174b7984\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt" Jun 11 14:45:16.207786 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:16.207714 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27adc9b4-6d46-4ed2-9484-6530174b7984-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt\" (UID: \"27adc9b4-6d46-4ed2-9484-6530174b7984\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt" Jun 11 14:45:16.207786 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:16.207751 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27adc9b4-6d46-4ed2-9484-6530174b7984-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt\" (UID: \"27adc9b4-6d46-4ed2-9484-6530174b7984\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt" Jun 11 14:45:16.207967 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:16.207920 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27adc9b4-6d46-4ed2-9484-6530174b7984-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt\" (UID: \"27adc9b4-6d46-4ed2-9484-6530174b7984\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt" Jun 11 14:45:16.208057 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:16.208019 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmm94\" (UniqueName: \"kubernetes.io/projected/27adc9b4-6d46-4ed2-9484-6530174b7984-kube-api-access-wmm94\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt\" (UID: \"27adc9b4-6d46-4ed2-9484-6530174b7984\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt" Jun 11 14:45:16.208057 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:16.208050 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27adc9b4-6d46-4ed2-9484-6530174b7984-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt\" (UID: \"27adc9b4-6d46-4ed2-9484-6530174b7984\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt" Jun 11 14:45:16.309614 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:16.309578 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27adc9b4-6d46-4ed2-9484-6530174b7984-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt\" (UID: \"27adc9b4-6d46-4ed2-9484-6530174b7984\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt" Jun 11 14:45:16.309820 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:16.309646 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/27adc9b4-6d46-4ed2-9484-6530174b7984-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt\" (UID: \"27adc9b4-6d46-4ed2-9484-6530174b7984\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt" Jun 11 14:45:16.309820 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:16.309695 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27adc9b4-6d46-4ed2-9484-6530174b7984-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt\" (UID: \"27adc9b4-6d46-4ed2-9484-6530174b7984\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt" Jun 11 14:45:16.309820 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:16.309713 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27adc9b4-6d46-4ed2-9484-6530174b7984-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt\" (UID: \"27adc9b4-6d46-4ed2-9484-6530174b7984\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt" Jun 11 14:45:16.309820 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:16.309741 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27adc9b4-6d46-4ed2-9484-6530174b7984-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt\" (UID: \"27adc9b4-6d46-4ed2-9484-6530174b7984\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt" Jun 11 14:45:16.309820 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:16.309758 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmm94\" (UniqueName: \"kubernetes.io/projected/27adc9b4-6d46-4ed2-9484-6530174b7984-kube-api-access-wmm94\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt\" (UID: \"27adc9b4-6d46-4ed2-9484-6530174b7984\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt" Jun 11 14:45:16.310179 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:16.310156 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/27adc9b4-6d46-4ed2-9484-6530174b7984-home\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt\" (UID: \"27adc9b4-6d46-4ed2-9484-6530174b7984\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt" Jun 11 14:45:16.310282 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:16.310228 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/27adc9b4-6d46-4ed2-9484-6530174b7984-kserve-provision-location\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt\" (UID: \"27adc9b4-6d46-4ed2-9484-6530174b7984\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt" Jun 11 14:45:16.310282 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:16.310262 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/27adc9b4-6d46-4ed2-9484-6530174b7984-model-cache\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt\" (UID: \"27adc9b4-6d46-4ed2-9484-6530174b7984\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt" Jun 11 14:45:16.312050 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:16.312030 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/27adc9b4-6d46-4ed2-9484-6530174b7984-dshm\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt\" (UID: \"27adc9b4-6d46-4ed2-9484-6530174b7984\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt" Jun 11 14:45:16.312407 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:16.312388 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/27adc9b4-6d46-4ed2-9484-6530174b7984-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt\" (UID: \"27adc9b4-6d46-4ed2-9484-6530174b7984\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt" Jun 11 14:45:16.325447 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:16.325424 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmm94\" (UniqueName: \"kubernetes.io/projected/27adc9b4-6d46-4ed2-9484-6530174b7984-kube-api-access-wmm94\") pod \"e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt\" (UID: \"27adc9b4-6d46-4ed2-9484-6530174b7984\") " pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt" Jun 11 14:45:16.394490 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:16.394396 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt" Jun 11 14:45:16.554836 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:16.554801 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt"] Jun 11 14:45:16.555920 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:45:16.555895 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod27adc9b4_6d46_4ed2_9484_6530174b7984.slice/crio-e03c22b7057f078a9c61727b7957cf1f0582806787ea0cf217bea060af8ed0b3 WatchSource:0}: Error finding container e03c22b7057f078a9c61727b7957cf1f0582806787ea0cf217bea060af8ed0b3: Status 404 returned error can't find the container with id e03c22b7057f078a9c61727b7957cf1f0582806787ea0cf217bea060af8ed0b3 Jun 11 14:45:16.792160 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:16.792122 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt" event={"ID":"27adc9b4-6d46-4ed2-9484-6530174b7984","Type":"ContainerStarted","Data":"63c9008a5ca24d771e75e1cd95a236d3bad076c402337fd3783424214efdf8eb"} Jun 11 14:45:16.792360 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:16.792188 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt" event={"ID":"27adc9b4-6d46-4ed2-9484-6530174b7984","Type":"ContainerStarted","Data":"e03c22b7057f078a9c61727b7957cf1f0582806787ea0cf217bea060af8ed0b3"} Jun 11 14:45:43.811428 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:43.811393 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl"] Jun 11 14:45:43.815467 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:43.815443 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl" Jun 11 14:45:43.818407 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:43.818380 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jun 11 14:45:43.902983 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:43.902951 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl"] Jun 11 14:45:43.971216 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:43.971187 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b824d7ac-4f17-4e07-a2a8-e6684f32c2d5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl\" (UID: \"b824d7ac-4f17-4e07-a2a8-e6684f32c2d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl" Jun 11 14:45:43.971460 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:43.971247 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b824d7ac-4f17-4e07-a2a8-e6684f32c2d5-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl\" (UID: \"b824d7ac-4f17-4e07-a2a8-e6684f32c2d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl" Jun 11 14:45:43.971460 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:43.971265 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b824d7ac-4f17-4e07-a2a8-e6684f32c2d5-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl\" (UID: \"b824d7ac-4f17-4e07-a2a8-e6684f32c2d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl" Jun 11 14:45:43.971460 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:43.971319 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b824d7ac-4f17-4e07-a2a8-e6684f32c2d5-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl\" (UID: \"b824d7ac-4f17-4e07-a2a8-e6684f32c2d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl" Jun 11 14:45:43.971460 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:43.971397 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b824d7ac-4f17-4e07-a2a8-e6684f32c2d5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl\" (UID: \"b824d7ac-4f17-4e07-a2a8-e6684f32c2d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl" Jun 11 14:45:43.971648 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:43.971468 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vllcc\" (UniqueName: \"kubernetes.io/projected/b824d7ac-4f17-4e07-a2a8-e6684f32c2d5-kube-api-access-vllcc\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl\" (UID: \"b824d7ac-4f17-4e07-a2a8-e6684f32c2d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl" Jun 11 14:45:44.072165 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:44.072069 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b824d7ac-4f17-4e07-a2a8-e6684f32c2d5-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl\" (UID: \"b824d7ac-4f17-4e07-a2a8-e6684f32c2d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl" Jun 11 14:45:44.072165 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:44.072109 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b824d7ac-4f17-4e07-a2a8-e6684f32c2d5-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl\" (UID: \"b824d7ac-4f17-4e07-a2a8-e6684f32c2d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl" Jun 11 14:45:44.072165 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:44.072130 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b824d7ac-4f17-4e07-a2a8-e6684f32c2d5-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl\" (UID: \"b824d7ac-4f17-4e07-a2a8-e6684f32c2d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl" Jun 11 14:45:44.072494 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:44.072262 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b824d7ac-4f17-4e07-a2a8-e6684f32c2d5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl\" (UID: \"b824d7ac-4f17-4e07-a2a8-e6684f32c2d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl" Jun 11 14:45:44.072494 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:44.072380 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vllcc\" (UniqueName: \"kubernetes.io/projected/b824d7ac-4f17-4e07-a2a8-e6684f32c2d5-kube-api-access-vllcc\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl\" (UID: \"b824d7ac-4f17-4e07-a2a8-e6684f32c2d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl" Jun 11 14:45:44.072494 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:44.072462 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b824d7ac-4f17-4e07-a2a8-e6684f32c2d5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl\" (UID: \"b824d7ac-4f17-4e07-a2a8-e6684f32c2d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl" Jun 11 14:45:44.072656 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:44.072565 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b824d7ac-4f17-4e07-a2a8-e6684f32c2d5-home\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl\" (UID: \"b824d7ac-4f17-4e07-a2a8-e6684f32c2d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl" Jun 11 14:45:44.072656 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:44.072606 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/b824d7ac-4f17-4e07-a2a8-e6684f32c2d5-kserve-provision-location\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl\" (UID: \"b824d7ac-4f17-4e07-a2a8-e6684f32c2d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl" Jun 11 14:45:44.072780 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:44.072759 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b824d7ac-4f17-4e07-a2a8-e6684f32c2d5-model-cache\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl\" (UID: \"b824d7ac-4f17-4e07-a2a8-e6684f32c2d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl" Jun 11 14:45:44.074652 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:44.074619 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b824d7ac-4f17-4e07-a2a8-e6684f32c2d5-dshm\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl\" (UID: \"b824d7ac-4f17-4e07-a2a8-e6684f32c2d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl" Jun 11 14:45:44.074953 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:44.074933 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b824d7ac-4f17-4e07-a2a8-e6684f32c2d5-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl\" (UID: \"b824d7ac-4f17-4e07-a2a8-e6684f32c2d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl" Jun 11 14:45:44.082456 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:44.082437 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vllcc\" (UniqueName: \"kubernetes.io/projected/b824d7ac-4f17-4e07-a2a8-e6684f32c2d5-kube-api-access-vllcc\") pod \"facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl\" (UID: \"b824d7ac-4f17-4e07-a2a8-e6684f32c2d5\") " pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl" Jun 11 14:45:44.126120 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:44.126075 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl" Jun 11 14:45:44.279296 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:44.279254 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl"] Jun 11 14:45:44.281935 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:45:44.281899 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb824d7ac_4f17_4e07_a2a8_e6684f32c2d5.slice/crio-da9d7ff58e5d78c0ad335ed90b7c292d038cb1e48daa5e3fe5d4a6275e55de02 WatchSource:0}: Error finding container da9d7ff58e5d78c0ad335ed90b7c292d038cb1e48daa5e3fe5d4a6275e55de02: Status 404 returned error can't find the container with id da9d7ff58e5d78c0ad335ed90b7c292d038cb1e48daa5e3fe5d4a6275e55de02 Jun 11 14:45:44.932834 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:44.932804 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl" event={"ID":"b824d7ac-4f17-4e07-a2a8-e6684f32c2d5","Type":"ContainerStarted","Data":"a1d1712cb43f52cf81a685070925167d5b38e2fce2de30b6092142b6399dda42"} Jun 11 14:45:44.933214 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:44.932852 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl" event={"ID":"b824d7ac-4f17-4e07-a2a8-e6684f32c2d5","Type":"ContainerStarted","Data":"da9d7ff58e5d78c0ad335ed90b7c292d038cb1e48daa5e3fe5d4a6275e55de02"} Jun 11 14:45:45.939377 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:45.939258 2574 generic.go:356] "Generic (PLEG): container finished" podID="b824d7ac-4f17-4e07-a2a8-e6684f32c2d5" containerID="a1d1712cb43f52cf81a685070925167d5b38e2fce2de30b6092142b6399dda42" exitCode=0 Jun 11 14:45:45.939377 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:45.939343 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl" event={"ID":"b824d7ac-4f17-4e07-a2a8-e6684f32c2d5","Type":"ContainerDied","Data":"a1d1712cb43f52cf81a685070925167d5b38e2fce2de30b6092142b6399dda42"} Jun 11 14:45:47.953050 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:47.953014 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl" event={"ID":"b824d7ac-4f17-4e07-a2a8-e6684f32c2d5","Type":"ContainerStarted","Data":"2a04a10f0a36d4c31208086125a8e2607294093da6b7d572a9593ec47568d38c"} Jun 11 14:45:47.971829 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:47.971774 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl" podStartSLOduration=2.569025093 podStartE2EDuration="4.971754255s" totalImagesPullingTime="1.102562935s" totalInitContainerRuntime="1.300166227s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:45:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:45:47.971115801 +0000 UTC m=+1055.303693300" watchObservedRunningTime="2026-06-11 14:45:47.971754255 +0000 UTC m=+1055.304331730" Jun 11 14:45:51.916138 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:51.916104 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-srn98"] Jun 11 14:45:51.920426 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:51.920402 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-srn98" Jun 11 14:45:51.923518 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:51.923497 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 11 14:45:51.947891 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:51.947862 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-srn98"] Jun 11 14:45:52.045926 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:52.045826 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6735673f-b3b7-4dc0-80fd-ca2876795c39-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-srn98\" (UID: \"6735673f-b3b7-4dc0-80fd-ca2876795c39\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-srn98" Jun 11 14:45:52.045926 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:52.045880 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2hd2k\" (UniqueName: \"kubernetes.io/projected/6735673f-b3b7-4dc0-80fd-ca2876795c39-kube-api-access-2hd2k\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-srn98\" (UID: \"6735673f-b3b7-4dc0-80fd-ca2876795c39\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-srn98" Jun 11 14:45:52.046186 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:52.045949 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6735673f-b3b7-4dc0-80fd-ca2876795c39-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-srn98\" (UID: \"6735673f-b3b7-4dc0-80fd-ca2876795c39\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-srn98" Jun 11 14:45:52.046186 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:52.045965 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6735673f-b3b7-4dc0-80fd-ca2876795c39-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-srn98\" (UID: \"6735673f-b3b7-4dc0-80fd-ca2876795c39\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-srn98" Jun 11 14:45:52.046186 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:52.046028 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6735673f-b3b7-4dc0-80fd-ca2876795c39-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-srn98\" (UID: \"6735673f-b3b7-4dc0-80fd-ca2876795c39\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-srn98" Jun 11 14:45:52.046186 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:52.046074 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6735673f-b3b7-4dc0-80fd-ca2876795c39-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-srn98\" (UID: \"6735673f-b3b7-4dc0-80fd-ca2876795c39\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-srn98" Jun 11 14:45:52.147524 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:52.147483 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6735673f-b3b7-4dc0-80fd-ca2876795c39-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-srn98\" (UID: \"6735673f-b3b7-4dc0-80fd-ca2876795c39\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-srn98" Jun 11 14:45:52.147733 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:52.147536 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2hd2k\" (UniqueName: \"kubernetes.io/projected/6735673f-b3b7-4dc0-80fd-ca2876795c39-kube-api-access-2hd2k\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-srn98\" (UID: \"6735673f-b3b7-4dc0-80fd-ca2876795c39\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-srn98" Jun 11 14:45:52.147733 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:52.147588 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6735673f-b3b7-4dc0-80fd-ca2876795c39-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-srn98\" (UID: \"6735673f-b3b7-4dc0-80fd-ca2876795c39\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-srn98" Jun 11 14:45:52.147733 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:52.147605 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6735673f-b3b7-4dc0-80fd-ca2876795c39-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-srn98\" (UID: \"6735673f-b3b7-4dc0-80fd-ca2876795c39\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-srn98" Jun 11 14:45:52.147733 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:52.147641 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6735673f-b3b7-4dc0-80fd-ca2876795c39-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-srn98\" (UID: \"6735673f-b3b7-4dc0-80fd-ca2876795c39\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-srn98" Jun 11 14:45:52.147733 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:52.147674 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6735673f-b3b7-4dc0-80fd-ca2876795c39-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-srn98\" (UID: \"6735673f-b3b7-4dc0-80fd-ca2876795c39\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-srn98" Jun 11 14:45:52.148008 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:52.147987 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/6735673f-b3b7-4dc0-80fd-ca2876795c39-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-srn98\" (UID: \"6735673f-b3b7-4dc0-80fd-ca2876795c39\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-srn98" Jun 11 14:45:52.148056 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:52.148027 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/6735673f-b3b7-4dc0-80fd-ca2876795c39-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-srn98\" (UID: \"6735673f-b3b7-4dc0-80fd-ca2876795c39\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-srn98" Jun 11 14:45:52.148094 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:52.148072 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/6735673f-b3b7-4dc0-80fd-ca2876795c39-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-srn98\" (UID: \"6735673f-b3b7-4dc0-80fd-ca2876795c39\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-srn98" Jun 11 14:45:52.150073 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:52.150052 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/6735673f-b3b7-4dc0-80fd-ca2876795c39-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-srn98\" (UID: \"6735673f-b3b7-4dc0-80fd-ca2876795c39\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-srn98" Jun 11 14:45:52.150307 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:52.150279 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6735673f-b3b7-4dc0-80fd-ca2876795c39-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-srn98\" (UID: \"6735673f-b3b7-4dc0-80fd-ca2876795c39\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-srn98" Jun 11 14:45:52.161950 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:52.161911 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2hd2k\" (UniqueName: \"kubernetes.io/projected/6735673f-b3b7-4dc0-80fd-ca2876795c39-kube-api-access-2hd2k\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-srn98\" (UID: \"6735673f-b3b7-4dc0-80fd-ca2876795c39\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-srn98" Jun 11 14:45:52.230522 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:52.230487 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-srn98" Jun 11 14:45:52.393427 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:52.393399 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-srn98"] Jun 11 14:45:52.396021 ip-10-0-135-108 kubenswrapper[2574]: W0611 14:45:52.395996 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6735673f_b3b7_4dc0_80fd_ca2876795c39.slice/crio-5dba0589ebfee51cf0dafde7150c8da940dab6a63e5733a753878f005fffb3cf WatchSource:0}: Error finding container 5dba0589ebfee51cf0dafde7150c8da940dab6a63e5733a753878f005fffb3cf: Status 404 returned error can't find the container with id 5dba0589ebfee51cf0dafde7150c8da940dab6a63e5733a753878f005fffb3cf Jun 11 14:45:52.982864 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:52.982830 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-srn98" event={"ID":"6735673f-b3b7-4dc0-80fd-ca2876795c39","Type":"ContainerStarted","Data":"63fd7934a78c1951b4148071eb58ff9dcf626f36b50fd0a36d7952d2239c6bc9"} Jun 11 14:45:52.983253 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:52.982877 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-srn98" event={"ID":"6735673f-b3b7-4dc0-80fd-ca2876795c39","Type":"ContainerStarted","Data":"5dba0589ebfee51cf0dafde7150c8da940dab6a63e5733a753878f005fffb3cf"} Jun 11 14:45:53.989163 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:53.989127 2574 generic.go:356] "Generic (PLEG): container finished" podID="6735673f-b3b7-4dc0-80fd-ca2876795c39" containerID="63fd7934a78c1951b4148071eb58ff9dcf626f36b50fd0a36d7952d2239c6bc9" exitCode=0 Jun 11 14:45:53.989587 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:53.989199 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-srn98" event={"ID":"6735673f-b3b7-4dc0-80fd-ca2876795c39","Type":"ContainerDied","Data":"63fd7934a78c1951b4148071eb58ff9dcf626f36b50fd0a36d7952d2239c6bc9"} Jun 11 14:45:54.126635 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:54.126596 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl" Jun 11 14:45:54.126798 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:54.126667 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl" Jun 11 14:45:54.141797 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:54.141769 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl" Jun 11 14:45:54.997492 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:54.997457 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-srn98" event={"ID":"6735673f-b3b7-4dc0-80fd-ca2876795c39","Type":"ContainerStarted","Data":"35d521f8a112164131d43d96f1a2768d827b8a829c89c5848e06b74d6aedd1f2"} Jun 11 14:45:55.009162 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:55.009135 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl" Jun 11 14:45:55.018110 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:45:55.018053 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-srn98" podStartSLOduration=2.2236986659999998 podStartE2EDuration="4.018039619s" totalImagesPullingTime="342.931995ms" totalInitContainerRuntime="1.451408958s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:45:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:45:55.016202567 +0000 UTC m=+1062.348780040" watchObservedRunningTime="2026-06-11 14:45:55.018039619 +0000 UTC m=+1062.350617124" Jun 11 14:46:01.034273 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:46:01.034171 2574 generic.go:356] "Generic (PLEG): container finished" podID="0508791f-327b-4331-9a18-207c61f6f9b0" containerID="e05fec8a051772105f9a353cdcff552c32d29d241073b240675da6820b73fa59" exitCode=0 Jun 11 14:46:01.034273 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:46:01.034203 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq" event={"ID":"0508791f-327b-4331-9a18-207c61f6f9b0","Type":"ContainerDied","Data":"e05fec8a051772105f9a353cdcff552c32d29d241073b240675da6820b73fa59"} Jun 11 14:46:01.034971 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:46:01.034953 2574 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 11 14:46:02.043008 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:46:02.042974 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq" event={"ID":"0508791f-327b-4331-9a18-207c61f6f9b0","Type":"ContainerStarted","Data":"b9c7282167e5c5f983f7077c30031933fc1067d0f1e4ad8a8fce84a862c5b42e"} Jun 11 14:46:02.065255 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:46:02.065204 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq" podStartSLOduration=2.206383405 podStartE2EDuration="1m0.065188141s" totalImagesPullingTime="4.615916686s" totalInitContainerRuntime="53.24288805s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:45:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:46:02.063666203 +0000 UTC m=+1069.396243696" watchObservedRunningTime="2026-06-11 14:46:02.065188141 +0000 UTC m=+1069.397765613" Jun 11 14:46:02.230806 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:46:02.230762 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-srn98" Jun 11 14:46:02.231011 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:46:02.230824 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-srn98" Jun 11 14:46:02.244036 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:46:02.244007 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-srn98" Jun 11 14:46:02.928893 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:46:02.928855 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq" Jun 11 14:46:02.929082 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:46:02.928927 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq" Jun 11 14:46:02.941575 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:46:02.941542 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq" Jun 11 14:46:03.058900 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:46:03.058867 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq" Jun 11 14:46:03.059716 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:46:03.059696 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-srn98" Jun 11 14:46:14.105606 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:46:14.105571 2574 generic.go:356] "Generic (PLEG): container finished" podID="27adc9b4-6d46-4ed2-9484-6530174b7984" containerID="63c9008a5ca24d771e75e1cd95a236d3bad076c402337fd3783424214efdf8eb" exitCode=0 Jun 11 14:46:14.106008 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:46:14.105644 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt" event={"ID":"27adc9b4-6d46-4ed2-9484-6530174b7984","Type":"ContainerDied","Data":"63c9008a5ca24d771e75e1cd95a236d3bad076c402337fd3783424214efdf8eb"} Jun 11 14:46:15.114950 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:46:15.114908 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt" event={"ID":"27adc9b4-6d46-4ed2-9484-6530174b7984","Type":"ContainerStarted","Data":"35c7538a586e02546d04786cc8462cc212b5bce643da0b6760ad529d629de397"} Jun 11 14:46:15.149200 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:46:15.149138 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt" podStartSLOduration=1.567010746 podStartE2EDuration="59.149121001s" totalImagesPullingTime="317.195407ms" totalInitContainerRuntime="57.264914848s" isStatefulPod=false podCreationTimestamp="2026-06-11 14:45:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 14:46:15.148488849 +0000 UTC m=+1082.481066347" watchObservedRunningTime="2026-06-11 14:46:15.149121001 +0000 UTC m=+1082.481698475" Jun 11 14:46:16.394510 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:46:16.394471 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt" Jun 11 14:46:16.394971 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:46:16.394567 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt" Jun 11 14:46:16.407379 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:46:16.407342 2574 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt" Jun 11 14:46:17.135722 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:46:17.135684 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt" Jun 11 14:48:13.147624 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:48:13.147593 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5lpfx_c3a99230-0749-4f98-97a8-cd9f586e529e/console-operator/2.log" Jun 11 14:48:13.149917 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:48:13.149898 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5lpfx_c3a99230-0749-4f98-97a8-cd9f586e529e/console-operator/2.log" Jun 11 14:48:13.151298 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:48:13.151279 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qld5j_37cb9247-f8d1-4b39-a031-89f74f7a8e1b/ovn-acl-logging/0.log" Jun 11 14:48:13.153609 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:48:13.153593 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qld5j_37cb9247-f8d1-4b39-a031-89f74f7a8e1b/ovn-acl-logging/0.log" Jun 11 14:53:13.184550 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:53:13.184518 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5lpfx_c3a99230-0749-4f98-97a8-cd9f586e529e/console-operator/2.log" Jun 11 14:53:13.187482 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:53:13.187460 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5lpfx_c3a99230-0749-4f98-97a8-cd9f586e529e/console-operator/2.log" Jun 11 14:53:13.188535 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:53:13.188510 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qld5j_37cb9247-f8d1-4b39-a031-89f74f7a8e1b/ovn-acl-logging/0.log" Jun 11 14:53:13.191071 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:53:13.191054 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qld5j_37cb9247-f8d1-4b39-a031-89f74f7a8e1b/ovn-acl-logging/0.log" Jun 11 14:58:13.226978 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:58:13.226945 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5lpfx_c3a99230-0749-4f98-97a8-cd9f586e529e/console-operator/2.log" Jun 11 14:58:13.230066 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:58:13.230034 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5lpfx_c3a99230-0749-4f98-97a8-cd9f586e529e/console-operator/2.log" Jun 11 14:58:13.230674 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:58:13.230653 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qld5j_37cb9247-f8d1-4b39-a031-89f74f7a8e1b/ovn-acl-logging/0.log" Jun 11 14:58:13.233656 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:58:13.233632 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qld5j_37cb9247-f8d1-4b39-a031-89f74f7a8e1b/ovn-acl-logging/0.log" Jun 11 14:59:42.382688 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:59:42.382593 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mrj49"] Jun 11 14:59:42.383256 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:59:42.382871 2574 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mrj49" podUID="c4471894-8f94-40cf-890a-50e622b4e3aa" containerName="manager" containerID="cri-o://4afa16068dbdeef2a96c907ee67dd6c7600679fc296fd4c8f4487dd551b7b1f7" gracePeriod=10 Jun 11 14:59:42.649639 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:59:42.649615 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mrj49" Jun 11 14:59:42.755279 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:59:42.755237 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4471894-8f94-40cf-890a-50e622b4e3aa-extensions-socket-volume\") pod \"c4471894-8f94-40cf-890a-50e622b4e3aa\" (UID: \"c4471894-8f94-40cf-890a-50e622b4e3aa\") " Jun 11 14:59:42.755496 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:59:42.755318 2574 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x8g8g\" (UniqueName: \"kubernetes.io/projected/c4471894-8f94-40cf-890a-50e622b4e3aa-kube-api-access-x8g8g\") pod \"c4471894-8f94-40cf-890a-50e622b4e3aa\" (UID: \"c4471894-8f94-40cf-890a-50e622b4e3aa\") " Jun 11 14:59:42.755655 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:59:42.755630 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4471894-8f94-40cf-890a-50e622b4e3aa-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c4471894-8f94-40cf-890a-50e622b4e3aa" (UID: "c4471894-8f94-40cf-890a-50e622b4e3aa"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 11 14:59:42.757619 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:59:42.757594 2574 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4471894-8f94-40cf-890a-50e622b4e3aa-kube-api-access-x8g8g" (OuterVolumeSpecName: "kube-api-access-x8g8g") pod "c4471894-8f94-40cf-890a-50e622b4e3aa" (UID: "c4471894-8f94-40cf-890a-50e622b4e3aa"). InnerVolumeSpecName "kube-api-access-x8g8g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 11 14:59:42.856880 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:59:42.856842 2574 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c4471894-8f94-40cf-890a-50e622b4e3aa-extensions-socket-volume\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:59:42.856880 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:59:42.856872 2574 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x8g8g\" (UniqueName: \"kubernetes.io/projected/c4471894-8f94-40cf-890a-50e622b4e3aa-kube-api-access-x8g8g\") on node \"ip-10-0-135-108.ec2.internal\" DevicePath \"\"" Jun 11 14:59:43.376401 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:59:43.376297 2574 generic.go:356] "Generic (PLEG): container finished" podID="c4471894-8f94-40cf-890a-50e622b4e3aa" containerID="4afa16068dbdeef2a96c907ee67dd6c7600679fc296fd4c8f4487dd551b7b1f7" exitCode=0 Jun 11 14:59:43.376401 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:59:43.376360 2574 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mrj49" Jun 11 14:59:43.376401 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:59:43.376387 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mrj49" event={"ID":"c4471894-8f94-40cf-890a-50e622b4e3aa","Type":"ContainerDied","Data":"4afa16068dbdeef2a96c907ee67dd6c7600679fc296fd4c8f4487dd551b7b1f7"} Jun 11 14:59:43.376641 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:59:43.376441 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mrj49" event={"ID":"c4471894-8f94-40cf-890a-50e622b4e3aa","Type":"ContainerDied","Data":"5fa0a0928c89f06a79f41d2b8b36983a785fc5b3317dbf42ff720c04725b186b"} Jun 11 14:59:43.376641 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:59:43.376464 2574 scope.go:117] "RemoveContainer" containerID="4afa16068dbdeef2a96c907ee67dd6c7600679fc296fd4c8f4487dd551b7b1f7" Jun 11 14:59:43.385901 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:59:43.385716 2574 scope.go:117] "RemoveContainer" containerID="4afa16068dbdeef2a96c907ee67dd6c7600679fc296fd4c8f4487dd551b7b1f7" Jun 11 14:59:43.386159 ip-10-0-135-108 kubenswrapper[2574]: E0611 14:59:43.386013 2574 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4afa16068dbdeef2a96c907ee67dd6c7600679fc296fd4c8f4487dd551b7b1f7\": container with ID starting with 4afa16068dbdeef2a96c907ee67dd6c7600679fc296fd4c8f4487dd551b7b1f7 not found: ID does not exist" containerID="4afa16068dbdeef2a96c907ee67dd6c7600679fc296fd4c8f4487dd551b7b1f7" Jun 11 14:59:43.386159 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:59:43.386046 2574 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4afa16068dbdeef2a96c907ee67dd6c7600679fc296fd4c8f4487dd551b7b1f7"} err="failed to get container status \"4afa16068dbdeef2a96c907ee67dd6c7600679fc296fd4c8f4487dd551b7b1f7\": rpc error: code = NotFound desc = could not find container \"4afa16068dbdeef2a96c907ee67dd6c7600679fc296fd4c8f4487dd551b7b1f7\": container with ID starting with 4afa16068dbdeef2a96c907ee67dd6c7600679fc296fd4c8f4487dd551b7b1f7 not found: ID does not exist" Jun 11 14:59:43.396288 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:59:43.396258 2574 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mrj49"] Jun 11 14:59:43.399870 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:59:43.399845 2574 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-mrj49"] Jun 11 14:59:45.113561 ip-10-0-135-108 kubenswrapper[2574]: I0611 14:59:45.113528 2574 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4471894-8f94-40cf-890a-50e622b4e3aa" path="/var/lib/kubelet/pods/c4471894-8f94-40cf-890a-50e622b4e3aa/volumes" Jun 11 15:00:48.810371 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:00:48.810317 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zprsj"] Jun 11 15:00:48.810903 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:00:48.810782 2574 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4471894-8f94-40cf-890a-50e622b4e3aa" containerName="manager" Jun 11 15:00:48.810903 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:00:48.810794 2574 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4471894-8f94-40cf-890a-50e622b4e3aa" containerName="manager" Jun 11 15:00:48.810903 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:00:48.810873 2574 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4471894-8f94-40cf-890a-50e622b4e3aa" containerName="manager" Jun 11 15:00:48.814077 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:00:48.814056 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zprsj" Jun 11 15:00:48.817968 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:00:48.817944 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-fkrxw\"" Jun 11 15:00:48.865359 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:00:48.865306 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zprsj"] Jun 11 15:00:48.884029 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:00:48.883998 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c33fd0e-a02d-4279-b549-34684bd66f01-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zprsj\" (UID: \"5c33fd0e-a02d-4279-b549-34684bd66f01\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zprsj" Jun 11 15:00:48.884189 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:00:48.884037 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zflq\" (UniqueName: \"kubernetes.io/projected/5c33fd0e-a02d-4279-b549-34684bd66f01-kube-api-access-5zflq\") pod \"kuadrant-operator-controller-manager-86878c769f-zprsj\" (UID: \"5c33fd0e-a02d-4279-b549-34684bd66f01\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zprsj" Jun 11 15:00:48.984737 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:00:48.984705 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c33fd0e-a02d-4279-b549-34684bd66f01-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zprsj\" (UID: \"5c33fd0e-a02d-4279-b549-34684bd66f01\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zprsj" Jun 11 15:00:48.984737 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:00:48.984740 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zflq\" (UniqueName: \"kubernetes.io/projected/5c33fd0e-a02d-4279-b549-34684bd66f01-kube-api-access-5zflq\") pod \"kuadrant-operator-controller-manager-86878c769f-zprsj\" (UID: \"5c33fd0e-a02d-4279-b549-34684bd66f01\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zprsj" Jun 11 15:00:48.985120 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:00:48.985099 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/5c33fd0e-a02d-4279-b549-34684bd66f01-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-zprsj\" (UID: \"5c33fd0e-a02d-4279-b549-34684bd66f01\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zprsj" Jun 11 15:00:48.994431 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:00:48.994403 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zflq\" (UniqueName: \"kubernetes.io/projected/5c33fd0e-a02d-4279-b549-34684bd66f01-kube-api-access-5zflq\") pod \"kuadrant-operator-controller-manager-86878c769f-zprsj\" (UID: \"5c33fd0e-a02d-4279-b549-34684bd66f01\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zprsj" Jun 11 15:00:49.125397 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:00:49.125284 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zprsj" Jun 11 15:00:49.267551 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:00:49.267516 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zprsj"] Jun 11 15:00:49.270878 ip-10-0-135-108 kubenswrapper[2574]: W0611 15:00:49.270850 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c33fd0e_a02d_4279_b549_34684bd66f01.slice/crio-4c55dee7cdb3a9264e404cb4b143af773142b97eb6e90be61ed46eb3ce3ab451 WatchSource:0}: Error finding container 4c55dee7cdb3a9264e404cb4b143af773142b97eb6e90be61ed46eb3ce3ab451: Status 404 returned error can't find the container with id 4c55dee7cdb3a9264e404cb4b143af773142b97eb6e90be61ed46eb3ce3ab451 Jun 11 15:00:49.720598 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:00:49.720565 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zprsj" event={"ID":"5c33fd0e-a02d-4279-b549-34684bd66f01","Type":"ContainerStarted","Data":"0209dd1f08ba9eb5ab92b56a52a64679e67e97d6b9a602c5ba53a81d4bd5dd67"} Jun 11 15:00:49.720779 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:00:49.720613 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zprsj" event={"ID":"5c33fd0e-a02d-4279-b549-34684bd66f01","Type":"ContainerStarted","Data":"4c55dee7cdb3a9264e404cb4b143af773142b97eb6e90be61ed46eb3ce3ab451"} Jun 11 15:00:49.720779 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:00:49.720644 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zprsj" Jun 11 15:00:49.743302 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:00:49.743253 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zprsj" podStartSLOduration=1.74323672 podStartE2EDuration="1.74323672s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-11 15:00:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:00:49.740576369 +0000 UTC m=+1957.073153872" watchObservedRunningTime="2026-06-11 15:00:49.74323672 +0000 UTC m=+1957.075814192" Jun 11 15:01:00.729317 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:01:00.729239 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-zprsj" Jun 11 15:03:13.263229 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:03:13.263202 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5lpfx_c3a99230-0749-4f98-97a8-cd9f586e529e/console-operator/2.log" Jun 11 15:03:13.266840 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:03:13.266821 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5lpfx_c3a99230-0749-4f98-97a8-cd9f586e529e/console-operator/2.log" Jun 11 15:03:13.267501 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:03:13.267480 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qld5j_37cb9247-f8d1-4b39-a031-89f74f7a8e1b/ovn-acl-logging/0.log" Jun 11 15:03:13.270841 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:03:13.270824 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qld5j_37cb9247-f8d1-4b39-a031-89f74f7a8e1b/ovn-acl-logging/0.log" Jun 11 15:08:13.299536 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:08:13.299435 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5lpfx_c3a99230-0749-4f98-97a8-cd9f586e529e/console-operator/2.log" Jun 11 15:08:13.303650 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:08:13.303381 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qld5j_37cb9247-f8d1-4b39-a031-89f74f7a8e1b/ovn-acl-logging/0.log" Jun 11 15:08:13.304675 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:08:13.304654 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5lpfx_c3a99230-0749-4f98-97a8-cd9f586e529e/console-operator/2.log" Jun 11 15:08:13.308305 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:08:13.308289 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-qld5j_37cb9247-f8d1-4b39-a031-89f74f7a8e1b/ovn-acl-logging/0.log" Jun 11 15:10:29.692002 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:29.691971 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-67cd5f7d45-7gdld_8393a887-f8f9-452b-98bb-e68bac2248b1/nginx/0.log" Jun 11 15:10:30.390677 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:30.390643 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-bf46957cd-ttmvz_75f5a0db-df8a-4f7f-9e44-2a5f95082311/maas-api/0.log" Jun 11 15:10:31.462017 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:31.461992 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cbcf64465-kn5w4_45e801ef-ad77-4cf2-aec4-118d95ca05f6/copy-manifests/0.log" Jun 11 15:10:31.469759 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:31.469737 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cbcf64465-kn5w4_45e801ef-ad77-4cf2-aec4-118d95ca05f6/manager/0.log" Jun 11 15:10:34.394217 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:34.394182 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-9jj4r_5082fde5-cf3e-4d25-b3d2-d1bc52453a41/manager/0.log" Jun 11 15:10:34.580894 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:34.580861 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-2d2fr_0df91591-35ff-4b11-8f7c-eda6377690c7/manager/0.log" Jun 11 15:10:34.940650 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:34.940616 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-z5gkq_58e1e6cd-7577-424d-adc6-5e6261e6e48a/registry-server/0.log" Jun 11 15:10:35.128729 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:35.128695 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-zprsj_5c33fd0e-a02d-4279-b549-34684bd66f01/manager/0.log" Jun 11 15:10:35.497803 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:35.497766 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-xzr4l_4116af36-9b01-4c99-88fe-b8c943020067/manager/0.log" Jun 11 15:10:36.114875 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:36.114842 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795k95ws_0be5a05a-19fa-406d-a49e-fa0d3a356fdd/istio-proxy/0.log" Jun 11 15:10:37.984209 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:37.984178 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq_0508791f-327b-4331-9a18-207c61f6f9b0/storage-initializer/0.log" Jun 11 15:10:37.995096 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:37.995069 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-f5c55bdc-6tqhq_0508791f-327b-4331-9a18-207c61f6f9b0/main/0.log" Jun 11 15:10:38.366407 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:38.366313 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt_27adc9b4-6d46-4ed2-9484-6530174b7984/storage-initializer/0.log" Jun 11 15:10:38.377999 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:38.377978 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-68bb6c58d9-4blmt_27adc9b4-6d46-4ed2-9484-6530174b7984/main/0.log" Jun 11 15:10:38.762170 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:38.762142 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl_b824d7ac-4f17-4e07-a2a8-e6684f32c2d5/storage-initializer/0.log" Jun 11 15:10:38.771761 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:38.771735 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-6f969c879b-x5jhl_b824d7ac-4f17-4e07-a2a8-e6684f32c2d5/main/0.log" Jun 11 15:10:38.958635 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:38.958605 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-srn98_6735673f-b3b7-4dc0-80fd-ca2876795c39/storage-initializer/0.log" Jun 11 15:10:38.980493 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:38.980470 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-srn98_6735673f-b3b7-4dc0-80fd-ca2876795c39/main/0.log" Jun 11 15:10:49.675307 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:49.675273 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fddhk_9286b965-a177-4f5c-97b7-b239fb31c9bb/global-pull-secret-syncer/0.log" Jun 11 15:10:49.859803 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:49.859769 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-trm4l_81420dd7-ea56-423e-af93-80009c14c162/konnectivity-agent/0.log" Jun 11 15:10:49.971423 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:49.971396 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-135-108.ec2.internal_8b858571848d1c6292ca0714814a05d2/haproxy/0.log" Jun 11 15:10:54.729289 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:54.729261 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-9jj4r_5082fde5-cf3e-4d25-b3d2-d1bc52453a41/manager/0.log" Jun 11 15:10:54.759570 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:54.759546 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-2d2fr_0df91591-35ff-4b11-8f7c-eda6377690c7/manager/0.log" Jun 11 15:10:54.825425 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:54.825394 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-z5gkq_58e1e6cd-7577-424d-adc6-5e6261e6e48a/registry-server/0.log" Jun 11 15:10:54.900062 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:54.900032 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-zprsj_5c33fd0e-a02d-4279-b549-34684bd66f01/manager/0.log" Jun 11 15:10:55.007500 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:55.007422 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-xzr4l_4116af36-9b01-4c99-88fe-b8c943020067/manager/0.log" Jun 11 15:10:56.989703 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:56.989674 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-74bbf69bbb-snjm5_69fe43eb-2928-4a64-bbf3-873458af8bcf/cluster-monitoring-operator/0.log" Jun 11 15:10:57.036174 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:57.036146 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-xnnvx_4d5491f8-ed80-40b9-b0d9-652471e350ef/kube-state-metrics/0.log" Jun 11 15:10:57.074266 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:57.074237 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-xnnvx_4d5491f8-ed80-40b9-b0d9-652471e350ef/kube-rbac-proxy-main/0.log" Jun 11 15:10:57.117982 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:57.117957 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-57bbf8bfb5-xnnvx_4d5491f8-ed80-40b9-b0d9-652471e350ef/kube-rbac-proxy-self/0.log" Jun 11 15:10:57.336243 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:57.336214 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s2kv6_f2d73ee8-db46-4345-96b9-b9b1cff0e75e/node-exporter/0.log" Jun 11 15:10:57.374320 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:57.374275 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s2kv6_f2d73ee8-db46-4345-96b9-b9b1cff0e75e/kube-rbac-proxy/0.log" Jun 11 15:10:57.405990 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:57.405965 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-s2kv6_f2d73ee8-db46-4345-96b9-b9b1cff0e75e/init-textfile/0.log" Jun 11 15:10:57.578605 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:57.578494 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-4srdt_3e77e773-2a6d-4baf-90c4-32f8a286a11f/kube-rbac-proxy-main/0.log" Jun 11 15:10:57.603587 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:57.603563 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-4srdt_3e77e773-2a6d-4baf-90c4-32f8a286a11f/kube-rbac-proxy-self/0.log" Jun 11 15:10:57.631451 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:57.631426 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-4srdt_3e77e773-2a6d-4baf-90c4-32f8a286a11f/openshift-state-metrics/0.log" Jun 11 15:10:57.677919 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:57.677883 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_51cbaffe-25db-4a70-8131-4e1a53551528/prometheus/0.log" Jun 11 15:10:57.699806 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:57.699782 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_51cbaffe-25db-4a70-8131-4e1a53551528/config-reloader/0.log" Jun 11 15:10:57.725283 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:57.725257 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_51cbaffe-25db-4a70-8131-4e1a53551528/thanos-sidecar/0.log" Jun 11 15:10:57.753707 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:57.753679 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_51cbaffe-25db-4a70-8131-4e1a53551528/kube-rbac-proxy-web/0.log" Jun 11 15:10:57.787691 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:57.787660 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_51cbaffe-25db-4a70-8131-4e1a53551528/kube-rbac-proxy/0.log" Jun 11 15:10:57.813710 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:57.813681 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_51cbaffe-25db-4a70-8131-4e1a53551528/kube-rbac-proxy-thanos/0.log" Jun 11 15:10:57.839298 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:57.839215 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_51cbaffe-25db-4a70-8131-4e1a53551528/init-config-reloader/0.log" Jun 11 15:10:58.063417 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:58.063387 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-df965bddb-d8zn9_7fdd8e28-341e-45cd-8f61-f08018eb84ae/thanos-query/0.log" Jun 11 15:10:58.102319 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:58.102248 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-df965bddb-d8zn9_7fdd8e28-341e-45cd-8f61-f08018eb84ae/kube-rbac-proxy-web/0.log" Jun 11 15:10:58.141705 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:58.141666 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-df965bddb-d8zn9_7fdd8e28-341e-45cd-8f61-f08018eb84ae/kube-rbac-proxy/0.log" Jun 11 15:10:58.167019 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:58.166994 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-df965bddb-d8zn9_7fdd8e28-341e-45cd-8f61-f08018eb84ae/prom-label-proxy/0.log" Jun 11 15:10:58.194117 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:58.194093 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-df965bddb-d8zn9_7fdd8e28-341e-45cd-8f61-f08018eb84ae/kube-rbac-proxy-rules/0.log" Jun 11 15:10:58.222795 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:10:58.222767 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-df965bddb-d8zn9_7fdd8e28-341e-45cd-8f61-f08018eb84ae/kube-rbac-proxy-metrics/0.log" Jun 11 15:11:00.118070 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:00.118026 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5lpfx_c3a99230-0749-4f98-97a8-cd9f586e529e/console-operator/2.log" Jun 11 15:11:00.122372 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:00.122353 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-5lpfx_c3a99230-0749-4f98-97a8-cd9f586e529e/console-operator/3.log" Jun 11 15:11:00.691974 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:00.691945 2574 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-m5f7r/perf-node-gather-daemonset-p66x4"] Jun 11 15:11:00.695844 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:00.695827 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-p66x4" Jun 11 15:11:00.698228 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:00.698198 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m5f7r\"/\"openshift-service-ca.crt\"" Jun 11 15:11:00.698968 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:00.698950 2574 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-m5f7r\"/\"kube-root-ca.crt\"" Jun 11 15:11:00.699072 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:00.698967 2574 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-m5f7r\"/\"default-dockercfg-hjcwt\"" Jun 11 15:11:00.703952 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:00.703930 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m5f7r/perf-node-gather-daemonset-p66x4"] Jun 11 15:11:00.706921 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:00.706881 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e7d14411-d7fe-40e9-877a-33f0aa644c39-proc\") pod \"perf-node-gather-daemonset-p66x4\" (UID: \"e7d14411-d7fe-40e9-877a-33f0aa644c39\") " pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-p66x4" Jun 11 15:11:00.707038 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:00.706933 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prdp8\" (UniqueName: \"kubernetes.io/projected/e7d14411-d7fe-40e9-877a-33f0aa644c39-kube-api-access-prdp8\") pod \"perf-node-gather-daemonset-p66x4\" (UID: \"e7d14411-d7fe-40e9-877a-33f0aa644c39\") " pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-p66x4" Jun 11 15:11:00.707038 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:00.707007 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e7d14411-d7fe-40e9-877a-33f0aa644c39-podres\") pod \"perf-node-gather-daemonset-p66x4\" (UID: \"e7d14411-d7fe-40e9-877a-33f0aa644c39\") " pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-p66x4" Jun 11 15:11:00.707038 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:00.707032 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7d14411-d7fe-40e9-877a-33f0aa644c39-lib-modules\") pod \"perf-node-gather-daemonset-p66x4\" (UID: \"e7d14411-d7fe-40e9-877a-33f0aa644c39\") " pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-p66x4" Jun 11 15:11:00.707194 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:00.707093 2574 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7d14411-d7fe-40e9-877a-33f0aa644c39-sys\") pod \"perf-node-gather-daemonset-p66x4\" (UID: \"e7d14411-d7fe-40e9-877a-33f0aa644c39\") " pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-p66x4" Jun 11 15:11:00.786888 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:00.786865 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-fz7mb_fc2746e0-1892-498c-ba58-d951cc2f5523/download-server/0.log" Jun 11 15:11:00.807835 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:00.807808 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e7d14411-d7fe-40e9-877a-33f0aa644c39-proc\") pod \"perf-node-gather-daemonset-p66x4\" (UID: \"e7d14411-d7fe-40e9-877a-33f0aa644c39\") " pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-p66x4" Jun 11 15:11:00.807942 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:00.807837 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prdp8\" (UniqueName: \"kubernetes.io/projected/e7d14411-d7fe-40e9-877a-33f0aa644c39-kube-api-access-prdp8\") pod \"perf-node-gather-daemonset-p66x4\" (UID: \"e7d14411-d7fe-40e9-877a-33f0aa644c39\") " pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-p66x4" Jun 11 15:11:00.807942 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:00.807883 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e7d14411-d7fe-40e9-877a-33f0aa644c39-podres\") pod \"perf-node-gather-daemonset-p66x4\" (UID: \"e7d14411-d7fe-40e9-877a-33f0aa644c39\") " pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-p66x4" Jun 11 15:11:00.807942 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:00.807917 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7d14411-d7fe-40e9-877a-33f0aa644c39-lib-modules\") pod \"perf-node-gather-daemonset-p66x4\" (UID: \"e7d14411-d7fe-40e9-877a-33f0aa644c39\") " pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-p66x4" Jun 11 15:11:00.808104 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:00.807988 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e7d14411-d7fe-40e9-877a-33f0aa644c39-podres\") pod \"perf-node-gather-daemonset-p66x4\" (UID: \"e7d14411-d7fe-40e9-877a-33f0aa644c39\") " pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-p66x4" Jun 11 15:11:00.808104 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:00.807917 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e7d14411-d7fe-40e9-877a-33f0aa644c39-proc\") pod \"perf-node-gather-daemonset-p66x4\" (UID: \"e7d14411-d7fe-40e9-877a-33f0aa644c39\") " pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-p66x4" Jun 11 15:11:00.808104 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:00.808007 2574 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7d14411-d7fe-40e9-877a-33f0aa644c39-sys\") pod \"perf-node-gather-daemonset-p66x4\" (UID: \"e7d14411-d7fe-40e9-877a-33f0aa644c39\") " pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-p66x4" Jun 11 15:11:00.808104 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:00.808054 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e7d14411-d7fe-40e9-877a-33f0aa644c39-sys\") pod \"perf-node-gather-daemonset-p66x4\" (UID: \"e7d14411-d7fe-40e9-877a-33f0aa644c39\") " pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-p66x4" Jun 11 15:11:00.808104 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:00.808081 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e7d14411-d7fe-40e9-877a-33f0aa644c39-lib-modules\") pod \"perf-node-gather-daemonset-p66x4\" (UID: \"e7d14411-d7fe-40e9-877a-33f0aa644c39\") " pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-p66x4" Jun 11 15:11:00.819850 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:00.819826 2574 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prdp8\" (UniqueName: \"kubernetes.io/projected/e7d14411-d7fe-40e9-877a-33f0aa644c39-kube-api-access-prdp8\") pod \"perf-node-gather-daemonset-p66x4\" (UID: \"e7d14411-d7fe-40e9-877a-33f0aa644c39\") " pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-p66x4" Jun 11 15:11:01.007679 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:01.007644 2574 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-p66x4" Jun 11 15:11:01.152177 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:01.152150 2574 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-m5f7r/perf-node-gather-daemonset-p66x4"] Jun 11 15:11:01.154418 ip-10-0-135-108 kubenswrapper[2574]: W0611 15:11:01.154376 2574 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode7d14411_d7fe_40e9_877a_33f0aa644c39.slice/crio-999107599defe79960e95fbed686f7cdec681ed0901389f665f2a2e52d5f659e WatchSource:0}: Error finding container 999107599defe79960e95fbed686f7cdec681ed0901389f665f2a2e52d5f659e: Status 404 returned error can't find the container with id 999107599defe79960e95fbed686f7cdec681ed0901389f665f2a2e52d5f659e Jun 11 15:11:01.908726 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:01.908688 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-p66x4" event={"ID":"e7d14411-d7fe-40e9-877a-33f0aa644c39","Type":"ContainerStarted","Data":"26214d8ca87162b479f8e2f1d20520491b3361b022fea9135fc62b5dd7c5b1a0"} Jun 11 15:11:01.909008 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:01.908782 2574 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-p66x4" event={"ID":"e7d14411-d7fe-40e9-877a-33f0aa644c39","Type":"ContainerStarted","Data":"999107599defe79960e95fbed686f7cdec681ed0901389f665f2a2e52d5f659e"} Jun 11 15:11:01.909008 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:01.908810 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-p66x4" Jun 11 15:11:01.931200 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:01.931139 2574 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-p66x4" podStartSLOduration=1.931123166 podStartE2EDuration="1.931123166s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-11 15:11:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-11 15:11:01.928649249 +0000 UTC m=+2569.261226739" watchObservedRunningTime="2026-06-11 15:11:01.931123166 +0000 UTC m=+2569.263700672" Jun 11 15:11:02.692979 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:02.692948 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dfxs5_ec9feeb0-c748-4e61-828d-f48ee812ad14/dns/0.log" Jun 11 15:11:02.716799 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:02.716771 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-dfxs5_ec9feeb0-c748-4e61-828d-f48ee812ad14/kube-rbac-proxy/0.log" Jun 11 15:11:02.831993 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:02.831962 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-nw644_e2e1c881-454a-4129-b1c4-82db9c5f65ed/dns-node-resolver/0.log" Jun 11 15:11:03.483310 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:03.483278 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-2vwxx_92c15579-52ac-4218-a656-1981d234cd34/node-ca/0.log" Jun 11 15:11:04.625781 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:04.625756 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795k95ws_0be5a05a-19fa-406d-a49e-fa0d3a356fdd/istio-proxy/0.log" Jun 11 15:11:05.764204 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:05.764178 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-6qt5g_2d770ac0-988e-46c7-a44c-9d74cd45ad3c/serve-healthcheck-canary/0.log" Jun 11 15:11:06.477812 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:06.477783 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wgxm6_1ccc09ef-7e11-4824-8da7-69bea1be972d/kube-rbac-proxy/0.log" Jun 11 15:11:06.503095 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:06.503067 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wgxm6_1ccc09ef-7e11-4824-8da7-69bea1be972d/exporter/0.log" Jun 11 15:11:06.525124 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:06.525100 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wgxm6_1ccc09ef-7e11-4824-8da7-69bea1be972d/extractor/0.log" Jun 11 15:11:07.925438 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:07.925403 2574 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-m5f7r/perf-node-gather-daemonset-p66x4" Jun 11 15:11:08.969508 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:08.969480 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_dashboard-redirect-67cd5f7d45-7gdld_8393a887-f8f9-452b-98bb-e68bac2248b1/nginx/0.log" Jun 11 15:11:09.197530 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:09.197500 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-bf46957cd-ttmvz_75f5a0db-df8a-4f7f-9e44-2a5f95082311/maas-api/0.log" Jun 11 15:11:09.694210 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:09.694186 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cbcf64465-kn5w4_45e801ef-ad77-4cf2-aec4-118d95ca05f6/manager/0.log" Jun 11 15:11:09.727809 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:09.727783 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-7cbcf64465-kn5w4_45e801ef-ad77-4cf2-aec4-118d95ca05f6/copy-manifests/0.log" Jun 11 15:11:11.702935 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:11.702903 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-868d864f-znsfk_f4141f22-2c05-4f75-908a-fc9fd7f2faef/manager/0.log" Jun 11 15:11:11.736421 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:11.736391 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-gh6mv_7f5225c7-966f-4f9f-addf-7a90ff254868/openshift-lws-operator/0.log" Jun 11 15:11:13.902213 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:13.902176 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795k95ws_0be5a05a-19fa-406d-a49e-fa0d3a356fdd/istio-proxy/0.log" Jun 11 15:11:15.501734 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:15.501706 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795k95ws_0be5a05a-19fa-406d-a49e-fa0d3a356fdd/istio-proxy/0.log" Jun 11 15:11:17.334736 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:17.334692 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-74pkt_7ed2c89b-c0c8-4aa8-9145-fb8f08e22b38/migrator/0.log" Jun 11 15:11:17.363321 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:17.363292 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-955ffdf5f-74pkt_7ed2c89b-c0c8-4aa8-9145-fb8f08e22b38/graceful-termination/0.log" Jun 11 15:11:17.706370 ip-10-0-135-108 kubenswrapper[2574]: I0611 15:11:17.706258 2574 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-74759f9795k95ws_0be5a05a-19fa-406d-a49e-fa0d3a356fdd/istio-proxy/0.log"